Jun 11 16:36:07.035993 ip-10-0-129-139 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:36:07.520289 ip-10-0-129-139 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:36:07.520289 ip-10-0-129-139 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:36:07.520289 ip-10-0-129-139 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:36:07.520985 ip-10-0-129-139 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:36:07.520985 ip-10-0-129-139 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:36:07.523325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.523229 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:36:07.527115 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527085 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:36:07.527115 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527114 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:36:07.527115 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527120 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:36:07.527115 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527123 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:36:07.527115 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527127 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527130 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527133 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527136 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527139 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527142 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527147 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527151 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527154 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527156 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527159 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527162 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527165 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527167 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527170 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527173 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527183 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527186 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527188 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527191 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:36:07.527269 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527193 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527196 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527198 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527201 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527204 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527206 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527209 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527211 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527214 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527216 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527219 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527221 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527224 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527227 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527230 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527234 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527237 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527240 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527242 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:36:07.527771 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527246 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527249 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527253 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527255 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527258 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527260 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527263 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527265 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527268 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527271 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527273 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527276 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527279 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527281 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527284 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527287 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527290 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527292 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527295 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527297 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:36:07.528247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527300 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527302 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527305 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527308 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527310 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527313 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527315 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527320 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527324 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527326 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527329 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527332 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527334 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527337 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527339 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527342 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527344 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527346 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527350 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527354 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:36:07.528754 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527357 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527360 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527363 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527367 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527369 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527372 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527375 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527377 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527380 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527383 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527385 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527389 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527393 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527396 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527399 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.527402 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528123 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528129 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528134 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:36:07.529248 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528138 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528142 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528146 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528149 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528152 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528155 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528158 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528161 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528163 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528166 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528169 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528171 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528174 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528177 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528179 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528182 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528184 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528187 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528190 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:36:07.529721 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528192 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528195 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528199 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528203 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528206 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528208 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528211 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528214 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528216 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528219 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528222 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528224 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528227 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528230 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528234 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528237 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528240 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528243 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528245 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:36:07.530199 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528248 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528252 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528254 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528257 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528260 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528263 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528265 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528268 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528271 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528273 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528276 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528278 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528281 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528283 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528286 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528289 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528291 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528293 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528296 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:36:07.530700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528299 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528302 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528306 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528310 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528312 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528315 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528318 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528321 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528324 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528326 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528329 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528332 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528334 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528337 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528340 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528343 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528345 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528348 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528350 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528353 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:36:07.531176 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528355 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528358 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528360 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528363 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528365 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528368 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528370 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528373 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528375 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528378 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528381 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528383 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528386 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528388 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528391 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528394 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528396 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528399 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528401 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528807 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:36:07.531685 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528812 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528815 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528818 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528821 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528825 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528829 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528832 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528835 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528837 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528840 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528843 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528847 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528850 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528853 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528856 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528859 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528862 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528865 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528868 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:36:07.532184 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528870 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528873 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528875 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528878 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528880 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528883 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528885 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528888 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528890 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528893 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528896 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528898 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528901 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528904 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528907 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528909 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528912 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528915 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528918 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528921 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:36:07.532687 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528923 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528926 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528928 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528931 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528933 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528936 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528938 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528941 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528943 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528946 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528948 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528950 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528953 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528955 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528958 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528960 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528963 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528965 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528968 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528970 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:36:07.533186 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528972 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528975 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528977 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528980 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528983 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528986 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528989 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528992 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528994 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.528997 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529000 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529002 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529005 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529008 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529010 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529013 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529015 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529018 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529020 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529023 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:36:07.533700 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529025 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529027 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529030 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529032 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529035 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529037 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529041 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529046 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529049 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529052 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529055 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529057 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529060 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529063 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529066 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529068 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529073 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529076 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529078 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529163 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:36:07.534233 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529173 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529183 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529189 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529196 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529201 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529207 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529212 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529216 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529219 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529222 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529226 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529229 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529232 2565 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529235 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529238 2565 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529241 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529245 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529250 2565 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529253 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529256 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529259 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529263 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529267 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:36:07.534738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529270 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529273 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529276 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529280 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529283 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529288 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529291 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529294 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529298 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529302 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529305 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529308 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529311 2565 flags.go:64] FLAG: --enable-server="true" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529314 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529319 2565 flags.go:64] FLAG: --event-burst="100" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529322 2565 flags.go:64] FLAG: --event-qps="50" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529325 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529328 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529331 2565 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529334 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529337 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529340 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529343 2565 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529346 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529348 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:36:07.535395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529351 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529354 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529357 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529360 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529363 2565 flags.go:64] FLAG: --feature-gates="" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529367 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529370 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529373 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529376 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529379 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529384 2565 flags.go:64] FLAG: --help="false" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529387 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529392 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529395 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529398 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529401 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529405 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529408 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529411 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529414 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529416 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529420 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529423 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529426 2565 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:36:07.536046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529429 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529432 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529435 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529438 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529441 2565 flags.go:64] FLAG: --lock-file="" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529444 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529447 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529450 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529455 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529458 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529461 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529464 2565 flags.go:64] FLAG: --logging-format="text" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529467 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529470 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529473 2565 flags.go:64] FLAG: --manifest-url="" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529476 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529481 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529484 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529490 2565 flags.go:64] FLAG: --max-pods="110" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529493 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529498 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529501 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529503 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529506 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529509 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:36:07.537102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529512 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529520 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529523 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529526 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529529 2565 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529533 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529538 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529554 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529557 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529561 2565 flags.go:64] FLAG: --port="10250" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529564 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529567 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04edad48016d9bb5e" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529570 2565 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529573 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529576 2565 flags.go:64] FLAG: --register-node="true" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529579 2565 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529583 2565 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529586 2565 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529588 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529591 2565 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529595 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529599 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529602 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529605 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529608 2565 flags.go:64] FLAG: --runonce="false" Jun 11 16:36:07.538208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529611 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529615 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529622 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529625 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529628 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529631 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529635 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529639 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529642 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529645 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529647 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529650 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529653 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529657 2565 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529660 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529665 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529668 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529671 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529676 2565 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529678 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529681 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529684 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529687 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529690 2565 flags.go:64] FLAG: --v="2" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529694 2565 flags.go:64] FLAG: --version="false" Jun 11 16:36:07.539023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529698 2565 flags.go:64] FLAG: --vmodule="" Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529701 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.529705 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529826 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529830 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529834 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529837 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529840 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529845 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529849 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529852 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529855 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529858 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529860 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529863 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529866 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529868 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529872 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529875 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529878 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:36:07.539854 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529880 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529884 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529886 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529889 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529892 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529894 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529897 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529899 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529902 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529905 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529907 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529910 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529912 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529915 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529917 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529920 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529922 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529925 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529928 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:36:07.540765 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529931 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529935 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529938 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529941 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529944 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529947 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529950 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529953 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529957 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529961 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529963 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529966 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529968 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529971 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529974 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529977 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529979 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529983 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529987 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:36:07.541435 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529990 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529993 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529995 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.529998 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530001 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530004 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530007 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530010 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530012 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530015 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530018 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530020 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530023 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530026 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530030 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530034 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530036 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530039 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530041 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530044 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:36:07.542151 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530047 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530049 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530053 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530056 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530059 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530062 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530065 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530068 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530071 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530074 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530077 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530080 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530083 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530086 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530089 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530091 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530094 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530097 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530099 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:36:07.543022 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530102 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530104 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530107 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530109 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.530112 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.530805 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.538492 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.538516 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.539519 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.539540 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539656 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539665 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539671 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539676 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:36:07.543711 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539680 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539685 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539690 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539694 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539699 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539704 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539708 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539713 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539717 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539722 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539726 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539730 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539734 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539738 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539742 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539747 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539754 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539760 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539764 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:36:07.544216 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539769 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539773 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539777 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539782 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539786 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539790 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539797 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539802 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539806 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539810 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539814 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539819 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539823 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539828 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539833 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539837 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539841 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539845 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539849 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539853 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:36:07.544861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539858 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539861 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539865 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539869 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539873 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539878 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539882 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539886 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539891 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539895 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539899 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539903 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539908 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539912 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539917 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539921 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539925 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539930 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:36:07.545504 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539937 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539946 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539954 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539959 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539964 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539969 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539974 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539979 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539984 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539988 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539993 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.539998 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540002 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540006 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540011 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540015 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540020 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540024 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540029 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540033 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:36:07.546027 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540037 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540041 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540046 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540050 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540055 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540059 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540063 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540068 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540072 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540076 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540081 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540085 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540090 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540095 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540100 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540105 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540109 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:36:07.546516 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540113 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.540121 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540342 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540352 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540358 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540363 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540369 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540376 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540381 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540385 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540389 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540393 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540397 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540402 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:36:07.546966 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540406 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540411 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540415 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540419 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540423 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540427 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540431 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540435 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540440 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540444 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540449 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540453 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540457 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540461 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540466 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540470 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540475 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540480 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540484 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540488 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:36:07.547327 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540492 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540497 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540501 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540505 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540509 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540513 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540517 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540521 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540526 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540530 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540534 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540538 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540560 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540565 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540570 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540574 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540578 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540582 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540587 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540591 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:36:07.548006 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540595 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540599 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540603 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540608 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540612 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540617 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540622 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540626 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540631 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540636 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540640 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540645 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540649 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540653 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540660 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540666 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540672 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540676 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540681 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:36:07.548522 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540686 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540691 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540696 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540701 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540706 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540710 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540715 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540720 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540724 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540729 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540735 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540739 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540745 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540750 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540755 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540760 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540764 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540768 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540772 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:36:07.549017 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540776 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540781 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540784 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540788 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540801 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540806 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540810 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540815 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:07.540819 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.540827 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.541019 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.543846 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.546757 2565 server.go:1019] "Starting client certificate rotation" Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.546862 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:36:07.549467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.546893 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:36:07.550531 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.550512 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:36:07.551950 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.551929 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:36:07.566644 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.566619 2565 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:36:07.569328 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.569313 2565 log.go:25] "Validated CRI v1 image API" Jun 11 16:36:07.571133 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.571118 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:36:07.572740 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.572723 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:36:07.574497 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.574475 2565 fs.go:135] Filesystem UUIDs: map[2b8b20e5-e6aa-4730-bc73-57187a25cf0a:/dev/nvme0n1p3 4d644d5d-d919-46ff-8f2b-6b6c7d863114:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 16:36:07.574583 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.574496 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:36:07.579928 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.579818 2565 manager.go:216] Machine: {Timestamp:2026-06-11 16:36:07.579289482 +0000 UTC m=+0.398856095 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098230 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26cf54c324a29d3429d5e21efcacb6 SystemUUID:ec26cf54-c324-a29d-3429-d5e21efcacb6 BootID:a36d6f13-5956-4426-b8f0-6953aaa9daf1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:a5:b2:87:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:a5:b2:87:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:e1:6c:f1:b9:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:36:07.579928 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.579924 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:36:07.580037 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.580007 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:36:07.583321 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.583288 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:36:07.583478 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.583326 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:36:07.585012 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.585000 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:36:07.585054 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.585014 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:36:07.585054 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.585027 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:36:07.585774 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.585762 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:36:07.586635 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.586623 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:36:07.589499 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.589485 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:36:07.589646 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.589635 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:36:07.589678 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.589671 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:36:07.589706 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.589686 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:36:07.589706 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.589699 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:36:07.589766 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.589709 2565 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:36:07.589766 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.589720 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:36:07.590241 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.590215 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:36:07.590339 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.590251 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:36:07.593660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.593621 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcc26" Jun 11 16:36:07.594557 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.594523 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:36:07.595876 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.595858 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:36:07.595959 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.595897 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:36:07.596959 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.596943 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:36:07.597027 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.596968 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:36:07.597027 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.596977 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:36:07.597027 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.596994 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:36:07.597027 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597008 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:36:07.597027 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597018 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:36:07.597207 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597031 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:36:07.597207 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597039 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:36:07.597207 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597049 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:36:07.597207 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597057 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:36:07.597207 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597069 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:36:07.597207 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597078 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:36:07.597843 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597831 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:36:07.597917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.597848 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:36:07.601304 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.601287 2565 server.go:1268] "Started kubelet" Jun 11 16:36:07.601454 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.601396 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:36:07.601527 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.601484 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:36:07.601710 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.601624 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:36:07.602302 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.602277 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:36:07.602302 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.602284 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:36:07.602391 ip-10-0-129-139 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:36:07.602947 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.602435 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:36:07.602947 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.602738 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcc26" Jun 11 16:36:07.603300 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.603237 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:36:07.604027 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.604012 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:36:07.607584 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.606342 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-139.ec2.internal.18b8141d0b4d6af0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-139.ec2.internal,UID:ip-10-0-129-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-139.ec2.internal,},FirstTimestamp:2026-06-11 16:36:07.601261296 +0000 UTC m=+0.420827958,LastTimestamp:2026-06-11 16:36:07.601261296 +0000 UTC m=+0.420827958,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-139.ec2.internal,}" Jun 11 16:36:07.608606 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.608589 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:36:07.608702 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.608599 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:36:07.608841 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.608819 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:07.609217 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.609189 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:36:07.609297 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.609262 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:36:07.609374 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.609232 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:36:07.609423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.609417 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:36:07.609466 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.609425 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:36:07.609638 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.608967 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:36:07.610649 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.610182 2565 factory.go:55] Registering systemd factory Jun 11 16:36:07.610649 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.610203 2565 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:36:07.610785 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.610733 2565 factory.go:153] Registering CRI-O factory Jun 11 16:36:07.610785 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.610749 2565 factory.go:223] Registration of the crio container factory successfully Jun 11 16:36:07.610875 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.610809 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:36:07.610875 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.610831 2565 factory.go:103] Registering Raw factory Jun 11 16:36:07.610875 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.610844 2565 manager.go:1196] Started watching for new ooms in manager Jun 11 16:36:07.611665 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.611643 2565 manager.go:349] Starting recovery of all containers Jun 11 16:36:07.617889 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.617852 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:36:07.622189 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.621993 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:36:07.624847 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.624795 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-139.ec2.internal\" not found" node="ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.625489 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.625474 2565 manager.go:354] Recovery completed Jun 11 16:36:07.629774 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.629760 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:36:07.631839 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.631817 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:36:07.631927 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.631854 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:36:07.631927 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.631867 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:36:07.632372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.632354 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:36:07.632372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.632371 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:36:07.632456 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.632392 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:36:07.632456 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.632363 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:36:07.633520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.633505 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:36:07.633725 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.633535 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:36:07.633725 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.633564 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:36:07.633725 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.633650 2565 policy_none.go:49] "None policy: Start" Jun 11 16:36:07.633725 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.633668 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:36:07.633725 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.633685 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:36:07.634748 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.634735 2565 policy_none.go:47] "Start" Jun 11 16:36:07.680334 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.680312 2565 manager.go:337] "Starting Device Plugin manager" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.680356 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.680370 2565 server.go:87] "Starting device plugin registration server" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.680655 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.680667 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.680779 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.680912 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.680927 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.681559 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.681614 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.690421 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.690459 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.690479 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:36:07.690775 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.690515 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:36:07.692771 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.692749 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:36:07.781065 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.780954 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:36:07.782930 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.782907 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:36:07.783063 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.782944 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:36:07.783063 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.782959 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:36:07.783063 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.782998 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.791341 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.791320 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.791341 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.791336 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal"] Jun 11 16:36:07.791471 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.791347 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-139.ec2.internal\": node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:07.791471 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.791437 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:36:07.792341 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.792322 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:36:07.792449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.792355 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:36:07.792449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.792366 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:36:07.793910 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.793896 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:36:07.794011 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.793997 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.794059 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.794033 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:36:07.794741 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.794718 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:36:07.794844 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.794744 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:36:07.794844 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.794752 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:36:07.794844 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.794762 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:36:07.794844 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.794768 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:36:07.794844 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.794776 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:36:07.796016 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.796000 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.796102 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.796040 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:36:07.796842 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.796826 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:36:07.796922 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.796853 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:36:07.796922 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.796864 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:36:07.806804 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.806788 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:07.812165 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.812149 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-139.ec2.internal\" not found" node="ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.816298 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.816282 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-139.ec2.internal\" not found" node="ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.907597 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:07.907564 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:07.910847 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.910827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33e4799e2cf9d90f29ee83bae71e9e5d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-139.ec2.internal\" (UID: \"33e4799e2cf9d90f29ee83bae71e9e5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.910916 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.910855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:07.910982 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:07.910956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.008324 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.008291 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.011594 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.011570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.011700 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.011611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33e4799e2cf9d90f29ee83bae71e9e5d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-139.ec2.internal\" (UID: \"33e4799e2cf9d90f29ee83bae71e9e5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.011700 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.011638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.011700 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.011650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.011700 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.011674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.011830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.011719 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33e4799e2cf9d90f29ee83bae71e9e5d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-139.ec2.internal\" (UID: \"33e4799e2cf9d90f29ee83bae71e9e5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.109044 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.108962 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.116330 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.116311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.120153 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.119960 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.209729 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.209687 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.310134 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.310096 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.410621 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.410530 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.510997 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.510954 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.546280 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.546258 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:36:08.546870 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.546418 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:36:08.546870 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.546463 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:36:08.601025 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.600982 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:36:08.610258 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.610226 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:31:07 +0000 UTC" deadline="2028-02-26 13:53:25.071394766 +0000 UTC" Jun 11 16:36:08.610258 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.610255 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14997h17m16.46114332s" Jun 11 16:36:08.611323 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.611306 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.643219 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:08.643187 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e4799e2cf9d90f29ee83bae71e9e5d.slice/crio-ad8d5cbe77cfecf4fe5a84d6af156110b89ac5f44d9c15749b305eca1ee5bf87 WatchSource:0}: Error finding container ad8d5cbe77cfecf4fe5a84d6af156110b89ac5f44d9c15749b305eca1ee5bf87: Status 404 returned error can't find the container with id ad8d5cbe77cfecf4fe5a84d6af156110b89ac5f44d9c15749b305eca1ee5bf87 Jun 11 16:36:08.644222 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:08.644198 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802ce0072bc35220ef07e5a5529f3ab8.slice/crio-11bfeb3ea75de5153e82ec2b42ff69c564326e76a1a946dc992203d5164853c4 WatchSource:0}: Error finding container 11bfeb3ea75de5153e82ec2b42ff69c564326e76a1a946dc992203d5164853c4: Status 404 returned error can't find the container with id 11bfeb3ea75de5153e82ec2b42ff69c564326e76a1a946dc992203d5164853c4 Jun 11 16:36:08.651597 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.651581 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:36:08.694224 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.694124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" event={"ID":"33e4799e2cf9d90f29ee83bae71e9e5d","Type":"ContainerStarted","Data":"ad8d5cbe77cfecf4fe5a84d6af156110b89ac5f44d9c15749b305eca1ee5bf87"} Jun 11 16:36:08.695222 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.695200 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" event={"ID":"802ce0072bc35220ef07e5a5529f3ab8","Type":"ContainerStarted","Data":"11bfeb3ea75de5153e82ec2b42ff69c564326e76a1a946dc992203d5164853c4"} Jun 11 16:36:08.711554 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.711520 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.812016 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:08.811985 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 11 16:36:08.895803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.895779 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:36:08.910166 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.910140 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.923021 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.922996 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:36:08.924173 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.924158 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 11 16:36:08.932290 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:08.932273 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:36:09.591508 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.591415 2565 apiserver.go:52] "Watching apiserver" Jun 11 16:36:09.599896 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.599855 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:36:09.600620 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.600490 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal","openshift-multus/network-metrics-daemon-ddsx7","openshift-network-diagnostics/network-check-target-8n5hh","openshift-network-operator/iptables-alerter-zhpw2","kube-system/global-pull-secret-syncer-bp9d4","kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal","openshift-cluster-node-tuning-operator/tuned-w7v77","openshift-image-registry/node-ca-48xp7","openshift-multus/multus-additional-cni-plugins-q844p","openshift-multus/multus-jmhkm","openshift-ovn-kubernetes/ovnkube-node-xbs4x","kube-system/konnectivity-agent-czlvh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4","openshift-dns/node-resolver-p79f5"] Jun 11 16:36:09.603283 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.602732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.604430 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.604408 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:09.604559 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.604491 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:09.604959 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.604939 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:36:09.605063 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.605045 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:36:09.605188 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.605139 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:36:09.605188 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.605131 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:36:09.605416 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.605398 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xkx7k\"" Jun 11 16:36:09.605530 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.605461 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:36:09.606208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.606191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:09.606322 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.606262 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:09.607420 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.607365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.609155 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.609134 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:36:09.609247 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.609193 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vr5rj\"" Jun 11 16:36:09.609386 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.609368 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:36:09.609457 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.609409 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.609871 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.609851 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:36:09.611054 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.611034 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m9vbq\"" Jun 11 16:36:09.611273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.611162 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:36:09.611273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.611252 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:36:09.611627 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.611440 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.612627 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.612610 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.613209 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.613190 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:36:09.613684 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.613511 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:36:09.615042 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.614993 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:36:09.615133 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.615112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7zgst\"" Jun 11 16:36:09.616574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.615214 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:36:09.616574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.615625 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:36:09.616574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.615742 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:36:09.616574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.615847 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:36:09.616574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.616066 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:36:09.616574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.616113 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-86trd\"" Jun 11 16:36:09.616574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.616322 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.618307 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.618050 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.619343 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619321 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:36:09.619343 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619341 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:36:09.619483 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619399 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wwl2h\"" Jun 11 16:36:09.619483 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619342 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:36:09.619867 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-system-cni-dir\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.619953 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcr9k\" (UniqueName: \"kubernetes.io/projected/ba2c30aa-b038-41d0-baae-a0916f5b459e-kube-api-access-qcr9k\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:09.619953 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.619953 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619935 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/035eab56-2e83-4307-b49c-517b6622e9fa-hosts-file\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/035eab56-2e83-4307-b49c-517b6622e9fa-tmp-dir\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.619985 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-kubelet\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-systemd-units\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-run-netns\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-log-socket\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-systemd\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6988a27-687d-4721-a899-14b4bf72b6f4-ovn-node-metrics-cert\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.620180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svn6h\" (UniqueName: \"kubernetes.io/projected/035eab56-2e83-4307-b49c-517b6622e9fa-kube-api-access-svn6h\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-node-log\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0-konnectivity-ca\") pod \"konnectivity-agent-czlvh\" (UID: \"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0\") " pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-slash\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-etc-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-ovnkube-config\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620454 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smwg5\" (UniqueName: \"kubernetes.io/projected/c08f7c43-1ca5-4a1e-b463-53f71efe452b-kube-api-access-smwg5\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-cni-bin\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-ovnkube-script-lib\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-var-lib-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620625 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lqxmb\"" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.620864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-env-overrides\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620686 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cnibin\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-os-release\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0-agent-certs\") pod \"konnectivity-agent-czlvh\" (UID: \"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0\") " pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-ovn\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-cni-netd\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.620844 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5lnr\" (UniqueName: \"kubernetes.io/projected/d6988a27-687d-4721-a899-14b4bf72b6f4-kube-api-access-t5lnr\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.621038 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.621112 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:09.621477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.621300 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:36:09.622649 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.622492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.623841 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.623822 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.625033 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.624729 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:36:09.625033 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.624793 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-db5d9\"" Jun 11 16:36:09.625033 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.624903 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:36:09.625033 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.624942 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:36:09.625946 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.625922 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:36:09.626368 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.626346 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qxwz6\"" Jun 11 16:36:09.626456 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.626434 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:36:09.626786 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.626763 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:36:09.642016 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.641989 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5wwzb" Jun 11 16:36:09.649511 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.649487 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5wwzb" Jun 11 16:36:09.710259 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.710232 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:36:09.721281 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysctl-d\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.721281 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-tuned\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63acdc96-d33c-4a19-bef6-df4ffd0223bc-host-slash\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0-konnectivity-ca\") pod \"konnectivity-agent-czlvh\" (UID: \"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0\") " pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721414 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-ovnkube-config\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30f045c6-2e71-4b56-87d6-fa2a8146e250-dbus\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:09.721514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721476 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-cni-bin\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-tmp\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.721589 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-conf-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721625 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-cni-bin\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-daemon-config\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.721675 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs podName:ba2c30aa-b038-41d0-baae-a0916f5b459e nodeName:}" failed. No retries permitted until 2026-06-11 16:36:10.221637258 +0000 UTC m=+3.041203875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs") pod "network-metrics-daemon-ddsx7" (UID: "ba2c30aa-b038-41d0-baae-a0916f5b459e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-etc-selinux\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-var-lib-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-var-lib-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.721912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-env-overrides\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30f045c6-2e71-4b56-87d6-fa2a8146e250-kubelet-config\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-modprobe-d\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.721991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-os-release\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cnibin\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-os-release\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0-konnectivity-ca\") pod \"konnectivity-agent-czlvh\" (UID: \"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0\") " pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-ovn\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cnibin\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-cni-netd\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722105 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-ovnkube-config\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722137 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-ovn\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-os-release\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.722463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lnr\" (UniqueName: \"kubernetes.io/projected/d6988a27-687d-4721-a899-14b4bf72b6f4-kube-api-access-t5lnr\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-system-cni-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-cni-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-system-cni-dir\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722183 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-cni-netd\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcr9k\" (UniqueName: \"kubernetes.io/projected/ba2c30aa-b038-41d0-baae-a0916f5b459e-kube-api-access-qcr9k\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-system-cni-dir\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722342 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-env-overrides\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-netns\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-cni-multus\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/035eab56-2e83-4307-b49c-517b6622e9fa-hosts-file\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/035eab56-2e83-4307-b49c-517b6622e9fa-tmp-dir\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-kubelet\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-systemd-units\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/035eab56-2e83-4307-b49c-517b6622e9fa-hosts-file\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-run-netns\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.723388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-kubelet\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-systemd-units\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2267e07d-322f-4b09-b27c-04bc24ec4d62-cni-binary-copy\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-run-netns\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-multus-certs\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-systemd\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6988a27-687d-4721-a899-14b4bf72b6f4-ovn-node-metrics-cert\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vrzl\" (UniqueName: \"kubernetes.io/projected/cfd99b7b-a943-4ad7-a8bb-aba85c971226-kube-api-access-5vrzl\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-run-systemd\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722761 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/035eab56-2e83-4307-b49c-517b6622e9fa-tmp-dir\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-kubernetes\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-host\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-run\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-kubelet\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktdjf\" (UniqueName: \"kubernetes.io/projected/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-kube-api-access-ktdjf\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.722969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-slash\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-etc-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723035 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-host-slash\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723076 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723080 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-etc-openvswitch\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-systemd\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smwg5\" (UniqueName: \"kubernetes.io/projected/c08f7c43-1ca5-4a1e-b463-53f71efe452b-kube-api-access-smwg5\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-ovnkube-script-lib\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm4s5\" (UniqueName: \"kubernetes.io/projected/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-kube-api-access-hm4s5\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-k8s-cni-cncf-io\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-hostroot\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-socket-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6rzx\" (UniqueName: \"kubernetes.io/projected/63acdc96-d33c-4a19-bef6-df4ffd0223bc-kube-api-access-p6rzx\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0-agent-certs\") pod \"konnectivity-agent-czlvh\" (UID: \"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0\") " pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-socket-dir-parent\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723478 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-registration-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysconfig\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-var-lib-kubelet\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-etc-kubernetes\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.724915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78wtj\" (UniqueName: \"kubernetes.io/projected/2267e07d-322f-4b09-b27c-04bc24ec4d62-kube-api-access-78wtj\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-log-socket\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfd99b7b-a943-4ad7-a8bb-aba85c971226-host\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysctl-conf\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-lib-modules\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-cni-bin\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723819 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6988a27-687d-4721-a899-14b4bf72b6f4-ovnkube-script-lib\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-device-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-sys-fs\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723892 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-log-socket\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.723897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724053 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c08f7c43-1ca5-4a1e-b463-53f71efe452b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724170 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfd99b7b-a943-4ad7-a8bb-aba85c971226-serviceca\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-sys\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-cnibin\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63acdc96-d33c-4a19-bef6-df4ffd0223bc-iptables-alerter-script\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.725703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.726525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.726525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svn6h\" (UniqueName: \"kubernetes.io/projected/035eab56-2e83-4307-b49c-517b6622e9fa-kube-api-access-svn6h\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.726525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.726525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-node-log\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.726525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.724570 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6988a27-687d-4721-a899-14b4bf72b6f4-node-log\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.726525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.725009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.726525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.725074 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c08f7c43-1ca5-4a1e-b463-53f71efe452b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.726842 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.726739 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6988a27-687d-4721-a899-14b4bf72b6f4-ovn-node-metrics-cert\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.726952 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.726932 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0-agent-certs\") pod \"konnectivity-agent-czlvh\" (UID: \"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0\") " pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.732360 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.732330 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:36:09.732360 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.732354 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:36:09.732523 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.732368 2565 projected.go:196] Error preparing data for projected volume kube-api-access-xmjrc for pod openshift-network-diagnostics/network-check-target-8n5hh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:09.732523 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.732418 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc podName:3fe0e73d-c35d-41f5-9d36-3a249703a304 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:10.232403149 +0000 UTC m=+3.051969750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xmjrc" (UniqueName: "kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc") pod "network-check-target-8n5hh" (UID: "3fe0e73d-c35d-41f5-9d36-3a249703a304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:09.735254 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.735227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcr9k\" (UniqueName: \"kubernetes.io/projected/ba2c30aa-b038-41d0-baae-a0916f5b459e-kube-api-access-qcr9k\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:09.735904 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.735854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smwg5\" (UniqueName: \"kubernetes.io/projected/c08f7c43-1ca5-4a1e-b463-53f71efe452b-kube-api-access-smwg5\") pod \"multus-additional-cni-plugins-q844p\" (UID: \"c08f7c43-1ca5-4a1e-b463-53f71efe452b\") " pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.735998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.735939 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lnr\" (UniqueName: \"kubernetes.io/projected/d6988a27-687d-4721-a899-14b4bf72b6f4-kube-api-access-t5lnr\") pod \"ovnkube-node-xbs4x\" (UID: \"d6988a27-687d-4721-a899-14b4bf72b6f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.735998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.735952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svn6h\" (UniqueName: \"kubernetes.io/projected/035eab56-2e83-4307-b49c-517b6622e9fa-kube-api-access-svn6h\") pod \"node-resolver-p79f5\" (UID: \"035eab56-2e83-4307-b49c-517b6622e9fa\") " pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.825198 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysctl-d\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.825198 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-tuned\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.825394 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.825394 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825345 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysctl-d\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.825394 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63acdc96-d33c-4a19-bef6-df4ffd0223bc-host-slash\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.825558 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825410 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.825558 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825393 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63acdc96-d33c-4a19-bef6-df4ffd0223bc-host-slash\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.825558 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30f045c6-2e71-4b56-87d6-fa2a8146e250-dbus\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.825558 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-tmp\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.825558 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-conf-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-daemon-config\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825578 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-conf-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825594 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-etc-selinux\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30f045c6-2e71-4b56-87d6-fa2a8146e250-kubelet-config\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/30f045c6-2e71-4b56-87d6-fa2a8146e250-dbus\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-modprobe-d\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-os-release\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825733 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/30f045c6-2e71-4b56-87d6-fa2a8146e250-kubelet-config\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825740 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-etc-selinux\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-system-cni-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.825792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-cni-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-modprobe-d\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825811 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-system-cni-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-netns\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-netns\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825855 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-cni-multus\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-os-release\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-cni-multus\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2267e07d-322f-4b09-b27c-04bc24ec4d62-cni-binary-copy\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825948 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-cni-dir\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.825973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-multus-certs\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.825988 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vrzl\" (UniqueName: \"kubernetes.io/projected/cfd99b7b-a943-4ad7-a8bb-aba85c971226-kube-api-access-5vrzl\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-kubernetes\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-host\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:09.826094 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret podName:30f045c6-2e71-4b56-87d6-fa2a8146e250 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:10.3260742 +0000 UTC m=+3.145640818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret") pod "global-pull-secret-syncer-bp9d4" (UID: "30f045c6-2e71-4b56-87d6-fa2a8146e250") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-host\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.826303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-run\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-daemon-config\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-kubelet\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-kubernetes\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktdjf\" (UniqueName: \"kubernetes.io/projected/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-kube-api-access-ktdjf\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826197 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-run\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-systemd\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826241 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-systemd\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm4s5\" (UniqueName: \"kubernetes.io/projected/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-kube-api-access-hm4s5\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-k8s-cni-cncf-io\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-kubelet\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-hostroot\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-socket-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rzx\" (UniqueName: \"kubernetes.io/projected/63acdc96-d33c-4a19-bef6-df4ffd0223bc-kube-api-access-p6rzx\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-socket-dir-parent\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-registration-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826430 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-k8s-cni-cncf-io\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2267e07d-322f-4b09-b27c-04bc24ec4d62-cni-binary-copy\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysconfig\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-var-lib-kubelet\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-run-multus-certs\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-etc-kubernetes\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-multus-socket-dir-parent\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-var-lib-kubelet\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-registration-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826631 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-etc-kubernetes\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-hostroot\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wtj\" (UniqueName: \"kubernetes.io/projected/2267e07d-322f-4b09-b27c-04bc24ec4d62-kube-api-access-78wtj\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfd99b7b-a943-4ad7-a8bb-aba85c971226-host\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysctl-conf\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysconfig\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-socket-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-lib-modules\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826794 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfd99b7b-a943-4ad7-a8bb-aba85c971226-host\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-cni-bin\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.827936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-device-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-lib-modules\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-sys-fs\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-sysctl-conf\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826930 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-host-var-lib-cni-bin\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-sys-fs\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.826992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-device-dir\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfd99b7b-a943-4ad7-a8bb-aba85c971226-serviceca\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-sys\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-cnibin\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63acdc96-d33c-4a19-bef6-df4ffd0223bc-iptables-alerter-script\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-sys\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827146 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2267e07d-322f-4b09-b27c-04bc24ec4d62-cnibin\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827457 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfd99b7b-a943-4ad7-a8bb-aba85c971226-serviceca\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827658 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63acdc96-d33c-4a19-bef6-df4ffd0223bc-iptables-alerter-script\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.827991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-tmp\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.828621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.828163 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-etc-tuned\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.834408 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.834373 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm4s5\" (UniqueName: \"kubernetes.io/projected/4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2-kube-api-access-hm4s5\") pod \"tuned-w7v77\" (UID: \"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2\") " pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.834559 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.834369 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6rzx\" (UniqueName: \"kubernetes.io/projected/63acdc96-d33c-4a19-bef6-df4ffd0223bc-kube-api-access-p6rzx\") pod \"iptables-alerter-zhpw2\" (UID: \"63acdc96-d33c-4a19-bef6-df4ffd0223bc\") " pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:09.834559 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.834442 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktdjf\" (UniqueName: \"kubernetes.io/projected/c846a8c3-d1b9-4ebd-8920-ac4c845acf39-kube-api-access-ktdjf\") pod \"aws-ebs-csi-driver-node-5nbt4\" (UID: \"c846a8c3-d1b9-4ebd-8920-ac4c845acf39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.835240 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.835218 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vrzl\" (UniqueName: \"kubernetes.io/projected/cfd99b7b-a943-4ad7-a8bb-aba85c971226-kube-api-access-5vrzl\") pod \"node-ca-48xp7\" (UID: \"cfd99b7b-a943-4ad7-a8bb-aba85c971226\") " pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.835344 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.835263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78wtj\" (UniqueName: \"kubernetes.io/projected/2267e07d-322f-4b09-b27c-04bc24ec4d62-kube-api-access-78wtj\") pod \"multus-jmhkm\" (UID: \"2267e07d-322f-4b09-b27c-04bc24ec4d62\") " pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.861941 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.861863 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:36:09.915680 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.915648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q844p" Jun 11 16:36:09.927634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.927594 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p79f5" Jun 11 16:36:09.934767 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.934735 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:09.942587 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.942558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:09.950325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.950302 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w7v77" Jun 11 16:36:09.957875 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.957851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48xp7" Jun 11 16:36:09.965744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.965723 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jmhkm" Jun 11 16:36:09.972592 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.972567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" Jun 11 16:36:09.978176 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:09.978155 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zhpw2" Jun 11 16:36:10.020928 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.020893 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:36:10.229932 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.229841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:10.230081 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.229998 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:10.230081 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.230078 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs podName:ba2c30aa-b038-41d0-baae-a0916f5b459e nodeName:}" failed. No retries permitted until 2026-06-11 16:36:11.230055128 +0000 UTC m=+4.049621751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs") pod "network-metrics-daemon-ddsx7" (UID: "ba2c30aa-b038-41d0-baae-a0916f5b459e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:10.331166 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.331129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:10.331361 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.331191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:10.331361 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.331303 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:10.331361 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.331323 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:36:10.331361 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.331346 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:36:10.331361 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.331358 2565 projected.go:196] Error preparing data for projected volume kube-api-access-xmjrc for pod openshift-network-diagnostics/network-check-target-8n5hh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:10.331670 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.331374 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret podName:30f045c6-2e71-4b56-87d6-fa2a8146e250 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:11.331354786 +0000 UTC m=+4.150921405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret") pod "global-pull-secret-syncer-bp9d4" (UID: "30f045c6-2e71-4b56-87d6-fa2a8146e250") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:10.331670 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.331411 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc podName:3fe0e73d-c35d-41f5-9d36-3a249703a304 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:11.331393385 +0000 UTC m=+4.150960004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmjrc" (UniqueName: "kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc") pod "network-check-target-8n5hh" (UID: "3fe0e73d-c35d-41f5-9d36-3a249703a304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:10.478422 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:10.478384 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6988a27_687d_4721_a899_14b4bf72b6f4.slice/crio-bafc6a48e72ff2f772c369e42563237c6006d61d39eab87bceb53938d8046707 WatchSource:0}: Error finding container bafc6a48e72ff2f772c369e42563237c6006d61d39eab87bceb53938d8046707: Status 404 returned error can't find the container with id bafc6a48e72ff2f772c369e42563237c6006d61d39eab87bceb53938d8046707 Jun 11 16:36:10.480177 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:10.479946 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247ee0c0_0da2_4ea8_bb98_0d5c7dffbdf0.slice/crio-ac96de5e811e0da43d76082957fff0111c2bc3dd480fa546d1121815b2cf20a5 WatchSource:0}: Error finding container ac96de5e811e0da43d76082957fff0111c2bc3dd480fa546d1121815b2cf20a5: Status 404 returned error can't find the container with id ac96de5e811e0da43d76082957fff0111c2bc3dd480fa546d1121815b2cf20a5 Jun 11 16:36:10.483693 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:10.483670 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc846a8c3_d1b9_4ebd_8920_ac4c845acf39.slice/crio-c9dba7129efc4b19511b269e25357b8fc16ec0c22f0b3a8eeba53e5c52d84a3e WatchSource:0}: Error finding container c9dba7129efc4b19511b269e25357b8fc16ec0c22f0b3a8eeba53e5c52d84a3e: Status 404 returned error can't find the container with id c9dba7129efc4b19511b269e25357b8fc16ec0c22f0b3a8eeba53e5c52d84a3e Jun 11 16:36:10.485247 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:10.485225 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd99b7b_a943_4ad7_a8bb_aba85c971226.slice/crio-635107b6a54ee7acb178d3d28f835f9b3d49f00ecb70684a174c9deed7ad3c18 WatchSource:0}: Error finding container 635107b6a54ee7acb178d3d28f835f9b3d49f00ecb70684a174c9deed7ad3c18: Status 404 returned error can't find the container with id 635107b6a54ee7acb178d3d28f835f9b3d49f00ecb70684a174c9deed7ad3c18 Jun 11 16:36:10.486072 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:10.486047 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63acdc96_d33c_4a19_bef6_df4ffd0223bc.slice/crio-63898c0800cbfccd77e7cc51443ba2bba559f16f15a43d61782b1717a9d2c0eb WatchSource:0}: Error finding container 63898c0800cbfccd77e7cc51443ba2bba559f16f15a43d61782b1717a9d2c0eb: Status 404 returned error can't find the container with id 63898c0800cbfccd77e7cc51443ba2bba559f16f15a43d61782b1717a9d2c0eb Jun 11 16:36:10.488477 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:10.488352 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2267e07d_322f_4b09_b27c_04bc24ec4d62.slice/crio-3abcac32b6056883cb0734ce0ed4323cf967121a3c87de8e1dac97d909c3ad17 WatchSource:0}: Error finding container 3abcac32b6056883cb0734ce0ed4323cf967121a3c87de8e1dac97d909c3ad17: Status 404 returned error can't find the container with id 3abcac32b6056883cb0734ce0ed4323cf967121a3c87de8e1dac97d909c3ad17 Jun 11 16:36:10.652596 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.652322 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:31:09 +0000 UTC" deadline="2027-11-08 21:46:23.102747968 +0000 UTC" Jun 11 16:36:10.652596 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.652596 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12365h10m12.450158726s" Jun 11 16:36:10.690849 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.690817 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:10.691005 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:10.690924 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:10.700288 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.700251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jmhkm" event={"ID":"2267e07d-322f-4b09-b27c-04bc24ec4d62","Type":"ContainerStarted","Data":"3abcac32b6056883cb0734ce0ed4323cf967121a3c87de8e1dac97d909c3ad17"} Jun 11 16:36:10.701320 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.701294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-czlvh" event={"ID":"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0","Type":"ContainerStarted","Data":"ac96de5e811e0da43d76082957fff0111c2bc3dd480fa546d1121815b2cf20a5"} Jun 11 16:36:10.702393 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.702367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"bafc6a48e72ff2f772c369e42563237c6006d61d39eab87bceb53938d8046707"} Jun 11 16:36:10.704592 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.704529 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" event={"ID":"33e4799e2cf9d90f29ee83bae71e9e5d","Type":"ContainerStarted","Data":"e9b5142b5bf10211d3e4ab33ddb65b1f0f54807a3ddf09a80599deaf519fe1fd"} Jun 11 16:36:10.705754 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.705726 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w7v77" event={"ID":"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2","Type":"ContainerStarted","Data":"eb7e7b9fda10d3fe0ffc73c6883e06cd1c303767718550348904bdf5a25cd81c"} Jun 11 16:36:10.706620 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.706599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zhpw2" event={"ID":"63acdc96-d33c-4a19-bef6-df4ffd0223bc","Type":"ContainerStarted","Data":"63898c0800cbfccd77e7cc51443ba2bba559f16f15a43d61782b1717a9d2c0eb"} Jun 11 16:36:10.707642 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.707623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48xp7" event={"ID":"cfd99b7b-a943-4ad7-a8bb-aba85c971226","Type":"ContainerStarted","Data":"635107b6a54ee7acb178d3d28f835f9b3d49f00ecb70684a174c9deed7ad3c18"} Jun 11 16:36:10.708582 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.708563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" event={"ID":"c846a8c3-d1b9-4ebd-8920-ac4c845acf39","Type":"ContainerStarted","Data":"c9dba7129efc4b19511b269e25357b8fc16ec0c22f0b3a8eeba53e5c52d84a3e"} Jun 11 16:36:10.709626 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.709606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p79f5" event={"ID":"035eab56-2e83-4307-b49c-517b6622e9fa","Type":"ContainerStarted","Data":"9cd2cbec49aa2c1cf553f67edc87a50ff3bcddc3aa1f13d11517679bf1e18252"} Jun 11 16:36:10.710615 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.710593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerStarted","Data":"68c757cdec2be69954e1703cc5d3f0da75af2201adb409d7a9c38e93c74e1c10"} Jun 11 16:36:10.719370 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:10.719320 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" podStartSLOduration=2.719305709 podStartE2EDuration="2.719305709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:10.718868556 +0000 UTC m=+3.538435179" watchObservedRunningTime="2026-06-11 16:36:10.719305709 +0000 UTC m=+3.538872331" Jun 11 16:36:11.239228 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.238630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:11.239228 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.238807 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:11.239228 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.238885 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs podName:ba2c30aa-b038-41d0-baae-a0916f5b459e nodeName:}" failed. No retries permitted until 2026-06-11 16:36:13.23886525 +0000 UTC m=+6.058431855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs") pod "network-metrics-daemon-ddsx7" (UID: "ba2c30aa-b038-41d0-baae-a0916f5b459e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:11.339045 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.339003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:11.339231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.339069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:11.339231 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.339206 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:11.339339 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.339271 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret podName:30f045c6-2e71-4b56-87d6-fa2a8146e250 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:13.339252139 +0000 UTC m=+6.158818742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret") pod "global-pull-secret-syncer-bp9d4" (UID: "30f045c6-2e71-4b56-87d6-fa2a8146e250") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:11.339706 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.339687 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:36:11.339792 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.339712 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:36:11.339792 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.339725 2565 projected.go:196] Error preparing data for projected volume kube-api-access-xmjrc for pod openshift-network-diagnostics/network-check-target-8n5hh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:11.339900 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.339810 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc podName:3fe0e73d-c35d-41f5-9d36-3a249703a304 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:13.339794431 +0000 UTC m=+6.159361051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmjrc" (UniqueName: "kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc") pod "network-check-target-8n5hh" (UID: "3fe0e73d-c35d-41f5-9d36-3a249703a304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:11.653454 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.653356 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:31:09 +0000 UTC" deadline="2027-12-20 23:00:54.504438961 +0000 UTC" Jun 11 16:36:11.653454 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.653398 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13374h24m42.851046043s" Jun 11 16:36:11.693400 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.693355 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:11.693580 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.693497 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:11.693915 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.693895 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:11.694006 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:11.693989 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:11.732702 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.732655 2565 generic.go:356] "Generic (PLEG): container finished" podID="802ce0072bc35220ef07e5a5529f3ab8" containerID="307ca10c08d48d1558cc30d1fed6dafd755c9086a485258225a795fc69e3f3e2" exitCode=0 Jun 11 16:36:11.732882 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:11.732779 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" event={"ID":"802ce0072bc35220ef07e5a5529f3ab8","Type":"ContainerDied","Data":"307ca10c08d48d1558cc30d1fed6dafd755c9086a485258225a795fc69e3f3e2"} Jun 11 16:36:12.691234 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:12.690749 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:12.691234 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:12.690882 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:12.756586 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:12.755021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" event={"ID":"802ce0072bc35220ef07e5a5529f3ab8","Type":"ContainerStarted","Data":"870c1f1db4ea8d88c4ede6d2f11be57e338c2ec9995e880bea34b1f769c4c124"} Jun 11 16:36:12.775746 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:12.774280 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" podStartSLOduration=4.774259625 podStartE2EDuration="4.774259625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:12.773160121 +0000 UTC m=+5.592726738" watchObservedRunningTime="2026-06-11 16:36:12.774259625 +0000 UTC m=+5.593826248" Jun 11 16:36:13.254914 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:13.254872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:13.255109 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.255073 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:13.255175 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.255139 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs podName:ba2c30aa-b038-41d0-baae-a0916f5b459e nodeName:}" failed. No retries permitted until 2026-06-11 16:36:17.25512003 +0000 UTC m=+10.074686634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs") pod "network-metrics-daemon-ddsx7" (UID: "ba2c30aa-b038-41d0-baae-a0916f5b459e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:13.355752 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:13.355713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:13.355931 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:13.355774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:13.355931 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.355918 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:13.356039 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.355983 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret podName:30f045c6-2e71-4b56-87d6-fa2a8146e250 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:17.355961834 +0000 UTC m=+10.175528454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret") pod "global-pull-secret-syncer-bp9d4" (UID: "30f045c6-2e71-4b56-87d6-fa2a8146e250") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:13.356426 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.356402 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:36:13.356529 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.356430 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:36:13.356529 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.356442 2565 projected.go:196] Error preparing data for projected volume kube-api-access-xmjrc for pod openshift-network-diagnostics/network-check-target-8n5hh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:13.356529 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.356486 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc podName:3fe0e73d-c35d-41f5-9d36-3a249703a304 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:17.356471803 +0000 UTC m=+10.176038417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmjrc" (UniqueName: "kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc") pod "network-check-target-8n5hh" (UID: "3fe0e73d-c35d-41f5-9d36-3a249703a304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:13.691944 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:13.691805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:13.691944 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:13.691851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:13.692424 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.691965 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:13.692424 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:13.692376 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:14.691495 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:14.691460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:14.691690 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:14.691627 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:15.691441 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:15.691405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:15.691908 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:15.691588 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:15.691908 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:15.691633 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:15.691908 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:15.691723 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:16.691740 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:16.691706 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:16.692390 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:16.691843 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:17.287736 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:17.287696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:17.288045 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.287917 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:17.288045 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.287990 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs podName:ba2c30aa-b038-41d0-baae-a0916f5b459e nodeName:}" failed. No retries permitted until 2026-06-11 16:36:25.287969714 +0000 UTC m=+18.107536319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs") pod "network-metrics-daemon-ddsx7" (UID: "ba2c30aa-b038-41d0-baae-a0916f5b459e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:17.389003 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:17.388964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:17.389189 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:17.389056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:17.389253 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.389208 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:36:17.389253 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.389226 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:36:17.389253 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.389244 2565 projected.go:196] Error preparing data for projected volume kube-api-access-xmjrc for pod openshift-network-diagnostics/network-check-target-8n5hh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:17.389397 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.389305 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc podName:3fe0e73d-c35d-41f5-9d36-3a249703a304 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:25.38928939 +0000 UTC m=+18.208855993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmjrc" (UniqueName: "kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc") pod "network-check-target-8n5hh" (UID: "3fe0e73d-c35d-41f5-9d36-3a249703a304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:17.389713 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.389677 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:17.389807 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.389748 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret podName:30f045c6-2e71-4b56-87d6-fa2a8146e250 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:25.389730081 +0000 UTC m=+18.209296687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret") pod "global-pull-secret-syncer-bp9d4" (UID: "30f045c6-2e71-4b56-87d6-fa2a8146e250") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:17.692246 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:17.691719 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:17.692246 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.691856 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:17.692246 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:17.691914 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:17.692246 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:17.692045 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:18.691230 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:18.691184 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:18.691382 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:18.691351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:19.695112 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:19.695081 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:19.695648 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:19.695213 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:19.695648 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:19.695330 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:19.695648 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:19.695449 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:20.691424 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:20.691391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:20.691631 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:20.691510 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:21.693826 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:21.693795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:21.694226 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:21.693795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:21.694226 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:21.693928 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:21.694226 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:21.693965 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:22.691516 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:22.691480 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:22.691708 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:22.691633 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:23.690872 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:23.690831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:23.691354 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:23.690878 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:23.691354 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:23.690982 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:23.691354 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:23.691098 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:24.691071 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:24.691039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:24.691631 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:24.691169 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:25.348657 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:25.348616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:25.348833 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.348771 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:25.348906 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.348838 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs podName:ba2c30aa-b038-41d0-baae-a0916f5b459e nodeName:}" failed. No retries permitted until 2026-06-11 16:36:41.34881903 +0000 UTC m=+34.168385648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs") pod "network-metrics-daemon-ddsx7" (UID: "ba2c30aa-b038-41d0-baae-a0916f5b459e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:25.449586 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:25.449534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:25.449769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:25.449609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:25.449769 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.449717 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:25.449769 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.449725 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:36:25.449769 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.449745 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:36:25.449769 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.449755 2565 projected.go:196] Error preparing data for projected volume kube-api-access-xmjrc for pod openshift-network-diagnostics/network-check-target-8n5hh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:25.450030 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.449776 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret podName:30f045c6-2e71-4b56-87d6-fa2a8146e250 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:41.449760002 +0000 UTC m=+34.269326612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret") pod "global-pull-secret-syncer-bp9d4" (UID: "30f045c6-2e71-4b56-87d6-fa2a8146e250") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:25.450030 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.449805 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc podName:3fe0e73d-c35d-41f5-9d36-3a249703a304 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:41.449787587 +0000 UTC m=+34.269354215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmjrc" (UniqueName: "kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc") pod "network-check-target-8n5hh" (UID: "3fe0e73d-c35d-41f5-9d36-3a249703a304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:25.691672 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:25.691580 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:25.692045 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:25.691597 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:25.692045 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.691745 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:25.692045 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:25.691851 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:26.691005 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:26.690959 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:26.691164 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:26.691093 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:27.694789 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:27.694760 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:27.695213 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:27.694760 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:27.695213 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:27.694900 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:27.695213 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:27.694936 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:28.691681 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:28.691650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:28.691855 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:28.691772 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:29.694737 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.694518 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:29.695436 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.694629 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:29.695436 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:29.694819 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:29.695436 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:29.694929 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:29.789970 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.789942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p79f5" event={"ID":"035eab56-2e83-4307-b49c-517b6622e9fa","Type":"ContainerStarted","Data":"37ec2d66910ec45157025f7115686f223ccdeb2fb43755e065de7e32b1ea43e8"} Jun 11 16:36:29.791432 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.791407 2565 generic.go:356] "Generic (PLEG): container finished" podID="c08f7c43-1ca5-4a1e-b463-53f71efe452b" containerID="df1f10b61acaa5910ed478c8e504e1a56d771b48ede74c746441abb0d493119e" exitCode=0 Jun 11 16:36:29.791583 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.791485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerDied","Data":"df1f10b61acaa5910ed478c8e504e1a56d771b48ede74c746441abb0d493119e"} Jun 11 16:36:29.793175 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.793146 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jmhkm" event={"ID":"2267e07d-322f-4b09-b27c-04bc24ec4d62","Type":"ContainerStarted","Data":"3051409ff104210636bc13e9158ae4dd7275fe84c3ab20e6fa917bb11a0f582d"} Jun 11 16:36:29.794868 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.794840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-czlvh" event={"ID":"247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0","Type":"ContainerStarted","Data":"f54c9f2ec68c317445bf65f89f3121b437fdd348b51bd01f2a3744a92f3b1759"} Jun 11 16:36:29.796442 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.796411 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:36:29.796815 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.796791 2565 generic.go:356] "Generic (PLEG): container finished" podID="d6988a27-687d-4721-a899-14b4bf72b6f4" containerID="0cfb1defd9998d20fbb3719d8214f78fc37ec72935573df38ab0c6bccf350949" exitCode=1 Jun 11 16:36:29.796902 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.796862 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerDied","Data":"0cfb1defd9998d20fbb3719d8214f78fc37ec72935573df38ab0c6bccf350949"} Jun 11 16:36:29.796961 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.796940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"d83f6f6676c8919681d3e7c819b41816fe991432450078245c3d66308b6a1f9c"} Jun 11 16:36:29.798328 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.798309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w7v77" event={"ID":"4e8c8731-5c9f-4a21-97ed-f5d1aed6e4c2","Type":"ContainerStarted","Data":"ef5a8e25252404b9ed36501245e7d0c58ed6268fca49c8dfd4255ad5f6c27653"} Jun 11 16:36:29.799741 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.799720 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48xp7" event={"ID":"cfd99b7b-a943-4ad7-a8bb-aba85c971226","Type":"ContainerStarted","Data":"f6ce463c0f7b7d4f0a0a90badd5cda83bb04af5859eeae2942c444a58e0c0c8d"} Jun 11 16:36:29.801053 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.801027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" event={"ID":"c846a8c3-d1b9-4ebd-8920-ac4c845acf39","Type":"ContainerStarted","Data":"e962196eed4683e3320118f950e8387a1ebb9c0b3e4b7bea4df9f1b0f77534ff"} Jun 11 16:36:29.803926 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.803886 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p79f5" podStartSLOduration=3.967288761 podStartE2EDuration="22.803874867s" totalImagesPullingTime="18.836586106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:29.803650851 +0000 UTC m=+22.623217474" watchObservedRunningTime="2026-06-11 16:36:29.803874867 +0000 UTC m=+22.623441489" Jun 11 16:36:29.817057 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.817016 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-czlvh" podStartSLOduration=4.26257733 podStartE2EDuration="22.816998455s" totalImagesPullingTime="18.554421125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:29.816952045 +0000 UTC m=+22.636518667" watchObservedRunningTime="2026-06-11 16:36:29.816998455 +0000 UTC m=+22.636565071" Jun 11 16:36:29.830524 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.830445 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w7v77" podStartSLOduration=2.972791097 podStartE2EDuration="21.83042705s" totalImagesPullingTime="18.857635953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:29.83031076 +0000 UTC m=+22.649877383" watchObservedRunningTime="2026-06-11 16:36:29.83042705 +0000 UTC m=+22.649993672" Jun 11 16:36:29.843406 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.843361 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-48xp7" podStartSLOduration=2.9986661420000003 podStartE2EDuration="21.843348029s" totalImagesPullingTime="18.844681887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:29.843142098 +0000 UTC m=+22.662708723" watchObservedRunningTime="2026-06-11 16:36:29.843348029 +0000 UTC m=+22.662914652" Jun 11 16:36:29.858214 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:29.858167 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jmhkm" podStartSLOduration=2.991468674 podStartE2EDuration="21.858151296s" totalImagesPullingTime="18.866682622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:29.857660364 +0000 UTC m=+22.677226985" watchObservedRunningTime="2026-06-11 16:36:29.858151296 +0000 UTC m=+22.677717917" Jun 11 16:36:30.691162 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:30.690898 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:30.691376 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:30.691217 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:30.807062 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:30.806976 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:36:30.807783 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:30.807753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"82b014eda906f11b032114c92ea57971c4709a853be4b4d05dea1ea9e4320bc3"} Jun 11 16:36:30.807922 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:30.807842 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"91a73f62065c3fc8072258941ff318bcf6dd7847df5b27df0a45e582f7c8768b"} Jun 11 16:36:30.807922 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:30.807892 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"21a988f19db7e0adf65174490cc52f69968b261c56b6761646d6ec6f9718bbcd"} Jun 11 16:36:30.808025 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:30.807924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"51ea912cfad1ab3710cb322a5c4250174c052bf3fee31a4e1752a6db5e005691"} Jun 11 16:36:30.874529 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:30.874495 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:36:31.693035 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.692920 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:36:30.87451519Z","UUID":"a33e8ef4-d3d8-4b2a-9cbc-cceeb4893cf6","Handler":null,"Name":"","Endpoint":""} Jun 11 16:36:31.694805 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.694774 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:36:31.694939 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.694828 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:36:31.695002 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.694949 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:31.695113 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:31.695090 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:31.695601 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.695206 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:31.695601 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:31.695319 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:31.812422 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.812382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zhpw2" event={"ID":"63acdc96-d33c-4a19-bef6-df4ffd0223bc","Type":"ContainerStarted","Data":"3900c23a7894375cbb681ea67379363d330d733448aa5fce2f0505d0b3dac0a9"} Jun 11 16:36:31.814631 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.814602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" event={"ID":"c846a8c3-d1b9-4ebd-8920-ac4c845acf39","Type":"ContainerStarted","Data":"abd17cf79d72cede610b5e8ebbb306ca16c868e8fa39fce774d167651769f12e"} Jun 11 16:36:31.825462 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:31.825407 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zhpw2" podStartSLOduration=4.956523996 podStartE2EDuration="23.825387465s" totalImagesPullingTime="18.868863469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:31.825077183 +0000 UTC m=+24.644643859" watchObservedRunningTime="2026-06-11 16:36:31.825387465 +0000 UTC m=+24.644954087" Jun 11 16:36:32.690935 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:32.690897 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:32.691093 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:32.691014 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:32.820393 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:32.820359 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:36:32.820849 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:32.820824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"1cdbb72b9ad40793090a2a5e21e0f4d5593266ee49860a27f5d4ee3f2fc74ded"} Jun 11 16:36:32.823176 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:32.823147 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" event={"ID":"c846a8c3-d1b9-4ebd-8920-ac4c845acf39","Type":"ContainerStarted","Data":"8b45e5f1693ca55996e3850d82bde044547e642c2b1276c23eb0183446cef8e0"} Jun 11 16:36:32.842721 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:32.842668 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nbt4" podStartSLOduration=3.9150025729999998 podStartE2EDuration="24.842649961s" totalImagesPullingTime="20.927647388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:32.841708925 +0000 UTC m=+25.661275546" watchObservedRunningTime="2026-06-11 16:36:32.842649961 +0000 UTC m=+25.662216583" Jun 11 16:36:33.691500 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:33.691256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:33.691693 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:33.691279 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:33.691693 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:33.691645 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:33.691795 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:33.691778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:34.678757 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.678670 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:34.679428 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.679243 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:34.691309 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.691286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:34.691402 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:34.691381 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:34.828910 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.828876 2565 generic.go:356] "Generic (PLEG): container finished" podID="c08f7c43-1ca5-4a1e-b463-53f71efe452b" containerID="32d27fab36d1da5b2655ca26bf02612ec9866d00f2e36ec2aff2b4b491532b47" exitCode=0 Jun 11 16:36:34.829052 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.828963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerDied","Data":"32d27fab36d1da5b2655ca26bf02612ec9866d00f2e36ec2aff2b4b491532b47"} Jun 11 16:36:34.832430 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.832413 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:36:34.833132 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.832869 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"cba306c28da690655a12d8e0b0e3c85c1af289d1a1b7f054b271a8a20c792136"} Jun 11 16:36:34.833132 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.833098 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:34.833286 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.833138 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:34.833401 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.833309 2565 scope.go:117] "RemoveContainer" containerID="0cfb1defd9998d20fbb3719d8214f78fc37ec72935573df38ab0c6bccf350949" Jun 11 16:36:34.833571 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.833537 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-czlvh" Jun 11 16:36:34.849112 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:34.849089 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:35.691657 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.691623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:35.691657 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.691644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:35.692069 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:35.691773 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:35.692069 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:35.691864 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:35.839113 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.839084 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:36:35.839529 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.839493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" event={"ID":"d6988a27-687d-4721-a899-14b4bf72b6f4","Type":"ContainerStarted","Data":"f1a5f31d2e69ef4b5f13608fe78fdf1f20dfb8a080042c5c26b8883a66908297"} Jun 11 16:36:35.839641 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.839601 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:35.839748 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.839732 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:35.855011 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.854982 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:36:35.863231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:35.863184 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" podStartSLOduration=9.957456674 podStartE2EDuration="28.863168803s" totalImagesPullingTime="18.905712129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:35.862638059 +0000 UTC m=+28.682204682" watchObservedRunningTime="2026-06-11 16:36:35.863168803 +0000 UTC m=+28.682735447" Jun 11 16:36:36.690746 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:36.690706 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:36.690925 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:36.690812 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:36.844040 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:36.844000 2565 generic.go:356] "Generic (PLEG): container finished" podID="c08f7c43-1ca5-4a1e-b463-53f71efe452b" containerID="c3286dfb16491a227bd4c9f455731c7bd1e560ab9ed31e428e6dd31819dd5fe2" exitCode=0 Jun 11 16:36:36.844467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:36.844087 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerDied","Data":"c3286dfb16491a227bd4c9f455731c7bd1e560ab9ed31e428e6dd31819dd5fe2"} Jun 11 16:36:37.691842 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:37.691812 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:37.692015 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:37.691898 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:37.692015 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:37.691925 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:37.692015 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:37.691999 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:38.691312 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:38.691272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:38.691715 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:38.691378 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:38.850189 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:38.850150 2565 generic.go:356] "Generic (PLEG): container finished" podID="c08f7c43-1ca5-4a1e-b463-53f71efe452b" containerID="54836445361d47a6cab70beeaa5c6320482d54cefe10d790577ecd45dd1b654c" exitCode=0 Jun 11 16:36:38.850328 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:38.850217 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerDied","Data":"54836445361d47a6cab70beeaa5c6320482d54cefe10d790577ecd45dd1b654c"} Jun 11 16:36:39.691175 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:39.691136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:39.691368 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:39.691148 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:39.691368 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:39.691268 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:39.691770 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:39.691381 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:40.690884 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:40.690848 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:40.691109 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:40.690994 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:41.366517 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.366369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:41.366888 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.366742 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:41.366888 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.366832 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs podName:ba2c30aa-b038-41d0-baae-a0916f5b459e nodeName:}" failed. No retries permitted until 2026-06-11 16:37:13.366809847 +0000 UTC m=+66.186376464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs") pod "network-metrics-daemon-ddsx7" (UID: "ba2c30aa-b038-41d0-baae-a0916f5b459e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:36:41.467490 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.467453 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:41.467695 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.467510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:41.467695 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.467644 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:41.467695 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.467661 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:36:41.467695 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.467693 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:36:41.467918 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.467707 2565 projected.go:196] Error preparing data for projected volume kube-api-access-xmjrc for pod openshift-network-diagnostics/network-check-target-8n5hh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:41.467918 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.467716 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret podName:30f045c6-2e71-4b56-87d6-fa2a8146e250 nodeName:}" failed. No retries permitted until 2026-06-11 16:37:13.467694913 +0000 UTC m=+66.287261538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret") pod "global-pull-secret-syncer-bp9d4" (UID: "30f045c6-2e71-4b56-87d6-fa2a8146e250") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:36:41.467918 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.467762 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc podName:3fe0e73d-c35d-41f5-9d36-3a249703a304 nodeName:}" failed. No retries permitted until 2026-06-11 16:37:13.467743968 +0000 UTC m=+66.287310571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmjrc" (UniqueName: "kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc") pod "network-check-target-8n5hh" (UID: "3fe0e73d-c35d-41f5-9d36-3a249703a304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:36:41.599713 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.599677 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8n5hh"] Jun 11 16:36:41.599898 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.599789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:41.599973 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.599899 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:41.604040 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.603930 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp9d4"] Jun 11 16:36:41.604433 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.604241 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:41.604433 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.604368 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:41.605385 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.605340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ddsx7"] Jun 11 16:36:41.605507 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:41.605430 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:41.605608 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:41.605576 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:42.690876 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:42.690781 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:42.691312 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:42.690926 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:43.691918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:43.691722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:43.692294 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:43.691793 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:43.692294 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:43.692006 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8n5hh" podUID="3fe0e73d-c35d-41f5-9d36-3a249703a304" Jun 11 16:36:43.692294 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:43.692081 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bp9d4" podUID="30f045c6-2e71-4b56-87d6-fa2a8146e250" Jun 11 16:36:43.864918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:43.864834 2565 generic.go:356] "Generic (PLEG): container finished" podID="c08f7c43-1ca5-4a1e-b463-53f71efe452b" containerID="2382d7780e4f5047f1bd4340beb8cc9601c0a9fa374eb4141febe15dd68168d2" exitCode=0 Jun 11 16:36:43.864918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:43.864874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerDied","Data":"2382d7780e4f5047f1bd4340beb8cc9601c0a9fa374eb4141febe15dd68168d2"} Jun 11 16:36:44.691504 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:44.691474 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:44.691709 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:44.691596 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddsx7" podUID="ba2c30aa-b038-41d0-baae-a0916f5b459e" Jun 11 16:36:44.869901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:44.869865 2565 generic.go:356] "Generic (PLEG): container finished" podID="c08f7c43-1ca5-4a1e-b463-53f71efe452b" containerID="92f856ef2945f747880a1cffd2feebcc927c3087b915dd8c3007806a7915fe40" exitCode=0 Jun 11 16:36:44.870582 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:44.869942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerDied","Data":"92f856ef2945f747880a1cffd2feebcc927c3087b915dd8c3007806a7915fe40"} Jun 11 16:36:45.437642 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.437612 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeReady" Jun 11 16:36:45.437811 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.437797 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:36:45.469194 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.469162 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74b8f78666-vz9ww"] Jun 11 16:36:45.471224 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.471199 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.473424 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.473400 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:36:45.473424 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.473417 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:36:45.473746 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.473400 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:36:45.473746 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.473737 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4w95s\"" Jun 11 16:36:45.479388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.479368 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:36:45.481011 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.480961 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5vp7n"] Jun 11 16:36:45.482765 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.482746 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.484440 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.484175 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xsfwx"] Jun 11 16:36:45.485316 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.485293 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:36:45.485452 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.485325 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:36:45.485525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.485486 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r6n8h\"" Jun 11 16:36:45.485746 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.485728 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:36:45.485840 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.485803 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:36:45.486318 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.486300 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.487991 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.487971 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74b8f78666-vz9ww"] Jun 11 16:36:45.488107 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.488087 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:36:45.488202 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.488143 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:36:45.488447 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.488430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:36:45.488539 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.488469 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-227dp\"" Jun 11 16:36:45.496587 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.496513 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5vp7n"] Jun 11 16:36:45.497367 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.497341 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsfwx"] Jun 11 16:36:45.585559 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.585513 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9k5pp"] Jun 11 16:36:45.588396 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.588364 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.590822 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.590786 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:36:45.590822 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.590822 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7k9g5\"" Jun 11 16:36:45.591004 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.590860 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:36:45.597409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedc788-7532-4777-93ac-dd369a39e12c-image-registry-private-configuration\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-registry-tls\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-data-volume\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.597409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedc788-7532-4777-93ac-dd369a39e12c-installation-pull-secrets\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d78cn\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-kube-api-access-d78cn\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f82pm\" (UniqueName: \"kubernetes.io/projected/db64fbfb-5cdc-4090-ae8f-77f17fdfbe92-kube-api-access-f82pm\") pod \"ingress-canary-xsfwx\" (UID: \"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92\") " pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedc788-7532-4777-93ac-dd369a39e12c-ca-trust-extracted\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedc788-7532-4777-93ac-dd369a39e12c-registry-certificates\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-bound-sa-token\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g874h\" (UniqueName: \"kubernetes.io/projected/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-kube-api-access-g874h\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db64fbfb-5cdc-4090-ae8f-77f17fdfbe92-cert\") pod \"ingress-canary-xsfwx\" (UID: \"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92\") " pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedc788-7532-4777-93ac-dd369a39e12c-trusted-ca\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-crio-socket\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.597801 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.597707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.598535 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.598509 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9k5pp"] Jun 11 16:36:45.691783 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.691677 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:36:45.691783 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.691745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:36:45.694171 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.694128 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:36:45.694171 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.694157 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:36:45.694171 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.694131 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:36:45.694416 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.694167 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7njlg\"" Jun 11 16:36:45.698088 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedc788-7532-4777-93ac-dd369a39e12c-image-registry-private-configuration\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.698199 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-registry-tls\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.698199 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-data-volume\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.698199 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedc788-7532-4777-93ac-dd369a39e12c-installation-pull-secrets\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.698199 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d78cn\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-kube-api-access-d78cn\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.698418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.698418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f82pm\" (UniqueName: \"kubernetes.io/projected/db64fbfb-5cdc-4090-ae8f-77f17fdfbe92-kube-api-access-f82pm\") pod \"ingress-canary-xsfwx\" (UID: \"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92\") " pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.698418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedc788-7532-4777-93ac-dd369a39e12c-ca-trust-extracted\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.698418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedc788-7532-4777-93ac-dd369a39e12c-registry-certificates\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.698418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-bound-sa-token\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.698418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g874h\" (UniqueName: \"kubernetes.io/projected/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-kube-api-access-g874h\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.698707 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fc930d-a7d5-4bef-9285-ce202924c91f-tmp-dir\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.698707 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15fc930d-a7d5-4bef-9285-ce202924c91f-config-volume\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.698707 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698474 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-data-volume\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.698707 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.698494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2kgp\" (UniqueName: \"kubernetes.io/projected/15fc930d-a7d5-4bef-9285-ce202924c91f-kube-api-access-d2kgp\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db64fbfb-5cdc-4090-ae8f-77f17fdfbe92-cert\") pod \"ingress-canary-xsfwx\" (UID: \"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92\") " pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedc788-7532-4777-93ac-dd369a39e12c-trusted-ca\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedc788-7532-4777-93ac-dd369a39e12c-registry-certificates\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-crio-socket\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699360 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedc788-7532-4777-93ac-dd369a39e12c-ca-trust-extracted\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15fc930d-a7d5-4bef-9285-ce202924c91f-metrics-tls\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699733 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-crio-socket\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.699901 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.699862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.700447 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.700379 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedc788-7532-4777-93ac-dd369a39e12c-trusted-ca\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.703093 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.703074 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedc788-7532-4777-93ac-dd369a39e12c-installation-pull-secrets\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.703093 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.703083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.703219 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.703113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-registry-tls\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.703219 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.703167 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db64fbfb-5cdc-4090-ae8f-77f17fdfbe92-cert\") pod \"ingress-canary-xsfwx\" (UID: \"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92\") " pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.703219 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.703177 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedc788-7532-4777-93ac-dd369a39e12c-image-registry-private-configuration\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.706159 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.706129 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f82pm\" (UniqueName: \"kubernetes.io/projected/db64fbfb-5cdc-4090-ae8f-77f17fdfbe92-kube-api-access-f82pm\") pod \"ingress-canary-xsfwx\" (UID: \"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92\") " pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.706159 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.706145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-bound-sa-token\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.706443 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.706421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d78cn\" (UniqueName: \"kubernetes.io/projected/faedc788-7532-4777-93ac-dd369a39e12c-kube-api-access-d78cn\") pod \"image-registry-74b8f78666-vz9ww\" (UID: \"faedc788-7532-4777-93ac-dd369a39e12c\") " pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.706712 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.706697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g874h\" (UniqueName: \"kubernetes.io/projected/1e437f1e-aa4d-495b-bea8-6c5af1a59bd0-kube-api-access-g874h\") pod \"insights-runtime-extractor-5vp7n\" (UID: \"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0\") " pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.782463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.782425 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:45.794069 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.794037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5vp7n" Jun 11 16:36:45.800570 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.800535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsfwx" Jun 11 16:36:45.800780 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.800754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15fc930d-a7d5-4bef-9285-ce202924c91f-metrics-tls\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.800897 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.800815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fc930d-a7d5-4bef-9285-ce202924c91f-tmp-dir\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.800897 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.800843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15fc930d-a7d5-4bef-9285-ce202924c91f-config-volume\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.800897 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.800861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2kgp\" (UniqueName: \"kubernetes.io/projected/15fc930d-a7d5-4bef-9285-ce202924c91f-kube-api-access-d2kgp\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.801198 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.801173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15fc930d-a7d5-4bef-9285-ce202924c91f-tmp-dir\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.801734 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.801705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15fc930d-a7d5-4bef-9285-ce202924c91f-config-volume\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.803689 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.803668 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15fc930d-a7d5-4bef-9285-ce202924c91f-metrics-tls\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.808363 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.808331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2kgp\" (UniqueName: \"kubernetes.io/projected/15fc930d-a7d5-4bef-9285-ce202924c91f-kube-api-access-d2kgp\") pod \"dns-default-9k5pp\" (UID: \"15fc930d-a7d5-4bef-9285-ce202924c91f\") " pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.881824 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.880892 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q844p" event={"ID":"c08f7c43-1ca5-4a1e-b463-53f71efe452b","Type":"ContainerStarted","Data":"40018cddab7ff210979b4629d2771b5d7e63b0b9cb3ea0ef54f3b18483b5325c"} Jun 11 16:36:45.898511 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.898428 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:45.902507 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.902448 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q844p" podStartSLOduration=9.362080845 podStartE2EDuration="38.902427427s" totalImagesPullingTime="29.540346582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:45.900658761 +0000 UTC m=+38.720225383" watchObservedRunningTime="2026-06-11 16:36:45.902427427 +0000 UTC m=+38.721994050" Jun 11 16:36:45.960040 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.959819 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5vp7n"] Jun 11 16:36:45.961004 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.960937 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74b8f78666-vz9ww"] Jun 11 16:36:45.962849 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:45.962606 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsfwx"] Jun 11 16:36:45.967444 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:45.966790 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb64fbfb_5cdc_4090_ae8f_77f17fdfbe92.slice/crio-ddef089de0a9ccbd083d842622bd66fb98dba4fbb08cf9e4662d3f90f4afd783 WatchSource:0}: Error finding container ddef089de0a9ccbd083d842622bd66fb98dba4fbb08cf9e4662d3f90f4afd783: Status 404 returned error can't find the container with id ddef089de0a9ccbd083d842622bd66fb98dba4fbb08cf9e4662d3f90f4afd783 Jun 11 16:36:45.967900 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:45.967766 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e437f1e_aa4d_495b_bea8_6c5af1a59bd0.slice/crio-ce85d13f0b3cbec6d40c07ace6933bfcefd5e533375fd5092326be44d5595ec5 WatchSource:0}: Error finding container ce85d13f0b3cbec6d40c07ace6933bfcefd5e533375fd5092326be44d5595ec5: Status 404 returned error can't find the container with id ce85d13f0b3cbec6d40c07ace6933bfcefd5e533375fd5092326be44d5595ec5 Jun 11 16:36:46.051450 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.051372 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9k5pp"] Jun 11 16:36:46.055520 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:46.055494 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fc930d_a7d5_4bef_9285_ce202924c91f.slice/crio-b074eadc85c0da3e7f22dcd6a7123b556492ba71e37a42370b1ed0836c78f8c3 WatchSource:0}: Error finding container b074eadc85c0da3e7f22dcd6a7123b556492ba71e37a42370b1ed0836c78f8c3: Status 404 returned error can't find the container with id b074eadc85c0da3e7f22dcd6a7123b556492ba71e37a42370b1ed0836c78f8c3 Jun 11 16:36:46.098388 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.098331 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69487747fb-msp5h"] Jun 11 16:36:46.102687 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.102660 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.104725 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.104690 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:36:46.104886 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.104866 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p4tmt\"" Jun 11 16:36:46.104990 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.104878 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:36:46.105278 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.105183 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:36:46.105278 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.105268 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:36:46.105421 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.105345 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:36:46.105421 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.105402 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:36:46.105764 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.105748 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:36:46.112438 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.112403 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:36:46.115334 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.115301 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69487747fb-msp5h"] Jun 11 16:36:46.203374 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.203336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-service-ca\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.203540 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.203392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-console-config\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.203540 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.203436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-oauth-serving-cert\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.203540 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.203461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8lq\" (UniqueName: \"kubernetes.io/projected/710ec1de-4370-4a3d-8870-f9906ebd440c-kube-api-access-mz8lq\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.203540 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.203519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-serving-cert\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.203691 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.203569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-trusted-ca-bundle\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.203691 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.203594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-oauth-config\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.304694 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.304664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-serving-cert\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.304855 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.304701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-trusted-ca-bundle\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.304855 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.304722 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-oauth-config\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.304855 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.304820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-service-ca\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.304975 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.304868 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-console-config\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.304975 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.304899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-oauth-serving-cert\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.305202 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.305137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8lq\" (UniqueName: \"kubernetes.io/projected/710ec1de-4370-4a3d-8870-f9906ebd440c-kube-api-access-mz8lq\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.305678 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.305656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-oauth-serving-cert\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.305759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.305708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-console-config\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.305759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.305727 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-service-ca\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.306246 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.306221 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-trusted-ca-bundle\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.309836 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.309711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-oauth-config\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.309981 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.309732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-serving-cert\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.312170 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.312148 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8lq\" (UniqueName: \"kubernetes.io/projected/710ec1de-4370-4a3d-8870-f9906ebd440c-kube-api-access-mz8lq\") pod \"console-69487747fb-msp5h\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.420382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.420346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:46.632209 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.632113 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69487747fb-msp5h"] Jun 11 16:36:46.691599 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.691562 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:36:46.693860 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.693757 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:36:46.694228 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.693732 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t6lsx\"" Jun 11 16:36:46.801196 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:46.801160 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710ec1de_4370_4a3d_8870_f9906ebd440c.slice/crio-2fe969f69ed6fd38928f71bfc0cfc2215a0132dbebe41ac0fcce86a51e90d12e WatchSource:0}: Error finding container 2fe969f69ed6fd38928f71bfc0cfc2215a0132dbebe41ac0fcce86a51e90d12e: Status 404 returned error can't find the container with id 2fe969f69ed6fd38928f71bfc0cfc2215a0132dbebe41ac0fcce86a51e90d12e Jun 11 16:36:46.887052 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.886887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9k5pp" event={"ID":"15fc930d-a7d5-4bef-9285-ce202924c91f","Type":"ContainerStarted","Data":"b074eadc85c0da3e7f22dcd6a7123b556492ba71e37a42370b1ed0836c78f8c3"} Jun 11 16:36:46.888557 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.888486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsfwx" event={"ID":"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92","Type":"ContainerStarted","Data":"ddef089de0a9ccbd083d842622bd66fb98dba4fbb08cf9e4662d3f90f4afd783"} Jun 11 16:36:46.890482 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.890448 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vp7n" event={"ID":"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0","Type":"ContainerStarted","Data":"fddc0122187ed738617351bd3aa089c622e97a5c4a5365e2a0d7cc64e7630623"} Jun 11 16:36:46.890606 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.890507 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vp7n" event={"ID":"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0","Type":"ContainerStarted","Data":"ce85d13f0b3cbec6d40c07ace6933bfcefd5e533375fd5092326be44d5595ec5"} Jun 11 16:36:46.892780 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.892708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69487747fb-msp5h" event={"ID":"710ec1de-4370-4a3d-8870-f9906ebd440c","Type":"ContainerStarted","Data":"2fe969f69ed6fd38928f71bfc0cfc2215a0132dbebe41ac0fcce86a51e90d12e"} Jun 11 16:36:46.896287 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.896262 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" event={"ID":"faedc788-7532-4777-93ac-dd369a39e12c","Type":"ContainerStarted","Data":"40f52b59d9b5c76c7dcc8fafb85b4e59a9ca0712e1eb8c692b301b308e3d6c59"} Jun 11 16:36:46.896432 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.896355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" event={"ID":"faedc788-7532-4777-93ac-dd369a39e12c","Type":"ContainerStarted","Data":"bd258ddbdd899093076206603411a6d77a85bb96984d81ead63528ae5ab3f93a"} Jun 11 16:36:46.896567 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.896456 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:36:46.912687 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:46.912504 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" podStartSLOduration=7.91248564 podStartE2EDuration="7.91248564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:46.910977046 +0000 UTC m=+39.730543670" watchObservedRunningTime="2026-06-11 16:36:46.91248564 +0000 UTC m=+39.732052263" Jun 11 16:36:47.902794 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:47.902752 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vp7n" event={"ID":"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0","Type":"ContainerStarted","Data":"37bce5401ab744729a248797cd5380fceca183311b876e3378fcb255c5308344"} Jun 11 16:36:48.911577 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:48.910897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9k5pp" event={"ID":"15fc930d-a7d5-4bef-9285-ce202924c91f","Type":"ContainerStarted","Data":"e605b754c990459a7754381f92026bd8cc8b8e2210a2e0d80ecdc0b8f354a48e"} Jun 11 16:36:48.911577 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:48.910968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9k5pp" event={"ID":"15fc930d-a7d5-4bef-9285-ce202924c91f","Type":"ContainerStarted","Data":"f632cae6db2c0751761dda7e972315decf475260acb5f43ddbbd346fe80a3359"} Jun 11 16:36:48.912192 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:48.912137 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9k5pp" Jun 11 16:36:48.930506 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:48.930318 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9k5pp" podStartSLOduration=1.9341905719999999 podStartE2EDuration="3.93029497s" totalImagesPullingTime="1.996104398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:48.929978637 +0000 UTC m=+41.749545272" watchObservedRunningTime="2026-06-11 16:36:48.93029497 +0000 UTC m=+41.749861599" Jun 11 16:36:50.919908 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:50.919820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69487747fb-msp5h" event={"ID":"710ec1de-4370-4a3d-8870-f9906ebd440c","Type":"ContainerStarted","Data":"7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825"} Jun 11 16:36:50.921337 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:50.921315 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsfwx" event={"ID":"db64fbfb-5cdc-4090-ae8f-77f17fdfbe92","Type":"ContainerStarted","Data":"59be53610188aedc642795aac699ecaa741d70a733670bd567004c5d4ab839d0"} Jun 11 16:36:50.923601 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:50.923572 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vp7n" event={"ID":"1e437f1e-aa4d-495b-bea8-6c5af1a59bd0","Type":"ContainerStarted","Data":"fea7ff8376272e94abe054d9e8058116fafb8a33310ece604757fa8cb83d9309"} Jun 11 16:36:50.936469 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:50.936415 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69487747fb-msp5h" podStartSLOduration=1.171460526 podStartE2EDuration="4.936399582s" totalImagesPullingTime="3.764939056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:50.935818421 +0000 UTC m=+43.755385044" watchObservedRunningTime="2026-06-11 16:36:50.936399582 +0000 UTC m=+43.755966204" Jun 11 16:36:50.952634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:50.952577 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5vp7n" podStartSLOduration=1.590988799 podStartE2EDuration="5.952534938s" totalImagesPullingTime="4.361546139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:50.951902638 +0000 UTC m=+43.771469283" watchObservedRunningTime="2026-06-11 16:36:50.952534938 +0000 UTC m=+43.772101557" Jun 11 16:36:50.966829 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:50.966773 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xsfwx" podStartSLOduration=1.3765261149999999 podStartE2EDuration="5.966756355s" totalImagesPullingTime="4.59023024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:50.965159204 +0000 UTC m=+43.784725826" watchObservedRunningTime="2026-06-11 16:36:50.966756355 +0000 UTC m=+43.786322977" Jun 11 16:36:53.370385 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:53.370348 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf"] Jun 11 16:36:53.392779 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:53.392754 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf"] Jun 11 16:36:53.392929 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:53.392850 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:53.395118 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:53.395090 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 16:36:53.395255 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:53.395139 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kbbjj\"" Jun 11 16:36:53.567116 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:53.567072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47596fdb-946d-41d3-a1a9-c627dcbeb70e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-57vdf\" (UID: \"47596fdb-946d-41d3-a1a9-c627dcbeb70e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:53.668269 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:53.668169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47596fdb-946d-41d3-a1a9-c627dcbeb70e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-57vdf\" (UID: \"47596fdb-946d-41d3-a1a9-c627dcbeb70e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:53.668419 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:53.668327 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:36:53.668419 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:36:53.668392 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47596fdb-946d-41d3-a1a9-c627dcbeb70e-tls-certificates podName:47596fdb-946d-41d3-a1a9-c627dcbeb70e nodeName:}" failed. No retries permitted until 2026-06-11 16:36:54.168375708 +0000 UTC m=+46.987942308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/47596fdb-946d-41d3-a1a9-c627dcbeb70e-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-57vdf" (UID: "47596fdb-946d-41d3-a1a9-c627dcbeb70e") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:36:54.172198 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:54.172154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47596fdb-946d-41d3-a1a9-c627dcbeb70e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-57vdf\" (UID: \"47596fdb-946d-41d3-a1a9-c627dcbeb70e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:54.175015 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:54.174991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/47596fdb-946d-41d3-a1a9-c627dcbeb70e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-57vdf\" (UID: \"47596fdb-946d-41d3-a1a9-c627dcbeb70e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:54.302018 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:54.301977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:54.456174 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:54.456098 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf"] Jun 11 16:36:54.459650 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:36:54.459620 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47596fdb_946d_41d3_a1a9_c627dcbeb70e.slice/crio-88c3122e52341782e34c777c4ed7f6bc2fa485383f06cc9f9dc6627a28b47beb WatchSource:0}: Error finding container 88c3122e52341782e34c777c4ed7f6bc2fa485383f06cc9f9dc6627a28b47beb: Status 404 returned error can't find the container with id 88c3122e52341782e34c777c4ed7f6bc2fa485383f06cc9f9dc6627a28b47beb Jun 11 16:36:54.936355 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:54.936325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" event={"ID":"47596fdb-946d-41d3-a1a9-c627dcbeb70e","Type":"ContainerStarted","Data":"88c3122e52341782e34c777c4ed7f6bc2fa485383f06cc9f9dc6627a28b47beb"} Jun 11 16:36:56.421365 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.421276 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:56.421738 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.421378 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:36:56.422714 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.422683 2565 patch_prober.go:28] interesting pod/console-69487747fb-msp5h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body= Jun 11 16:36:56.422769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.422734 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69487747fb-msp5h" podUID="710ec1de-4370-4a3d-8870-f9906ebd440c" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" Jun 11 16:36:56.945064 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.945026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" event={"ID":"47596fdb-946d-41d3-a1a9-c627dcbeb70e","Type":"ContainerStarted","Data":"c8873ecad4aceacbefe79993385a3d4792b05d37a80bf6f636156509ac9c00ad"} Jun 11 16:36:56.945280 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.945235 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:56.949669 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.949640 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" Jun 11 16:36:56.961255 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:56.961208 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-57vdf" podStartSLOduration=2.337733711 podStartE2EDuration="3.961193965s" totalImagesPullingTime="1.623460254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:56.960305659 +0000 UTC m=+49.779872281" watchObservedRunningTime="2026-06-11 16:36:56.961193965 +0000 UTC m=+49.780760631" Jun 11 16:36:59.926325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:36:59.926296 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9k5pp" Jun 11 16:37:04.769635 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.769594 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz"] Jun 11 16:37:04.803184 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.803154 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz"] Jun 11 16:37:04.803342 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.803197 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb"] Jun 11 16:37:04.803342 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.803280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.805703 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.805676 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:37:04.805835 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.805754 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:37:04.806028 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.806013 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:37:04.806093 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.806038 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 16:37:04.806536 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.806516 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:37:04.806640 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.806569 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zlnkr\"" Jun 11 16:37:04.817054 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.817028 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kck2f"] Jun 11 16:37:04.817170 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.817143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.819241 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.819218 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n8x6m\"" Jun 11 16:37:04.819368 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.819220 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 16:37:04.819368 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.819257 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:37:04.819368 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.819295 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 16:37:04.835025 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.834996 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb"] Jun 11 16:37:04.835181 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.835122 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.836956 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.836935 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:37:04.837147 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.837129 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qkzn8\"" Jun 11 16:37:04.837206 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.837168 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:37:04.837288 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.837274 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:37:04.852604 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba109950-8f19-48c7-9a72-62a18a155f96-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.852604 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-wtmp\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.852803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef07157f-8307-4a3c-a231-cd1bb32bc193-metrics-client-ca\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.852803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852760 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2268c4fb-6076-4fcb-ac33-53fe6358119f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.852803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-tls\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwjt\" (UniqueName: \"kubernetes.io/projected/ef07157f-8307-4a3c-a231-cd1bb32bc193-kube-api-access-sxwjt\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj586\" (UniqueName: \"kubernetes.io/projected/ba109950-8f19-48c7-9a72-62a18a155f96-kube-api-access-kj586\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-accelerators-collector-config\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-root\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-textfile\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.852998 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.852994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba109950-8f19-48c7-9a72-62a18a155f96-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.853277 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.853052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.853277 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.853104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckgj\" (UniqueName: \"kubernetes.io/projected/2268c4fb-6076-4fcb-ac33-53fe6358119f-kube-api-access-dckgj\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.853277 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.853131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-sys\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954135 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-root\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954135 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-textfile\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954327 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba109950-8f19-48c7-9a72-62a18a155f96-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.954327 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-root\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954327 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.954327 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckgj\" (UniqueName: \"kubernetes.io/projected/2268c4fb-6076-4fcb-ac33-53fe6358119f-kube-api-access-dckgj\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.954476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-sys\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba109950-8f19-48c7-9a72-62a18a155f96-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.954476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-wtmp\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954416 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.954476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954727 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef07157f-8307-4a3c-a231-cd1bb32bc193-metrics-client-ca\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954727 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-sys\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954727 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:04.954591 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 16:37:04.954727 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-wtmp\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.954727 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954641 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba109950-8f19-48c7-9a72-62a18a155f96-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.954727 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:04.954658 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-tls podName:2268c4fb-6076-4fcb-ac33-53fe6358119f nodeName:}" failed. No retries permitted until 2026-06-11 16:37:05.454637508 +0000 UTC m=+58.274204124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-n68cz" (UID: "2268c4fb-6076-4fcb-ac33-53fe6358119f") : secret "openshift-state-metrics-tls" not found Jun 11 16:37:04.954727 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2268c4fb-6076-4fcb-ac33-53fe6358119f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-tls\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954855 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwjt\" (UniqueName: \"kubernetes.io/projected/ef07157f-8307-4a3c-a231-cd1bb32bc193-kube-api-access-sxwjt\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj586\" (UniqueName: \"kubernetes.io/projected/ba109950-8f19-48c7-9a72-62a18a155f96-kube-api-access-kj586\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.954952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-accelerators-collector-config\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.955087 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.955069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef07157f-8307-4a3c-a231-cd1bb32bc193-metrics-client-ca\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.955475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.955268 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba109950-8f19-48c7-9a72-62a18a155f96-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.955475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.955344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.955475 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:04.955434 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 16:37:04.955475 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:04.955478 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-tls podName:ef07157f-8307-4a3c-a231-cd1bb32bc193 nodeName:}" failed. No retries permitted until 2026-06-11 16:37:05.455463201 +0000 UTC m=+58.275029808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-tls") pod "node-exporter-kck2f" (UID: "ef07157f-8307-4a3c-a231-cd1bb32bc193") : secret "node-exporter-tls" not found Jun 11 16:37:04.955720 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.955478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-accelerators-collector-config\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.955720 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:04.955566 2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 16:37:04.955720 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:04.955616 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-tls podName:ba109950-8f19-48c7-9a72-62a18a155f96 nodeName:}" failed. No retries permitted until 2026-06-11 16:37:05.455602837 +0000 UTC m=+58.275169443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-wfzqb" (UID: "ba109950-8f19-48c7-9a72-62a18a155f96") : secret "kube-state-metrics-tls" not found Jun 11 16:37:04.955720 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.955657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-textfile\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.955943 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.955783 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2268c4fb-6076-4fcb-ac33-53fe6358119f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.957067 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.957035 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.957327 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.957308 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.957454 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.957436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:04.961764 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.961741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckgj\" (UniqueName: \"kubernetes.io/projected/2268c4fb-6076-4fcb-ac33-53fe6358119f-kube-api-access-dckgj\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:04.962537 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.962511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj586\" (UniqueName: \"kubernetes.io/projected/ba109950-8f19-48c7-9a72-62a18a155f96-kube-api-access-kj586\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:04.962780 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:04.962747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwjt\" (UniqueName: \"kubernetes.io/projected/ef07157f-8307-4a3c-a231-cd1bb32bc193-kube-api-access-sxwjt\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:05.459613 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.459577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:05.459797 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.459662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-tls\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:05.459797 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.459693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:05.461961 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.461934 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef07157f-8307-4a3c-a231-cd1bb32bc193-node-exporter-tls\") pod \"node-exporter-kck2f\" (UID: \"ef07157f-8307-4a3c-a231-cd1bb32bc193\") " pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:05.462142 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.462119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba109950-8f19-48c7-9a72-62a18a155f96-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-wfzqb\" (UID: \"ba109950-8f19-48c7-9a72-62a18a155f96\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:05.462183 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.462159 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2268c4fb-6076-4fcb-ac33-53fe6358119f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n68cz\" (UID: \"2268c4fb-6076-4fcb-ac33-53fe6358119f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:05.716250 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.716172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" Jun 11 16:37:05.725331 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.725303 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" Jun 11 16:37:05.744556 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.744520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kck2f" Jun 11 16:37:05.788885 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.788849 2565 patch_prober.go:28] interesting pod/image-registry-74b8f78666-vz9ww container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:37:05.789251 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.788912 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" podUID="faedc788-7532-4777-93ac-dd369a39e12c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:37:05.802515 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:05.802469 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef07157f_8307_4a3c_a231_cd1bb32bc193.slice/crio-0698c343d19319dd921a47c9d9a189deb29a6dc02ab5732ec1d6bf4641f68cd5 WatchSource:0}: Error finding container 0698c343d19319dd921a47c9d9a189deb29a6dc02ab5732ec1d6bf4641f68cd5: Status 404 returned error can't find the container with id 0698c343d19319dd921a47c9d9a189deb29a6dc02ab5732ec1d6bf4641f68cd5 Jun 11 16:37:05.889272 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.889239 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz"] Jun 11 16:37:05.892536 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:05.892509 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2268c4fb_6076_4fcb_ac33_53fe6358119f.slice/crio-c2ab0081f1f8e37ba03c331abad0a9c0ac730bd138a430b95542e5d53011ea7c WatchSource:0}: Error finding container c2ab0081f1f8e37ba03c331abad0a9c0ac730bd138a430b95542e5d53011ea7c: Status 404 returned error can't find the container with id c2ab0081f1f8e37ba03c331abad0a9c0ac730bd138a430b95542e5d53011ea7c Jun 11 16:37:05.915939 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.915889 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb"] Jun 11 16:37:05.921308 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:05.921281 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba109950_8f19_48c7_9a72_62a18a155f96.slice/crio-a34669d06f4eb9d06b4cb24fc1e01dc084812859f8e5a984a421c36ed92bb749 WatchSource:0}: Error finding container a34669d06f4eb9d06b4cb24fc1e01dc084812859f8e5a984a421c36ed92bb749: Status 404 returned error can't find the container with id a34669d06f4eb9d06b4cb24fc1e01dc084812859f8e5a984a421c36ed92bb749 Jun 11 16:37:05.975121 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.975019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kck2f" event={"ID":"ef07157f-8307-4a3c-a231-cd1bb32bc193","Type":"ContainerStarted","Data":"0698c343d19319dd921a47c9d9a189deb29a6dc02ab5732ec1d6bf4641f68cd5"} Jun 11 16:37:05.976219 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.976195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" event={"ID":"2268c4fb-6076-4fcb-ac33-53fe6358119f","Type":"ContainerStarted","Data":"c2ab0081f1f8e37ba03c331abad0a9c0ac730bd138a430b95542e5d53011ea7c"} Jun 11 16:37:05.977219 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:05.977195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" event={"ID":"ba109950-8f19-48c7-9a72-62a18a155f96","Type":"ContainerStarted","Data":"a34669d06f4eb9d06b4cb24fc1e01dc084812859f8e5a984a421c36ed92bb749"} Jun 11 16:37:06.425885 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:06.425850 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:37:06.431405 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:06.431376 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:37:06.984115 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:06.984032 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" event={"ID":"2268c4fb-6076-4fcb-ac33-53fe6358119f","Type":"ContainerStarted","Data":"c8f8382bd55e6e0f9f2eb96c8922aab9a8ef9f64b915c79c6c5f7374cc0584b9"} Jun 11 16:37:06.984633 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:06.984142 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" event={"ID":"2268c4fb-6076-4fcb-ac33-53fe6358119f","Type":"ContainerStarted","Data":"d2721e69e1af1f193fc49ebd6018dee88a5f86b866d5e47e72fdead9606e6689"} Jun 11 16:37:06.986321 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:06.986288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kck2f" event={"ID":"ef07157f-8307-4a3c-a231-cd1bb32bc193","Type":"ContainerStarted","Data":"3d7a715ea48b3fd1358a227f2cb5caba34bafc58725614a9f9bd3d99b2defb48"} Jun 11 16:37:07.868238 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:07.868206 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xbs4x" Jun 11 16:37:07.908146 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:07.908115 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74b8f78666-vz9ww" Jun 11 16:37:07.992287 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:07.992251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" event={"ID":"ba109950-8f19-48c7-9a72-62a18a155f96","Type":"ContainerStarted","Data":"ae2ca1542b045ac639df42fd547aeb2ef759af83e7d396fcb2c458174b295b04"} Jun 11 16:37:07.992767 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:07.992318 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" event={"ID":"ba109950-8f19-48c7-9a72-62a18a155f96","Type":"ContainerStarted","Data":"4f8917b635f602d01f0ac30587dc92d7e218ef09f1b7fc105b5deaf15d58dcf4"} Jun 11 16:37:07.992767 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:07.992346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" event={"ID":"ba109950-8f19-48c7-9a72-62a18a155f96","Type":"ContainerStarted","Data":"ed65df4273a1bf2d007ee56fac21a7114aea8ce83975be4837674f8df1461a85"} Jun 11 16:37:07.994039 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:07.994009 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef07157f-8307-4a3c-a231-cd1bb32bc193" containerID="3d7a715ea48b3fd1358a227f2cb5caba34bafc58725614a9f9bd3d99b2defb48" exitCode=0 Jun 11 16:37:07.994162 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:07.994048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kck2f" event={"ID":"ef07157f-8307-4a3c-a231-cd1bb32bc193","Type":"ContainerDied","Data":"3d7a715ea48b3fd1358a227f2cb5caba34bafc58725614a9f9bd3d99b2defb48"} Jun 11 16:37:08.013047 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:08.012984 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wfzqb" podStartSLOduration=2.75170711 podStartE2EDuration="4.012961653s" totalImagesPullingTime="1.261254543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:08.011382007 +0000 UTC m=+60.830948630" watchObservedRunningTime="2026-06-11 16:37:08.012961653 +0000 UTC m=+60.832528275" Jun 11 16:37:08.999015 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:08.998980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kck2f" event={"ID":"ef07157f-8307-4a3c-a231-cd1bb32bc193","Type":"ContainerStarted","Data":"e7d36e3aef8815dd4b8865ea33bf8edc8342949b9e5728cbc02f53e2195a8830"} Jun 11 16:37:08.999466 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:08.999041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kck2f" event={"ID":"ef07157f-8307-4a3c-a231-cd1bb32bc193","Type":"ContainerStarted","Data":"9982eda4705e9ac43f4440b1cd7c3007d42969634b8fd21c7fca2143c3a64cd9"} Jun 11 16:37:09.001046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.001019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" event={"ID":"2268c4fb-6076-4fcb-ac33-53fe6358119f","Type":"ContainerStarted","Data":"05de46950976e660a87040ae8803990fcef2c5ab3092e5633687f07e22eb7122"} Jun 11 16:37:09.017797 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.017747 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kck2f" podStartSLOduration=4.052004592 podStartE2EDuration="5.017730202s" totalImagesPullingTime="891.239357ms" totalInitContainerRuntime="74.486253ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:09.016927494 +0000 UTC m=+61.836494116" watchObservedRunningTime="2026-06-11 16:37:09.017730202 +0000 UTC m=+61.837296825" Jun 11 16:37:09.035530 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.035481 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n68cz" podStartSLOduration=3.051141302 podStartE2EDuration="5.035463498s" totalImagesPullingTime="1.984322196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:09.035106985 +0000 UTC m=+61.854673603" watchObservedRunningTime="2026-06-11 16:37:09.035463498 +0000 UTC m=+61.855030116" Jun 11 16:37:09.960535 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.960494 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d75f9c959-b8vz5"] Jun 11 16:37:09.962469 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.962454 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.964298 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.964273 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 16:37:09.964418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.964394 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 16:37:09.964479 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.964431 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 16:37:09.964533 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.964493 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ws9rc\"" Jun 11 16:37:09.964533 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.964520 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 16:37:09.964658 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.964575 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 16:37:09.969937 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.969911 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 16:37:09.974691 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.974669 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d75f9c959-b8vz5"] Jun 11 16:37:09.998662 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.998627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-telemeter-client-tls\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.998830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.998680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-secret-telemeter-client\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.998830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.998712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-serving-certs-ca-bundle\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.998830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.998767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-federate-client-tls\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.998830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.998815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-metrics-client-ca\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.999036 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.998905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.999036 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.998984 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:09.999036 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:09.999021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5kt\" (UniqueName: \"kubernetes.io/projected/401abedd-05d9-440c-9a91-5cb3ba1d1709-kube-api-access-6w5kt\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.017372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.017341 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-556cf9d446-h6znm"] Jun 11 16:37:10.019139 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.019123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.028739 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.028716 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556cf9d446-h6znm"] Jun 11 16:37:10.100345 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-telemeter-client-tls\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.100493 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9q2q\" (UniqueName: \"kubernetes.io/projected/35b3214d-2841-4ad2-bb70-a622b761e1e3-kube-api-access-h9q2q\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.100493 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-serving-cert\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.100493 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-secret-telemeter-client\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.100493 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-config\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.100729 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-serving-certs-ca-bundle\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.100729 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-oauth-serving-cert\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.100729 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-service-ca\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.100729 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-federate-client-tls\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.100922 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-metrics-client-ca\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.100922 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.100922 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-oauth-config\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.101056 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-trusted-ca-bundle\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.101056 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.100997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.101056 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.101026 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5kt\" (UniqueName: \"kubernetes.io/projected/401abedd-05d9-440c-9a91-5cb3ba1d1709-kube-api-access-6w5kt\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.101291 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.101265 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-serving-certs-ca-bundle\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.101842 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.101815 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-metrics-client-ca\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.102390 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.102363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401abedd-05d9-440c-9a91-5cb3ba1d1709-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.103125 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.103104 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-telemeter-client-tls\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.103208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.103159 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-federate-client-tls\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.103306 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.103287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-secret-telemeter-client\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.103516 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.103501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/401abedd-05d9-440c-9a91-5cb3ba1d1709-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.108193 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.108175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5kt\" (UniqueName: \"kubernetes.io/projected/401abedd-05d9-440c-9a91-5cb3ba1d1709-kube-api-access-6w5kt\") pod \"telemeter-client-d75f9c959-b8vz5\" (UID: \"401abedd-05d9-440c-9a91-5cb3ba1d1709\") " pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.201599 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.201561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-oauth-serving-cert\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.201599 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.201604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-service-ca\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.201839 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.201682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-oauth-config\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.201839 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.201717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-trusted-ca-bundle\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.201839 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.201783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9q2q\" (UniqueName: \"kubernetes.io/projected/35b3214d-2841-4ad2-bb70-a622b761e1e3-kube-api-access-h9q2q\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.201839 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.201812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-serving-cert\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.202021 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.201844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-config\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.202441 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.202411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-service-ca\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.202441 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.202417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-oauth-serving-cert\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.202641 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.202529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-trusted-ca-bundle\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.202641 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.202605 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-config\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.204162 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.204142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-oauth-config\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.204407 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.204386 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-serving-cert\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.210124 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.210102 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9q2q\" (UniqueName: \"kubernetes.io/projected/35b3214d-2841-4ad2-bb70-a622b761e1e3-kube-api-access-h9q2q\") pod \"console-556cf9d446-h6znm\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.271970 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.271875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" Jun 11 16:37:10.327985 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.327948 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:10.431617 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.431536 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d75f9c959-b8vz5"] Jun 11 16:37:10.434121 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:10.434085 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401abedd_05d9_440c_9a91_5cb3ba1d1709.slice/crio-6663cb35ba6837927264efaf61242d0a45e5d18b84a283ee89c8729ccca9a1d9 WatchSource:0}: Error finding container 6663cb35ba6837927264efaf61242d0a45e5d18b84a283ee89c8729ccca9a1d9: Status 404 returned error can't find the container with id 6663cb35ba6837927264efaf61242d0a45e5d18b84a283ee89c8729ccca9a1d9 Jun 11 16:37:10.472743 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:10.472709 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556cf9d446-h6znm"] Jun 11 16:37:10.476381 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:10.476347 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b3214d_2841_4ad2_bb70_a622b761e1e3.slice/crio-06a4350eb4e2c487fb8ae26edfcda48ef69dcd97f8d7eb24736acd7d7acab4c2 WatchSource:0}: Error finding container 06a4350eb4e2c487fb8ae26edfcda48ef69dcd97f8d7eb24736acd7d7acab4c2: Status 404 returned error can't find the container with id 06a4350eb4e2c487fb8ae26edfcda48ef69dcd97f8d7eb24736acd7d7acab4c2 Jun 11 16:37:11.010057 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:11.010021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cf9d446-h6znm" event={"ID":"35b3214d-2841-4ad2-bb70-a622b761e1e3","Type":"ContainerStarted","Data":"c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96"} Jun 11 16:37:11.010477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:11.010089 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cf9d446-h6znm" event={"ID":"35b3214d-2841-4ad2-bb70-a622b761e1e3","Type":"ContainerStarted","Data":"06a4350eb4e2c487fb8ae26edfcda48ef69dcd97f8d7eb24736acd7d7acab4c2"} Jun 11 16:37:11.011287 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:11.011263 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" event={"ID":"401abedd-05d9-440c-9a91-5cb3ba1d1709","Type":"ContainerStarted","Data":"6663cb35ba6837927264efaf61242d0a45e5d18b84a283ee89c8729ccca9a1d9"} Jun 11 16:37:11.029981 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:11.028295 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-556cf9d446-h6znm" podStartSLOduration=1.028275194 podStartE2EDuration="1.028275194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:11.025676379 +0000 UTC m=+63.845243027" watchObservedRunningTime="2026-06-11 16:37:11.028275194 +0000 UTC m=+63.847841817" Jun 11 16:37:13.021191 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.021151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" event={"ID":"401abedd-05d9-440c-9a91-5cb3ba1d1709","Type":"ContainerStarted","Data":"5008b959f839d7f361fefb586f1c511772831a39af2dbc42e62580466444b699"} Jun 11 16:37:13.431327 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.431284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:37:13.434075 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.434051 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:37:13.443918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.443895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba2c30aa-b038-41d0-baae-a0916f5b459e-metrics-certs\") pod \"network-metrics-daemon-ddsx7\" (UID: \"ba2c30aa-b038-41d0-baae-a0916f5b459e\") " pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:37:13.532567 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.532447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:37:13.532567 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.532565 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:37:13.534750 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.534728 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:37:13.534863 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.534789 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:37:13.545497 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.545469 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:37:13.545727 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.545712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/30f045c6-2e71-4b56-87d6-fa2a8146e250-original-pull-secret\") pod \"global-pull-secret-syncer-bp9d4\" (UID: \"30f045c6-2e71-4b56-87d6-fa2a8146e250\") " pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:37:13.555882 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.555848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjrc\" (UniqueName: \"kubernetes.io/projected/3fe0e73d-c35d-41f5-9d36-3a249703a304-kube-api-access-xmjrc\") pod \"network-check-target-8n5hh\" (UID: \"3fe0e73d-c35d-41f5-9d36-3a249703a304\") " pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:37:13.603383 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.603352 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bp9d4" Jun 11 16:37:13.629056 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.629029 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7njlg\"" Jun 11 16:37:13.637520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.637494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:37:13.708593 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.708434 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t6lsx\"" Jun 11 16:37:13.717245 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.716938 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddsx7" Jun 11 16:37:13.758429 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.758399 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bp9d4"] Jun 11 16:37:13.762990 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:13.762948 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f045c6_2e71_4b56_87d6_fa2a8146e250.slice/crio-ffab00ced7dca88db6b79da4e3400c68a1110b99f6c8388b635f52363330c410 WatchSource:0}: Error finding container ffab00ced7dca88db6b79da4e3400c68a1110b99f6c8388b635f52363330c410: Status 404 returned error can't find the container with id ffab00ced7dca88db6b79da4e3400c68a1110b99f6c8388b635f52363330c410 Jun 11 16:37:13.818111 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.816350 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8n5hh"] Jun 11 16:37:13.820048 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:13.820021 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe0e73d_c35d_41f5_9d36_3a249703a304.slice/crio-b36829915144bfde05b09516c38b7b88406fb78acc7335cd447a2dfbf9c3210a WatchSource:0}: Error finding container b36829915144bfde05b09516c38b7b88406fb78acc7335cd447a2dfbf9c3210a: Status 404 returned error can't find the container with id b36829915144bfde05b09516c38b7b88406fb78acc7335cd447a2dfbf9c3210a Jun 11 16:37:13.865519 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:13.865483 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ddsx7"] Jun 11 16:37:13.869155 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:13.869131 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2c30aa_b038_41d0_baae_a0916f5b459e.slice/crio-85f1d54fcdc938c9da39a086a1183eb88934452fb64458e21ef48a0d3bb73b52 WatchSource:0}: Error finding container 85f1d54fcdc938c9da39a086a1183eb88934452fb64458e21ef48a0d3bb73b52: Status 404 returned error can't find the container with id 85f1d54fcdc938c9da39a086a1183eb88934452fb64458e21ef48a0d3bb73b52 Jun 11 16:37:14.026372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.026337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddsx7" event={"ID":"ba2c30aa-b038-41d0-baae-a0916f5b459e","Type":"ContainerStarted","Data":"85f1d54fcdc938c9da39a086a1183eb88934452fb64458e21ef48a0d3bb73b52"} Jun 11 16:37:14.027569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.027514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp9d4" event={"ID":"30f045c6-2e71-4b56-87d6-fa2a8146e250","Type":"ContainerStarted","Data":"ffab00ced7dca88db6b79da4e3400c68a1110b99f6c8388b635f52363330c410"} Jun 11 16:37:14.029569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.029529 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" event={"ID":"401abedd-05d9-440c-9a91-5cb3ba1d1709","Type":"ContainerStarted","Data":"71f42febcf5731dd3ec28619850f9b2837eebcff761f8469ea23ac46b496a6b5"} Jun 11 16:37:14.029663 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.029596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" event={"ID":"401abedd-05d9-440c-9a91-5cb3ba1d1709","Type":"ContainerStarted","Data":"32c020915ff4681526d46ee63d35645e3f24089747edaf34af5428ee6af3cd1b"} Jun 11 16:37:14.030646 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.030626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8n5hh" event={"ID":"3fe0e73d-c35d-41f5-9d36-3a249703a304","Type":"ContainerStarted","Data":"b36829915144bfde05b09516c38b7b88406fb78acc7335cd447a2dfbf9c3210a"} Jun 11 16:37:14.052254 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.052101 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d75f9c959-b8vz5" podStartSLOduration=2.348465647 podStartE2EDuration="5.05208113s" totalImagesPullingTime="2.703615483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:14.051248774 +0000 UTC m=+66.870815396" watchObservedRunningTime="2026-06-11 16:37:14.05208113 +0000 UTC m=+66.871647752" Jun 11 16:37:14.710564 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.710474 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556cf9d446-h6znm"] Jun 11 16:37:14.800032 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.799984 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55fcf7bbf5-v5bqw"] Jun 11 16:37:14.803014 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.802986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.814306 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.814242 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fcf7bbf5-v5bqw"] Jun 11 16:37:14.844983 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.844943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-serving-cert\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.845153 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.845030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-console-config\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.845153 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.845063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-oauth-serving-cert\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.845153 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.845104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-trusted-ca-bundle\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.845153 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.845138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlqlv\" (UniqueName: \"kubernetes.io/projected/7410b603-861b-42ee-a369-4959fb6579d8-kube-api-access-hlqlv\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.845294 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.845202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-oauth-config\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.845294 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.845262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-service-ca\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.946611 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.946505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-console-config\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.946611 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.946589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-oauth-serving-cert\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.946611 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.946619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-trusted-ca-bundle\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.946917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.946654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlqlv\" (UniqueName: \"kubernetes.io/projected/7410b603-861b-42ee-a369-4959fb6579d8-kube-api-access-hlqlv\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.946917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.946692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-oauth-config\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.946917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.946719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-service-ca\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.946917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.946814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-serving-cert\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.947586 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.947519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-oauth-serving-cert\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.947769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.947747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-trusted-ca-bundle\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.948230 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.948207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-console-config\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.948677 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.948658 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-service-ca\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.949891 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.949868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-serving-cert\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.949990 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.949924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-oauth-config\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:14.955025 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:14.954998 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlqlv\" (UniqueName: \"kubernetes.io/projected/7410b603-861b-42ee-a369-4959fb6579d8-kube-api-access-hlqlv\") pod \"console-55fcf7bbf5-v5bqw\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:15.116617 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:15.116468 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:15.275713 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:15.275438 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fcf7bbf5-v5bqw"] Jun 11 16:37:15.279342 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:37:15.279298 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7410b603_861b_42ee_a369_4959fb6579d8.slice/crio-7f0727e788d25bb6f8c0be7db43235b1a8a9c3f7400f8441eeeff752308f25ab WatchSource:0}: Error finding container 7f0727e788d25bb6f8c0be7db43235b1a8a9c3f7400f8441eeeff752308f25ab: Status 404 returned error can't find the container with id 7f0727e788d25bb6f8c0be7db43235b1a8a9c3f7400f8441eeeff752308f25ab Jun 11 16:37:16.044651 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:16.044590 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fcf7bbf5-v5bqw" event={"ID":"7410b603-861b-42ee-a369-4959fb6579d8","Type":"ContainerStarted","Data":"c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476"} Jun 11 16:37:16.044651 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:16.044666 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fcf7bbf5-v5bqw" event={"ID":"7410b603-861b-42ee-a369-4959fb6579d8","Type":"ContainerStarted","Data":"7f0727e788d25bb6f8c0be7db43235b1a8a9c3f7400f8441eeeff752308f25ab"} Jun 11 16:37:16.047414 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:16.047384 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddsx7" event={"ID":"ba2c30aa-b038-41d0-baae-a0916f5b459e","Type":"ContainerStarted","Data":"b6a18b33871d42d62ef6e265002d215171f0a800d4ffa628d042b26988dcf14f"} Jun 11 16:37:16.047568 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:16.047442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddsx7" event={"ID":"ba2c30aa-b038-41d0-baae-a0916f5b459e","Type":"ContainerStarted","Data":"b27639d6c274c220cda15fc2a37ea18ca86b12667cd6033ed6a78c50eb206dde"} Jun 11 16:37:16.061931 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:16.061829 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55fcf7bbf5-v5bqw" podStartSLOduration=2.061809358 podStartE2EDuration="2.061809358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:16.060484466 +0000 UTC m=+68.880051092" watchObservedRunningTime="2026-06-11 16:37:16.061809358 +0000 UTC m=+68.881375980" Jun 11 16:37:16.079895 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:16.079716 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ddsx7" podStartSLOduration=67.962163026 podStartE2EDuration="1m9.079698521s" totalImagesPullingTime="1.117535495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:16.078493256 +0000 UTC m=+68.898059880" watchObservedRunningTime="2026-06-11 16:37:16.079698521 +0000 UTC m=+68.899265144" Jun 11 16:37:20.074376 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:20.074337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bp9d4" event={"ID":"30f045c6-2e71-4b56-87d6-fa2a8146e250","Type":"ContainerStarted","Data":"6b43233ab24350acb97608fdc680f7e69525dd5d47216680725ce382cc3124f2"} Jun 11 16:37:20.075903 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:20.075877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8n5hh" event={"ID":"3fe0e73d-c35d-41f5-9d36-3a249703a304","Type":"ContainerStarted","Data":"5eeed72a18b1b3226ed7028918f706eabe019180ac417895c3bac696ea3a0592"} Jun 11 16:37:20.076023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:20.076007 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:37:20.089390 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:20.089338 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bp9d4" podStartSLOduration=66.649001503 podStartE2EDuration="1m12.089323096s" totalImagesPullingTime="5.440321593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:20.088079125 +0000 UTC m=+72.907645760" watchObservedRunningTime="2026-06-11 16:37:20.089323096 +0000 UTC m=+72.908889717" Jun 11 16:37:20.103194 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:20.103145 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8n5hh" podStartSLOduration=67.720832574 podStartE2EDuration="1m13.103130025s" totalImagesPullingTime="5.382297451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:20.102159247 +0000 UTC m=+72.921725878" watchObservedRunningTime="2026-06-11 16:37:20.103130025 +0000 UTC m=+72.922696646" Jun 11 16:37:20.328638 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:20.328505 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:25.116907 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:25.116778 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:25.116907 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:25.116844 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:25.121563 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:25.121521 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:26.104602 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:26.104574 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:37:26.152477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:26.152444 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69487747fb-msp5h"] Jun 11 16:37:39.741561 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:39.741503 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-556cf9d446-h6znm" podUID="35b3214d-2841-4ad2-bb70-a622b761e1e3" containerName="console" containerID="cri-o://c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96" gracePeriod=15 Jun 11 16:37:40.006405 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.006369 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:40.151769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.151734 2565 generic.go:356] "Generic (PLEG): container finished" podID="35b3214d-2841-4ad2-bb70-a622b761e1e3" containerID="c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96" exitCode=0 Jun 11 16:37:40.151769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.151775 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556cf9d446-h6znm" Jun 11 16:37:40.151991 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.151812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cf9d446-h6znm" event={"ID":"35b3214d-2841-4ad2-bb70-a622b761e1e3","Type":"ContainerDied","Data":"c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96"} Jun 11 16:37:40.151991 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.151863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556cf9d446-h6znm" event={"ID":"35b3214d-2841-4ad2-bb70-a622b761e1e3","Type":"ContainerDied","Data":"06a4350eb4e2c487fb8ae26edfcda48ef69dcd97f8d7eb24736acd7d7acab4c2"} Jun 11 16:37:40.151991 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.151898 2565 scope.go:117] "RemoveContainer" containerID="c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96" Jun 11 16:37:40.164220 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.164195 2565 scope.go:117] "RemoveContainer" containerID="c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96" Jun 11 16:37:40.165158 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:40.165062 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96\": container with ID starting with c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96 not found: ID does not exist" containerID="c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96" Jun 11 16:37:40.165158 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.165105 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96"} err="failed to get container status \"c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96\": rpc error: code = NotFound desc = could not find container \"c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96\": container with ID starting with c7bcc5c0ea2353e59dbbc64adbba0b0577fe8923493f5df3355b56170b4f8a96 not found: ID does not exist" Jun 11 16:37:40.174724 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.174697 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9q2q\" (UniqueName: \"kubernetes.io/projected/35b3214d-2841-4ad2-bb70-a622b761e1e3-kube-api-access-h9q2q\") pod \"35b3214d-2841-4ad2-bb70-a622b761e1e3\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " Jun 11 16:37:40.174822 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.174734 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-serving-cert\") pod \"35b3214d-2841-4ad2-bb70-a622b761e1e3\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " Jun 11 16:37:40.174822 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.174775 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-trusted-ca-bundle\") pod \"35b3214d-2841-4ad2-bb70-a622b761e1e3\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " Jun 11 16:37:40.174903 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.174877 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-config\") pod \"35b3214d-2841-4ad2-bb70-a622b761e1e3\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " Jun 11 16:37:40.174955 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.174947 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-service-ca\") pod \"35b3214d-2841-4ad2-bb70-a622b761e1e3\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " Jun 11 16:37:40.175018 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175000 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-oauth-config\") pod \"35b3214d-2841-4ad2-bb70-a622b761e1e3\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " Jun 11 16:37:40.175077 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175035 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-oauth-serving-cert\") pod \"35b3214d-2841-4ad2-bb70-a622b761e1e3\" (UID: \"35b3214d-2841-4ad2-bb70-a622b761e1e3\") " Jun 11 16:37:40.175127 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175108 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "35b3214d-2841-4ad2-bb70-a622b761e1e3" (UID: "35b3214d-2841-4ad2-bb70-a622b761e1e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:40.175304 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175230 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-config" (OuterVolumeSpecName: "console-config") pod "35b3214d-2841-4ad2-bb70-a622b761e1e3" (UID: "35b3214d-2841-4ad2-bb70-a622b761e1e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:40.175304 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175317 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-trusted-ca-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:40.175478 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175319 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "35b3214d-2841-4ad2-bb70-a622b761e1e3" (UID: "35b3214d-2841-4ad2-bb70-a622b761e1e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:40.175478 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175335 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:40.175617 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.175479 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "35b3214d-2841-4ad2-bb70-a622b761e1e3" (UID: "35b3214d-2841-4ad2-bb70-a622b761e1e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:40.177292 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.177255 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "35b3214d-2841-4ad2-bb70-a622b761e1e3" (UID: "35b3214d-2841-4ad2-bb70-a622b761e1e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:37:40.177364 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.177283 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35b3214d-2841-4ad2-bb70-a622b761e1e3-kube-api-access-h9q2q" (OuterVolumeSpecName: "kube-api-access-h9q2q") pod "35b3214d-2841-4ad2-bb70-a622b761e1e3" (UID: "35b3214d-2841-4ad2-bb70-a622b761e1e3"). InnerVolumeSpecName "kube-api-access-h9q2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:37:40.177364 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.177310 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "35b3214d-2841-4ad2-bb70-a622b761e1e3" (UID: "35b3214d-2841-4ad2-bb70-a622b761e1e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:37:40.276018 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.275930 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-oauth-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:40.276018 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.275977 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-oauth-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:40.276018 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.275994 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9q2q\" (UniqueName: \"kubernetes.io/projected/35b3214d-2841-4ad2-bb70-a622b761e1e3-kube-api-access-h9q2q\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:40.276018 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.276011 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35b3214d-2841-4ad2-bb70-a622b761e1e3-console-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:40.276245 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.276029 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35b3214d-2841-4ad2-bb70-a622b761e1e3-service-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:40.475225 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.475194 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556cf9d446-h6znm"] Jun 11 16:37:40.480112 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:40.480080 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-556cf9d446-h6znm"] Jun 11 16:37:41.696742 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:41.696709 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35b3214d-2841-4ad2-bb70-a622b761e1e3" path="/var/lib/kubelet/pods/35b3214d-2841-4ad2-bb70-a622b761e1e3/volumes" Jun 11 16:37:51.082423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.082393 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8n5hh" Jun 11 16:37:51.176205 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.176159 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69487747fb-msp5h" podUID="710ec1de-4370-4a3d-8870-f9906ebd440c" containerName="console" containerID="cri-o://7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825" gracePeriod=15 Jun 11 16:37:51.421205 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.421180 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:37:51.464059 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464025 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-service-ca\") pod \"710ec1de-4370-4a3d-8870-f9906ebd440c\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " Jun 11 16:37:51.464059 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464067 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-oauth-serving-cert\") pod \"710ec1de-4370-4a3d-8870-f9906ebd440c\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " Jun 11 16:37:51.464288 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464100 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-trusted-ca-bundle\") pod \"710ec1de-4370-4a3d-8870-f9906ebd440c\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " Jun 11 16:37:51.464288 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464147 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-oauth-config\") pod \"710ec1de-4370-4a3d-8870-f9906ebd440c\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " Jun 11 16:37:51.464288 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464175 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz8lq\" (UniqueName: \"kubernetes.io/projected/710ec1de-4370-4a3d-8870-f9906ebd440c-kube-api-access-mz8lq\") pod \"710ec1de-4370-4a3d-8870-f9906ebd440c\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " Jun 11 16:37:51.464288 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464200 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-serving-cert\") pod \"710ec1de-4370-4a3d-8870-f9906ebd440c\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " Jun 11 16:37:51.464288 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464231 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-console-config\") pod \"710ec1de-4370-4a3d-8870-f9906ebd440c\" (UID: \"710ec1de-4370-4a3d-8870-f9906ebd440c\") " Jun 11 16:37:51.464651 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464601 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-service-ca" (OuterVolumeSpecName: "service-ca") pod "710ec1de-4370-4a3d-8870-f9906ebd440c" (UID: "710ec1de-4370-4a3d-8870-f9906ebd440c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:51.464651 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464541 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "710ec1de-4370-4a3d-8870-f9906ebd440c" (UID: "710ec1de-4370-4a3d-8870-f9906ebd440c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:51.464799 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464694 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "710ec1de-4370-4a3d-8870-f9906ebd440c" (UID: "710ec1de-4370-4a3d-8870-f9906ebd440c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:51.464799 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.464718 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-console-config" (OuterVolumeSpecName: "console-config") pod "710ec1de-4370-4a3d-8870-f9906ebd440c" (UID: "710ec1de-4370-4a3d-8870-f9906ebd440c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:37:51.466535 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.466503 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "710ec1de-4370-4a3d-8870-f9906ebd440c" (UID: "710ec1de-4370-4a3d-8870-f9906ebd440c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:37:51.466666 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.466570 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710ec1de-4370-4a3d-8870-f9906ebd440c-kube-api-access-mz8lq" (OuterVolumeSpecName: "kube-api-access-mz8lq") pod "710ec1de-4370-4a3d-8870-f9906ebd440c" (UID: "710ec1de-4370-4a3d-8870-f9906ebd440c"). InnerVolumeSpecName "kube-api-access-mz8lq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:37:51.466722 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.466685 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "710ec1de-4370-4a3d-8870-f9906ebd440c" (UID: "710ec1de-4370-4a3d-8870-f9906ebd440c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:37:51.565095 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.565065 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-trusted-ca-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:51.565095 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.565094 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-oauth-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:51.565279 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.565105 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz8lq\" (UniqueName: \"kubernetes.io/projected/710ec1de-4370-4a3d-8870-f9906ebd440c-kube-api-access-mz8lq\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:51.565279 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.565115 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/710ec1de-4370-4a3d-8870-f9906ebd440c-console-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:51.565279 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.565124 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-console-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:51.565279 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.565132 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-service-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:51.565279 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:51.565142 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/710ec1de-4370-4a3d-8870-f9906ebd440c-oauth-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:37:52.198003 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.197966 2565 generic.go:356] "Generic (PLEG): container finished" podID="710ec1de-4370-4a3d-8870-f9906ebd440c" containerID="7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825" exitCode=0 Jun 11 16:37:52.198003 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.198008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69487747fb-msp5h" event={"ID":"710ec1de-4370-4a3d-8870-f9906ebd440c","Type":"ContainerDied","Data":"7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825"} Jun 11 16:37:52.198514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.198016 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69487747fb-msp5h" Jun 11 16:37:52.198514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.198051 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69487747fb-msp5h" event={"ID":"710ec1de-4370-4a3d-8870-f9906ebd440c","Type":"ContainerDied","Data":"2fe969f69ed6fd38928f71bfc0cfc2215a0132dbebe41ac0fcce86a51e90d12e"} Jun 11 16:37:52.198514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.198071 2565 scope.go:117] "RemoveContainer" containerID="7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825" Jun 11 16:37:52.208467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.208445 2565 scope.go:117] "RemoveContainer" containerID="7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825" Jun 11 16:37:52.208764 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:37:52.208743 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825\": container with ID starting with 7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825 not found: ID does not exist" containerID="7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825" Jun 11 16:37:52.208813 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.208775 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825"} err="failed to get container status \"7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825\": rpc error: code = NotFound desc = could not find container \"7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825\": container with ID starting with 7bc1d891ebae87d12e861be6045b328958180509e08de6960ba166f8ba504825 not found: ID does not exist" Jun 11 16:37:52.215893 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.215867 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69487747fb-msp5h"] Jun 11 16:37:52.220202 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:52.220181 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69487747fb-msp5h"] Jun 11 16:37:53.695319 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:37:53.695282 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="710ec1de-4370-4a3d-8870-f9906ebd440c" path="/var/lib/kubelet/pods/710ec1de-4370-4a3d-8870-f9906ebd440c/volumes" Jun 11 16:38:16.790898 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.790866 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9bccf64d-ds2l2"] Jun 11 16:38:16.791359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.791162 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b3214d-2841-4ad2-bb70-a622b761e1e3" containerName="console" Jun 11 16:38:16.791359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.791175 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b3214d-2841-4ad2-bb70-a622b761e1e3" containerName="console" Jun 11 16:38:16.791359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.791190 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710ec1de-4370-4a3d-8870-f9906ebd440c" containerName="console" Jun 11 16:38:16.791359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.791199 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="710ec1de-4370-4a3d-8870-f9906ebd440c" containerName="console" Jun 11 16:38:16.791359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.791244 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="35b3214d-2841-4ad2-bb70-a622b761e1e3" containerName="console" Jun 11 16:38:16.791359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.791253 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="710ec1de-4370-4a3d-8870-f9906ebd440c" containerName="console" Jun 11 16:38:16.793863 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.793844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.806465 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.806432 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9bccf64d-ds2l2"] Jun 11 16:38:16.837247 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.837213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-oauth-serving-cert\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.837247 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.837249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-service-ca\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.837449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.837276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl5qh\" (UniqueName: \"kubernetes.io/projected/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-kube-api-access-cl5qh\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.837449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.837334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-trusted-ca-bundle\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.837449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.837372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-config\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.837449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.837395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-oauth-config\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.837449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.837430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-serving-cert\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.938446 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.938411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-oauth-serving-cert\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.938446 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.938445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-service-ca\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.938705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.938474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl5qh\" (UniqueName: \"kubernetes.io/projected/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-kube-api-access-cl5qh\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.938705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.938497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-trusted-ca-bundle\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.938705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.938537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-config\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.938848 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.938707 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-oauth-config\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.938848 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.938791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-serving-cert\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.939454 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.939426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-oauth-serving-cert\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.939588 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.939479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-config\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.939588 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.939523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-service-ca\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.939916 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.939898 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-trusted-ca-bundle\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.941265 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.941233 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-oauth-config\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.941265 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.941255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-serving-cert\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:16.945174 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:16.945150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl5qh\" (UniqueName: \"kubernetes.io/projected/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-kube-api-access-cl5qh\") pod \"console-6b9bccf64d-ds2l2\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:17.103112 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:17.103073 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:17.236089 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:17.236054 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9bccf64d-ds2l2"] Jun 11 16:38:17.239947 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:38:17.239918 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4390dc5e_8a72_4cde_ad66_0ea6d8d4c466.slice/crio-62f027c60bc5f2bcbc59585446f67ba1d948469cd896388e4d0d935104bf672c WatchSource:0}: Error finding container 62f027c60bc5f2bcbc59585446f67ba1d948469cd896388e4d0d935104bf672c: Status 404 returned error can't find the container with id 62f027c60bc5f2bcbc59585446f67ba1d948469cd896388e4d0d935104bf672c Jun 11 16:38:17.287245 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:17.287218 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9bccf64d-ds2l2" event={"ID":"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466","Type":"ContainerStarted","Data":"62f027c60bc5f2bcbc59585446f67ba1d948469cd896388e4d0d935104bf672c"} Jun 11 16:38:18.292154 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:18.292110 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9bccf64d-ds2l2" event={"ID":"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466","Type":"ContainerStarted","Data":"2cb2f724347e87fe204181f4ae4a3dc22e08445a5cb0e939cf654ede6a495e89"} Jun 11 16:38:18.315464 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:18.315403 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9bccf64d-ds2l2" podStartSLOduration=2.315380989 podStartE2EDuration="2.315380989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:38:18.314858221 +0000 UTC m=+131.134424842" watchObservedRunningTime="2026-06-11 16:38:18.315380989 +0000 UTC m=+131.134947612" Jun 11 16:38:27.103416 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:27.103359 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:27.103911 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:27.103440 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:27.108155 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:27.108133 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:27.328161 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:27.328132 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:38:27.364344 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:27.364257 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55fcf7bbf5-v5bqw"] Jun 11 16:38:52.389750 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.389707 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55fcf7bbf5-v5bqw" podUID="7410b603-861b-42ee-a369-4959fb6579d8" containerName="console" containerID="cri-o://c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476" gracePeriod=15 Jun 11 16:38:52.632391 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.632364 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:38:52.730356 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730271 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-serving-cert\") pod \"7410b603-861b-42ee-a369-4959fb6579d8\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " Jun 11 16:38:52.730356 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730326 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-service-ca\") pod \"7410b603-861b-42ee-a369-4959fb6579d8\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " Jun 11 16:38:52.730609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730365 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-oauth-serving-cert\") pod \"7410b603-861b-42ee-a369-4959fb6579d8\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " Jun 11 16:38:52.730609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730389 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-console-config\") pod \"7410b603-861b-42ee-a369-4959fb6579d8\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " Jun 11 16:38:52.730609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730441 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlqlv\" (UniqueName: \"kubernetes.io/projected/7410b603-861b-42ee-a369-4959fb6579d8-kube-api-access-hlqlv\") pod \"7410b603-861b-42ee-a369-4959fb6579d8\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " Jun 11 16:38:52.730609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730472 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-oauth-config\") pod \"7410b603-861b-42ee-a369-4959fb6579d8\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " Jun 11 16:38:52.730609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730500 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-trusted-ca-bundle\") pod \"7410b603-861b-42ee-a369-4959fb6579d8\" (UID: \"7410b603-861b-42ee-a369-4959fb6579d8\") " Jun 11 16:38:52.730956 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730913 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-console-config" (OuterVolumeSpecName: "console-config") pod "7410b603-861b-42ee-a369-4959fb6579d8" (UID: "7410b603-861b-42ee-a369-4959fb6579d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:52.730956 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730836 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "7410b603-861b-42ee-a369-4959fb6579d8" (UID: "7410b603-861b-42ee-a369-4959fb6579d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:52.731073 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.730961 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7410b603-861b-42ee-a369-4959fb6579d8" (UID: "7410b603-861b-42ee-a369-4959fb6579d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:52.731073 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.731038 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7410b603-861b-42ee-a369-4959fb6579d8" (UID: "7410b603-861b-42ee-a369-4959fb6579d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:52.732769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.732735 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7410b603-861b-42ee-a369-4959fb6579d8" (UID: "7410b603-861b-42ee-a369-4959fb6579d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:38:52.733053 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.733036 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7410b603-861b-42ee-a369-4959fb6579d8" (UID: "7410b603-861b-42ee-a369-4959fb6579d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:38:52.733119 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.733091 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7410b603-861b-42ee-a369-4959fb6579d8-kube-api-access-hlqlv" (OuterVolumeSpecName: "kube-api-access-hlqlv") pod "7410b603-861b-42ee-a369-4959fb6579d8" (UID: "7410b603-861b-42ee-a369-4959fb6579d8"). InnerVolumeSpecName "kube-api-access-hlqlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:38:52.831830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.831789 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:38:52.831830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.831823 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-service-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:38:52.831830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.831833 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-oauth-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:38:52.832064 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.831842 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-console-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:38:52.832064 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.831852 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlqlv\" (UniqueName: \"kubernetes.io/projected/7410b603-861b-42ee-a369-4959fb6579d8-kube-api-access-hlqlv\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:38:52.832064 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.831861 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7410b603-861b-42ee-a369-4959fb6579d8-console-oauth-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:38:52.832064 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:52.831869 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7410b603-861b-42ee-a369-4959fb6579d8-trusted-ca-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:38:53.422009 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.421976 2565 generic.go:356] "Generic (PLEG): container finished" podID="7410b603-861b-42ee-a369-4959fb6579d8" containerID="c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476" exitCode=0 Jun 11 16:38:53.422423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.422020 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fcf7bbf5-v5bqw" Jun 11 16:38:53.422423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.422048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fcf7bbf5-v5bqw" event={"ID":"7410b603-861b-42ee-a369-4959fb6579d8","Type":"ContainerDied","Data":"c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476"} Jun 11 16:38:53.422423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.422084 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fcf7bbf5-v5bqw" event={"ID":"7410b603-861b-42ee-a369-4959fb6579d8","Type":"ContainerDied","Data":"7f0727e788d25bb6f8c0be7db43235b1a8a9c3f7400f8441eeeff752308f25ab"} Jun 11 16:38:53.422423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.422104 2565 scope.go:117] "RemoveContainer" containerID="c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476" Jun 11 16:38:53.430486 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.430462 2565 scope.go:117] "RemoveContainer" containerID="c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476" Jun 11 16:38:53.430785 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:38:53.430764 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476\": container with ID starting with c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476 not found: ID does not exist" containerID="c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476" Jun 11 16:38:53.430864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.430793 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476"} err="failed to get container status \"c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476\": rpc error: code = NotFound desc = could not find container \"c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476\": container with ID starting with c41b47f8b52446cca03cc30b643a80f54f6a4421d02a700e6f992c812cecd476 not found: ID does not exist" Jun 11 16:38:53.443962 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.443933 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55fcf7bbf5-v5bqw"] Jun 11 16:38:53.450737 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.450711 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55fcf7bbf5-v5bqw"] Jun 11 16:38:53.695683 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:38:53.695604 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7410b603-861b-42ee-a369-4959fb6579d8" path="/var/lib/kubelet/pods/7410b603-861b-42ee-a369-4959fb6579d8/volumes" Jun 11 16:39:18.412392 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.412355 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt"] Jun 11 16:39:18.412771 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.412674 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7410b603-861b-42ee-a369-4959fb6579d8" containerName="console" Jun 11 16:39:18.412771 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.412684 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7410b603-861b-42ee-a369-4959fb6579d8" containerName="console" Jun 11 16:39:18.412771 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.412726 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7410b603-861b-42ee-a369-4959fb6579d8" containerName="console" Jun 11 16:39:18.417201 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.417183 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.419511 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.419487 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:39:18.419917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.419900 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lw6j7\"" Jun 11 16:39:18.419963 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.419929 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:39:18.423263 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.423230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt"] Jun 11 16:39:18.521133 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.521097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z697c\" (UniqueName: \"kubernetes.io/projected/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-kube-api-access-z697c\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.521301 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.521159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.521301 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.521203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.622304 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.622253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z697c\" (UniqueName: \"kubernetes.io/projected/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-kube-api-access-z697c\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.622466 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.622338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.622466 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.622377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.622831 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.622810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.622867 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.622825 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.630499 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.630480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z697c\" (UniqueName: \"kubernetes.io/projected/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-kube-api-access-z697c\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.727019 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.726919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:18.853679 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:18.853649 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt"] Jun 11 16:39:18.857099 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:39:18.857073 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60c49a3_38e4_4fb6_8cda_f8ed77e8facd.slice/crio-71602c810caf53c1f9b240f9b6febb8c50692cedcb13a669b09178389084308c WatchSource:0}: Error finding container 71602c810caf53c1f9b240f9b6febb8c50692cedcb13a669b09178389084308c: Status 404 returned error can't find the container with id 71602c810caf53c1f9b240f9b6febb8c50692cedcb13a669b09178389084308c Jun 11 16:39:19.513216 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:19.513181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" event={"ID":"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd","Type":"ContainerStarted","Data":"71602c810caf53c1f9b240f9b6febb8c50692cedcb13a669b09178389084308c"} Jun 11 16:39:26.540467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:26.540433 2565 generic.go:356] "Generic (PLEG): container finished" podID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerID="8c29242358e5f2339ed156ab8a40c8d36fc777b7e35606f708c838598aa86b5f" exitCode=0 Jun 11 16:39:26.540995 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:26.540501 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" event={"ID":"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd","Type":"ContainerDied","Data":"8c29242358e5f2339ed156ab8a40c8d36fc777b7e35606f708c838598aa86b5f"} Jun 11 16:39:28.550316 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:28.550270 2565 generic.go:356] "Generic (PLEG): container finished" podID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerID="df745a7ce78d187482ee3e37f4ba709827ecd590594d9632122fb9730922c5b4" exitCode=0 Jun 11 16:39:28.550725 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:28.550363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" event={"ID":"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd","Type":"ContainerDied","Data":"df745a7ce78d187482ee3e37f4ba709827ecd590594d9632122fb9730922c5b4"} Jun 11 16:39:38.592726 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:38.592631 2565 generic.go:356] "Generic (PLEG): container finished" podID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerID="39aad917452049e3e97ba045b0b4ca8e2789d59eb09fcbd206df30ea63762359" exitCode=0 Jun 11 16:39:38.592726 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:38.592705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" event={"ID":"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd","Type":"ContainerDied","Data":"39aad917452049e3e97ba045b0b4ca8e2789d59eb09fcbd206df30ea63762359"} Jun 11 16:39:39.724158 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.724131 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:39.805314 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.805279 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z697c\" (UniqueName: \"kubernetes.io/projected/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-kube-api-access-z697c\") pod \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " Jun 11 16:39:39.805489 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.805340 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-util\") pod \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " Jun 11 16:39:39.805489 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.805379 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-bundle\") pod \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\" (UID: \"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd\") " Jun 11 16:39:39.806154 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.806123 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-bundle" (OuterVolumeSpecName: "bundle") pod "a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" (UID: "a60c49a3-38e4-4fb6-8cda-f8ed77e8facd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:39:39.807643 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.807614 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-kube-api-access-z697c" (OuterVolumeSpecName: "kube-api-access-z697c") pod "a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" (UID: "a60c49a3-38e4-4fb6-8cda-f8ed77e8facd"). InnerVolumeSpecName "kube-api-access-z697c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:39:39.810185 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.810165 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-util" (OuterVolumeSpecName: "util") pod "a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" (UID: "a60c49a3-38e4-4fb6-8cda-f8ed77e8facd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:39:39.906926 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.906837 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:39:39.906926 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.906870 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:39:39.906926 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:39.906880 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z697c\" (UniqueName: \"kubernetes.io/projected/a60c49a3-38e4-4fb6-8cda-f8ed77e8facd-kube-api-access-z697c\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:39:40.601393 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:40.601353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" event={"ID":"a60c49a3-38e4-4fb6-8cda-f8ed77e8facd","Type":"ContainerDied","Data":"71602c810caf53c1f9b240f9b6febb8c50692cedcb13a669b09178389084308c"} Jun 11 16:39:40.601393 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:40.601375 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnrzdt" Jun 11 16:39:40.601393 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:40.601403 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71602c810caf53c1f9b240f9b6febb8c50692cedcb13a669b09178389084308c" Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.239656 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw"] Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.240269 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerName="pull" Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.240289 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerName="pull" Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.240336 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerName="extract" Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.240345 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerName="extract" Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.240362 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerName="util" Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.240372 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerName="util" Jun 11 16:39:46.241773 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.240483 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60c49a3-38e4-4fb6-8cda-f8ed77e8facd" containerName="extract" Jun 11 16:39:46.244486 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.244456 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.246843 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.246817 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:39:46.246980 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.246897 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lvhds\"" Jun 11 16:39:46.247060 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.246973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 16:39:46.256605 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.256574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw"] Jun 11 16:39:46.360168 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.360125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e907d00-5e07-44a6-942a-ced3b2414361-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-v5rbw\" (UID: \"9e907d00-5e07-44a6-942a-ced3b2414361\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.360360 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.360202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dng4z\" (UniqueName: \"kubernetes.io/projected/9e907d00-5e07-44a6-942a-ced3b2414361-kube-api-access-dng4z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-v5rbw\" (UID: \"9e907d00-5e07-44a6-942a-ced3b2414361\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.461406 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.461365 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dng4z\" (UniqueName: \"kubernetes.io/projected/9e907d00-5e07-44a6-942a-ced3b2414361-kube-api-access-dng4z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-v5rbw\" (UID: \"9e907d00-5e07-44a6-942a-ced3b2414361\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.461627 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.461424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e907d00-5e07-44a6-942a-ced3b2414361-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-v5rbw\" (UID: \"9e907d00-5e07-44a6-942a-ced3b2414361\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.461788 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.461770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e907d00-5e07-44a6-942a-ced3b2414361-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-v5rbw\" (UID: \"9e907d00-5e07-44a6-942a-ced3b2414361\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.469523 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.469497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dng4z\" (UniqueName: \"kubernetes.io/projected/9e907d00-5e07-44a6-942a-ced3b2414361-kube-api-access-dng4z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-v5rbw\" (UID: \"9e907d00-5e07-44a6-942a-ced3b2414361\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.554347 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.554318 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" Jun 11 16:39:46.685066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:46.685024 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw"] Jun 11 16:39:46.688920 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:39:46.688888 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e907d00_5e07_44a6_942a_ced3b2414361.slice/crio-9bc0873ae1b0652761a5a61cf47678b4a6a581ca6e7d8caae49bd156e89df0ca WatchSource:0}: Error finding container 9bc0873ae1b0652761a5a61cf47678b4a6a581ca6e7d8caae49bd156e89df0ca: Status 404 returned error can't find the container with id 9bc0873ae1b0652761a5a61cf47678b4a6a581ca6e7d8caae49bd156e89df0ca Jun 11 16:39:47.628004 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:47.627969 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" event={"ID":"9e907d00-5e07-44a6-942a-ced3b2414361","Type":"ContainerStarted","Data":"9bc0873ae1b0652761a5a61cf47678b4a6a581ca6e7d8caae49bd156e89df0ca"} Jun 11 16:39:48.634465 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:48.634431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" event={"ID":"9e907d00-5e07-44a6-942a-ced3b2414361","Type":"ContainerStarted","Data":"2c30868eb2985365242679d2957ed1a5f397641d7dad989bebcc1c096e46a4c6"} Jun 11 16:39:48.653081 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:48.653025 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-v5rbw" podStartSLOduration=1.314005434 podStartE2EDuration="2.653002737s" totalImagesPullingTime="1.338997303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:48.652203248 +0000 UTC m=+221.471769867" watchObservedRunningTime="2026-06-11 16:39:48.653002737 +0000 UTC m=+221.472569360" Jun 11 16:39:50.468259 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.468223 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd"] Jun 11 16:39:50.470423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.470404 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.474213 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.474195 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lw6j7\"" Jun 11 16:39:50.474415 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.474402 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:39:50.474620 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.474605 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:39:50.482582 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.482537 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd"] Jun 11 16:39:50.595041 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.594993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqk5s\" (UniqueName: \"kubernetes.io/projected/c4525585-6106-4247-812b-7df5db86ba51-kube-api-access-pqk5s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.595197 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.595049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.595197 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.595169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.695598 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.695538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.695763 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.695640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.695763 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.695674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqk5s\" (UniqueName: \"kubernetes.io/projected/c4525585-6106-4247-812b-7df5db86ba51-kube-api-access-pqk5s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.695926 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.695905 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.695962 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.695941 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.703530 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.703507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqk5s\" (UniqueName: \"kubernetes.io/projected/c4525585-6106-4247-812b-7df5db86ba51-kube-api-access-pqk5s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.779790 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.779695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:50.906282 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:50.906249 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd"] Jun 11 16:39:50.909427 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:39:50.909403 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4525585_6106_4247_812b_7df5db86ba51.slice/crio-66ebd30506ba3ccbff671ed5c768678b97054ff5ad0c35954894f7759a146698 WatchSource:0}: Error finding container 66ebd30506ba3ccbff671ed5c768678b97054ff5ad0c35954894f7759a146698: Status 404 returned error can't find the container with id 66ebd30506ba3ccbff671ed5c768678b97054ff5ad0c35954894f7759a146698 Jun 11 16:39:51.441464 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.441427 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8"] Jun 11 16:39:51.443362 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.443346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.445435 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.445415 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:39:51.445581 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.445496 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-n8pnq\"" Jun 11 16:39:51.446026 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.446012 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:39:51.455025 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.454995 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8"] Jun 11 16:39:51.602601 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.602535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7m95\" (UniqueName: \"kubernetes.io/projected/a6e42df8-1c54-4dc7-8cba-64b010fcb374-kube-api-access-b7m95\") pod \"cert-manager-webhook-7dc76cbb94-5lmb8\" (UID: \"a6e42df8-1c54-4dc7-8cba-64b010fcb374\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.602982 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.602643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e42df8-1c54-4dc7-8cba-64b010fcb374-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5lmb8\" (UID: \"a6e42df8-1c54-4dc7-8cba-64b010fcb374\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.651736 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.651695 2565 generic.go:356] "Generic (PLEG): container finished" podID="c4525585-6106-4247-812b-7df5db86ba51" containerID="ce42cca98ced56ab85a9040024f25f41464c2eccae3241b3c185b0270a73fa28" exitCode=0 Jun 11 16:39:51.651886 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.651743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" event={"ID":"c4525585-6106-4247-812b-7df5db86ba51","Type":"ContainerDied","Data":"ce42cca98ced56ab85a9040024f25f41464c2eccae3241b3c185b0270a73fa28"} Jun 11 16:39:51.651886 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.651793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" event={"ID":"c4525585-6106-4247-812b-7df5db86ba51","Type":"ContainerStarted","Data":"66ebd30506ba3ccbff671ed5c768678b97054ff5ad0c35954894f7759a146698"} Jun 11 16:39:51.703952 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.703868 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7m95\" (UniqueName: \"kubernetes.io/projected/a6e42df8-1c54-4dc7-8cba-64b010fcb374-kube-api-access-b7m95\") pod \"cert-manager-webhook-7dc76cbb94-5lmb8\" (UID: \"a6e42df8-1c54-4dc7-8cba-64b010fcb374\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.703952 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.703909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e42df8-1c54-4dc7-8cba-64b010fcb374-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5lmb8\" (UID: \"a6e42df8-1c54-4dc7-8cba-64b010fcb374\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.711454 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.711422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7m95\" (UniqueName: \"kubernetes.io/projected/a6e42df8-1c54-4dc7-8cba-64b010fcb374-kube-api-access-b7m95\") pod \"cert-manager-webhook-7dc76cbb94-5lmb8\" (UID: \"a6e42df8-1c54-4dc7-8cba-64b010fcb374\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.711591 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.711423 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6e42df8-1c54-4dc7-8cba-64b010fcb374-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5lmb8\" (UID: \"a6e42df8-1c54-4dc7-8cba-64b010fcb374\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.769049 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.769009 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:51.896372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:51.896337 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8"] Jun 11 16:39:51.899099 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:39:51.899073 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6e42df8_1c54_4dc7_8cba_64b010fcb374.slice/crio-84b03781c6d83396a2131f14eb619cb21fbbe801390ea18a60756bd6ba66b2d2 WatchSource:0}: Error finding container 84b03781c6d83396a2131f14eb619cb21fbbe801390ea18a60756bd6ba66b2d2: Status 404 returned error can't find the container with id 84b03781c6d83396a2131f14eb619cb21fbbe801390ea18a60756bd6ba66b2d2 Jun 11 16:39:52.658596 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:52.658540 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" event={"ID":"a6e42df8-1c54-4dc7-8cba-64b010fcb374","Type":"ContainerStarted","Data":"84b03781c6d83396a2131f14eb619cb21fbbe801390ea18a60756bd6ba66b2d2"} Jun 11 16:39:55.674481 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:55.674447 2565 generic.go:356] "Generic (PLEG): container finished" podID="c4525585-6106-4247-812b-7df5db86ba51" containerID="39488aff780d66b977730c6fdf7b6e82097aa621cf5d1e6c00394683ff1ff4bf" exitCode=0 Jun 11 16:39:55.674991 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:55.674536 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" event={"ID":"c4525585-6106-4247-812b-7df5db86ba51","Type":"ContainerDied","Data":"39488aff780d66b977730c6fdf7b6e82097aa621cf5d1e6c00394683ff1ff4bf"} Jun 11 16:39:55.676034 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:55.676010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" event={"ID":"a6e42df8-1c54-4dc7-8cba-64b010fcb374","Type":"ContainerStarted","Data":"18e61e2981f013129cd142cd90e4ece0807fd9b165ab1ca0d7b72ebb6bb7df47"} Jun 11 16:39:55.676132 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:55.676055 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:39:55.706099 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:55.706048 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" podStartSLOduration=1.832120095 podStartE2EDuration="4.706032406s" totalImagesPullingTime="2.873912311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:55.705360092 +0000 UTC m=+228.524926725" watchObservedRunningTime="2026-06-11 16:39:55.706032406 +0000 UTC m=+228.525599026" Jun 11 16:39:56.633012 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.632969 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr"] Jun 11 16:39:56.635772 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.635750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:56.637784 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.637763 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rwvwc\"" Jun 11 16:39:56.643517 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.643492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr"] Jun 11 16:39:56.682164 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.682131 2565 generic.go:356] "Generic (PLEG): container finished" podID="c4525585-6106-4247-812b-7df5db86ba51" containerID="74654f40ac9fafee996f936fb4e77a548cfa4cfc4692839f8e8e41fcf3bd24cc" exitCode=0 Jun 11 16:39:56.682578 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.682227 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" event={"ID":"c4525585-6106-4247-812b-7df5db86ba51","Type":"ContainerDied","Data":"74654f40ac9fafee996f936fb4e77a548cfa4cfc4692839f8e8e41fcf3bd24cc"} Jun 11 16:39:56.749921 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.749878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8f2b9c-4ce1-464f-bcba-c7e2dac40934-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pkbkr\" (UID: \"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:56.750099 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.749963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxhqk\" (UniqueName: \"kubernetes.io/projected/4e8f2b9c-4ce1-464f-bcba-c7e2dac40934-kube-api-access-nxhqk\") pod \"cert-manager-cainjector-5d99449ffd-pkbkr\" (UID: \"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:56.851073 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.851023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxhqk\" (UniqueName: \"kubernetes.io/projected/4e8f2b9c-4ce1-464f-bcba-c7e2dac40934-kube-api-access-nxhqk\") pod \"cert-manager-cainjector-5d99449ffd-pkbkr\" (UID: \"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:56.851224 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.851086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8f2b9c-4ce1-464f-bcba-c7e2dac40934-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pkbkr\" (UID: \"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:56.858510 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.858468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8f2b9c-4ce1-464f-bcba-c7e2dac40934-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pkbkr\" (UID: \"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:56.858704 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.858686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxhqk\" (UniqueName: \"kubernetes.io/projected/4e8f2b9c-4ce1-464f-bcba-c7e2dac40934-kube-api-access-nxhqk\") pod \"cert-manager-cainjector-5d99449ffd-pkbkr\" (UID: \"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:56.945387 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:56.945297 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" Jun 11 16:39:57.073264 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.073232 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr"] Jun 11 16:39:57.076421 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:39:57.076387 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e8f2b9c_4ce1_464f_bcba_c7e2dac40934.slice/crio-b66e9a3e69ab55fec77b494ac44dc3e50cd25ea54010755b04f55b0e59af5dc8 WatchSource:0}: Error finding container b66e9a3e69ab55fec77b494ac44dc3e50cd25ea54010755b04f55b0e59af5dc8: Status 404 returned error can't find the container with id b66e9a3e69ab55fec77b494ac44dc3e50cd25ea54010755b04f55b0e59af5dc8 Jun 11 16:39:57.688731 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.688695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" event={"ID":"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934","Type":"ContainerStarted","Data":"ddcca9564c5eb3f02a155589d8b149f5a4dfb525255657aa6643ade4cae33746"} Jun 11 16:39:57.688731 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.688737 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" event={"ID":"4e8f2b9c-4ce1-464f-bcba-c7e2dac40934","Type":"ContainerStarted","Data":"b66e9a3e69ab55fec77b494ac44dc3e50cd25ea54010755b04f55b0e59af5dc8"} Jun 11 16:39:57.704328 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.704277 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pkbkr" podStartSLOduration=1.7042625550000001 podStartE2EDuration="1.704262555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:57.70261098 +0000 UTC m=+230.522177603" watchObservedRunningTime="2026-06-11 16:39:57.704262555 +0000 UTC m=+230.523829176" Jun 11 16:39:57.817473 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.817448 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:57.961790 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.961697 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-bundle\") pod \"c4525585-6106-4247-812b-7df5db86ba51\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " Jun 11 16:39:57.961790 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.961753 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqk5s\" (UniqueName: \"kubernetes.io/projected/c4525585-6106-4247-812b-7df5db86ba51-kube-api-access-pqk5s\") pod \"c4525585-6106-4247-812b-7df5db86ba51\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " Jun 11 16:39:57.961979 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.961810 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-util\") pod \"c4525585-6106-4247-812b-7df5db86ba51\" (UID: \"c4525585-6106-4247-812b-7df5db86ba51\") " Jun 11 16:39:57.962208 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.962179 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-bundle" (OuterVolumeSpecName: "bundle") pod "c4525585-6106-4247-812b-7df5db86ba51" (UID: "c4525585-6106-4247-812b-7df5db86ba51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:39:57.963905 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.963883 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4525585-6106-4247-812b-7df5db86ba51-kube-api-access-pqk5s" (OuterVolumeSpecName: "kube-api-access-pqk5s") pod "c4525585-6106-4247-812b-7df5db86ba51" (UID: "c4525585-6106-4247-812b-7df5db86ba51"). InnerVolumeSpecName "kube-api-access-pqk5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:39:57.968596 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:57.968570 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-util" (OuterVolumeSpecName: "util") pod "c4525585-6106-4247-812b-7df5db86ba51" (UID: "c4525585-6106-4247-812b-7df5db86ba51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:39:58.062637 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:58.062594 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:39:58.062637 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:58.062621 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4525585-6106-4247-812b-7df5db86ba51-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:39:58.062637 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:58.062631 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqk5s\" (UniqueName: \"kubernetes.io/projected/c4525585-6106-4247-812b-7df5db86ba51-kube-api-access-pqk5s\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:39:58.694467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:58.694436 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" Jun 11 16:39:58.694467 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:58.694457 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxq6kd" event={"ID":"c4525585-6106-4247-812b-7df5db86ba51","Type":"ContainerDied","Data":"66ebd30506ba3ccbff671ed5c768678b97054ff5ad0c35954894f7759a146698"} Jun 11 16:39:58.694924 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:39:58.694495 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66ebd30506ba3ccbff671ed5c768678b97054ff5ad0c35954894f7759a146698" Jun 11 16:40:01.685244 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:01.685208 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5lmb8" Jun 11 16:40:07.282792 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.282754 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h"] Jun 11 16:40:07.283282 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.283168 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4525585-6106-4247-812b-7df5db86ba51" containerName="pull" Jun 11 16:40:07.283282 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.283188 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4525585-6106-4247-812b-7df5db86ba51" containerName="pull" Jun 11 16:40:07.283282 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.283197 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4525585-6106-4247-812b-7df5db86ba51" containerName="extract" Jun 11 16:40:07.283282 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.283203 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4525585-6106-4247-812b-7df5db86ba51" containerName="extract" Jun 11 16:40:07.283282 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.283225 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4525585-6106-4247-812b-7df5db86ba51" containerName="util" Jun 11 16:40:07.283282 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.283235 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4525585-6106-4247-812b-7df5db86ba51" containerName="util" Jun 11 16:40:07.283560 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.283308 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4525585-6106-4247-812b-7df5db86ba51" containerName="extract" Jun 11 16:40:07.323067 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.323016 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h"] Jun 11 16:40:07.323242 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.323088 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.325394 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.325367 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:40:07.326045 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.325992 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:40:07.326045 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.326013 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p4klz\"" Jun 11 16:40:07.333626 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.333599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b90108-142a-45d2-9bbc-2d04cce0892a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4zr8h\" (UID: \"59b90108-142a-45d2-9bbc-2d04cce0892a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.333744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.333647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swlc\" (UniqueName: \"kubernetes.io/projected/59b90108-142a-45d2-9bbc-2d04cce0892a-kube-api-access-9swlc\") pod \"openshift-lws-operator-fd8ccff4c-4zr8h\" (UID: \"59b90108-142a-45d2-9bbc-2d04cce0892a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.434483 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.434447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b90108-142a-45d2-9bbc-2d04cce0892a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4zr8h\" (UID: \"59b90108-142a-45d2-9bbc-2d04cce0892a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.434483 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.434490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swlc\" (UniqueName: \"kubernetes.io/projected/59b90108-142a-45d2-9bbc-2d04cce0892a-kube-api-access-9swlc\") pod \"openshift-lws-operator-fd8ccff4c-4zr8h\" (UID: \"59b90108-142a-45d2-9bbc-2d04cce0892a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.434933 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.434909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b90108-142a-45d2-9bbc-2d04cce0892a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4zr8h\" (UID: \"59b90108-142a-45d2-9bbc-2d04cce0892a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.441875 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.441850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swlc\" (UniqueName: \"kubernetes.io/projected/59b90108-142a-45d2-9bbc-2d04cce0892a-kube-api-access-9swlc\") pod \"openshift-lws-operator-fd8ccff4c-4zr8h\" (UID: \"59b90108-142a-45d2-9bbc-2d04cce0892a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.635716 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.635680 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p4klz\"" Jun 11 16:40:07.644015 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.643987 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" Jun 11 16:40:07.793821 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:07.793781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h"] Jun 11 16:40:07.796882 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:40:07.796849 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59b90108_142a_45d2_9bbc_2d04cce0892a.slice/crio-2f164f0842a252df97ea208dc3832236a67fcbbb0e3c5f88e6b3fd58826510f3 WatchSource:0}: Error finding container 2f164f0842a252df97ea208dc3832236a67fcbbb0e3c5f88e6b3fd58826510f3: Status 404 returned error can't find the container with id 2f164f0842a252df97ea208dc3832236a67fcbbb0e3c5f88e6b3fd58826510f3 Jun 11 16:40:08.739046 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:08.739002 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" event={"ID":"59b90108-142a-45d2-9bbc-2d04cce0892a","Type":"ContainerStarted","Data":"2f164f0842a252df97ea208dc3832236a67fcbbb0e3c5f88e6b3fd58826510f3"} Jun 11 16:40:10.748709 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:10.748673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" event={"ID":"59b90108-142a-45d2-9bbc-2d04cce0892a","Type":"ContainerStarted","Data":"5254b4bd347ef66497bf8f98e10ac0eeab8e321d15c7c8f93dc9f0ace991e44e"} Jun 11 16:40:10.764504 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:10.764445 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4zr8h" podStartSLOduration=1.8674531779999999 podStartE2EDuration="3.764431642s" totalImagesPullingTime="1.896978464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:10.762326159 +0000 UTC m=+243.581892783" watchObservedRunningTime="2026-06-11 16:40:10.764431642 +0000 UTC m=+243.583998263" Jun 11 16:40:13.705866 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.705833 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb"] Jun 11 16:40:13.708184 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.708169 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.709945 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.709919 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lw6j7\"" Jun 11 16:40:13.710056 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.709919 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:40:13.710469 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.710452 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:40:13.715992 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.715971 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb"] Jun 11 16:40:13.788419 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.788375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.788419 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.788421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nkhn\" (UniqueName: \"kubernetes.io/projected/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-kube-api-access-6nkhn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.788688 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.788508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.889243 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.889205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.889401 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.889248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkhn\" (UniqueName: \"kubernetes.io/projected/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-kube-api-access-6nkhn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.889475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.889444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.889729 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.889707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.889814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.889750 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:13.897349 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:13.897326 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nkhn\" (UniqueName: \"kubernetes.io/projected/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-kube-api-access-6nkhn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:14.018106 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:14.018002 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:14.149227 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:14.149186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb"] Jun 11 16:40:14.152107 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:40:14.152071 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81cd9ed0_8916_4a9f_a3c5_e3120e1e7407.slice/crio-317e5135a2e1a51b94752dea15b268e4a345be50013524d21e7a8f5b8d602e51 WatchSource:0}: Error finding container 317e5135a2e1a51b94752dea15b268e4a345be50013524d21e7a8f5b8d602e51: Status 404 returned error can't find the container with id 317e5135a2e1a51b94752dea15b268e4a345be50013524d21e7a8f5b8d602e51 Jun 11 16:40:14.768295 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:14.768259 2565 generic.go:356] "Generic (PLEG): container finished" podID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerID="3ac03f47ccb6bde5ba0b3de5c0319013a56bf47580dedd154671d12d5291ac7e" exitCode=0 Jun 11 16:40:14.768787 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:14.768336 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" event={"ID":"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407","Type":"ContainerDied","Data":"3ac03f47ccb6bde5ba0b3de5c0319013a56bf47580dedd154671d12d5291ac7e"} Jun 11 16:40:14.768787 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:14.768385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" event={"ID":"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407","Type":"ContainerStarted","Data":"317e5135a2e1a51b94752dea15b268e4a345be50013524d21e7a8f5b8d602e51"} Jun 11 16:40:15.773819 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:15.773782 2565 generic.go:356] "Generic (PLEG): container finished" podID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerID="0f46245e7839f313ab255bf0a9c0cad64a5b779fc0abba11a22acb6160360c89" exitCode=0 Jun 11 16:40:15.774287 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:15.773855 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" event={"ID":"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407","Type":"ContainerDied","Data":"0f46245e7839f313ab255bf0a9c0cad64a5b779fc0abba11a22acb6160360c89"} Jun 11 16:40:16.780383 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:16.780348 2565 generic.go:356] "Generic (PLEG): container finished" podID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerID="351eecdbee19bb2fcd197e5169740183bfe3906b5db8bd496a8730397d0c4425" exitCode=0 Jun 11 16:40:16.780799 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:16.780419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" event={"ID":"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407","Type":"ContainerDied","Data":"351eecdbee19bb2fcd197e5169740183bfe3906b5db8bd496a8730397d0c4425"} Jun 11 16:40:17.918681 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:17.918656 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:18.026767 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.026733 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-bundle\") pod \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " Jun 11 16:40:18.026767 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.026776 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-util\") pod \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " Jun 11 16:40:18.026990 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.026809 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nkhn\" (UniqueName: \"kubernetes.io/projected/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-kube-api-access-6nkhn\") pod \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\" (UID: \"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407\") " Jun 11 16:40:18.027490 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.027464 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-bundle" (OuterVolumeSpecName: "bundle") pod "81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" (UID: "81cd9ed0-8916-4a9f-a3c5-e3120e1e7407"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:40:18.028891 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.028866 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-kube-api-access-6nkhn" (OuterVolumeSpecName: "kube-api-access-6nkhn") pod "81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" (UID: "81cd9ed0-8916-4a9f-a3c5-e3120e1e7407"). InnerVolumeSpecName "kube-api-access-6nkhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:40:18.032332 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.032305 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-util" (OuterVolumeSpecName: "util") pod "81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" (UID: "81cd9ed0-8916-4a9f-a3c5-e3120e1e7407"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:40:18.127598 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.127532 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:40:18.127598 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.127593 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nkhn\" (UniqueName: \"kubernetes.io/projected/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-kube-api-access-6nkhn\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:40:18.127598 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.127602 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81cd9ed0-8916-4a9f-a3c5-e3120e1e7407-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:40:18.790133 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.790098 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" event={"ID":"81cd9ed0-8916-4a9f-a3c5-e3120e1e7407","Type":"ContainerDied","Data":"317e5135a2e1a51b94752dea15b268e4a345be50013524d21e7a8f5b8d602e51"} Jun 11 16:40:18.790308 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.790142 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddcxgb" Jun 11 16:40:18.790308 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:18.790143 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="317e5135a2e1a51b94752dea15b268e4a345be50013524d21e7a8f5b8d602e51" Jun 11 16:40:25.762271 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762178 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd"] Jun 11 16:40:25.762873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762589 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerName="pull" Jun 11 16:40:25.762873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762607 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerName="pull" Jun 11 16:40:25.762873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762629 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerName="util" Jun 11 16:40:25.762873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762637 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerName="util" Jun 11 16:40:25.762873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762646 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerName="extract" Jun 11 16:40:25.762873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762654 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerName="extract" Jun 11 16:40:25.762873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.762738 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="81cd9ed0-8916-4a9f-a3c5-e3120e1e7407" containerName="extract" Jun 11 16:40:25.764535 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.764515 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.767273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.767241 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:40:25.767273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.767249 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:40:25.767462 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.767295 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t927w\"" Jun 11 16:40:25.767462 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.767306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:40:25.775729 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.775708 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd"] Jun 11 16:40:25.894606 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.894531 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cbf1598-7489-44d7-9fb5-78bda2123b20-metrics-cert\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.894813 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.894631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbf1598-7489-44d7-9fb5-78bda2123b20-cert\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.894813 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.894679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8cbf1598-7489-44d7-9fb5-78bda2123b20-manager-config\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.894813 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.894719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4xd9\" (UniqueName: \"kubernetes.io/projected/8cbf1598-7489-44d7-9fb5-78bda2123b20-kube-api-access-t4xd9\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.995294 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.995257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbf1598-7489-44d7-9fb5-78bda2123b20-cert\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.995479 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.995312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8cbf1598-7489-44d7-9fb5-78bda2123b20-manager-config\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.995479 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.995334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4xd9\" (UniqueName: \"kubernetes.io/projected/8cbf1598-7489-44d7-9fb5-78bda2123b20-kube-api-access-t4xd9\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.995587 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.995503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cbf1598-7489-44d7-9fb5-78bda2123b20-metrics-cert\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.996066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.996037 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8cbf1598-7489-44d7-9fb5-78bda2123b20-manager-config\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.997805 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.997780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbf1598-7489-44d7-9fb5-78bda2123b20-cert\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:25.997891 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:25.997850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cbf1598-7489-44d7-9fb5-78bda2123b20-metrics-cert\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:26.008049 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.008022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4xd9\" (UniqueName: \"kubernetes.io/projected/8cbf1598-7489-44d7-9fb5-78bda2123b20-kube-api-access-t4xd9\") pod \"lws-controller-manager-555c946c64-t7wbd\" (UID: \"8cbf1598-7489-44d7-9fb5-78bda2123b20\") " pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:26.074741 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.074697 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:26.219408 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.219250 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd"] Jun 11 16:40:26.222207 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:40:26.222179 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbf1598_7489_44d7_9fb5_78bda2123b20.slice/crio-5ef39ed154a3bc7b3afc6789d691337cd4949dee012ed8e4083b06c8f720ecdd WatchSource:0}: Error finding container 5ef39ed154a3bc7b3afc6789d691337cd4949dee012ed8e4083b06c8f720ecdd: Status 404 returned error can't find the container with id 5ef39ed154a3bc7b3afc6789d691337cd4949dee012ed8e4083b06c8f720ecdd Jun 11 16:40:26.285726 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.285693 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs"] Jun 11 16:40:26.288381 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.288364 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.291775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.291746 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:40:26.291900 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.291851 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:40:26.291971 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.291921 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:40:26.291971 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.291930 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z66cl\"" Jun 11 16:40:26.292172 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.292158 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:40:26.309749 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.309717 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs"] Jun 11 16:40:26.399572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.399448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/621b1853-b2ff-4523-b1f5-9661c7df7e45-webhook-cert\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.399572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.399492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/621b1853-b2ff-4523-b1f5-9661c7df7e45-manifests\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.399759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.399591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/621b1853-b2ff-4523-b1f5-9661c7df7e45-tmp\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.399759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.399639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzf2t\" (UniqueName: \"kubernetes.io/projected/621b1853-b2ff-4523-b1f5-9661c7df7e45-kube-api-access-hzf2t\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.399759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.399709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/621b1853-b2ff-4523-b1f5-9661c7df7e45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.501086 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.501049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/621b1853-b2ff-4523-b1f5-9661c7df7e45-tmp\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.501086 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.501092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzf2t\" (UniqueName: \"kubernetes.io/projected/621b1853-b2ff-4523-b1f5-9661c7df7e45-kube-api-access-hzf2t\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.501296 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.501116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/621b1853-b2ff-4523-b1f5-9661c7df7e45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.501296 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.501153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/621b1853-b2ff-4523-b1f5-9661c7df7e45-webhook-cert\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.501296 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.501170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/621b1853-b2ff-4523-b1f5-9661c7df7e45-manifests\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.501559 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.501530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/621b1853-b2ff-4523-b1f5-9661c7df7e45-manifests\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.503415 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.503390 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/621b1853-b2ff-4523-b1f5-9661c7df7e45-tmp\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.503564 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.503493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/621b1853-b2ff-4523-b1f5-9661c7df7e45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.503705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.503686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/621b1853-b2ff-4523-b1f5-9661c7df7e45-webhook-cert\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.516086 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.516054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzf2t\" (UniqueName: \"kubernetes.io/projected/621b1853-b2ff-4523-b1f5-9661c7df7e45-kube-api-access-hzf2t\") pod \"opendatahub-operator-controller-manager-54b9969b5c-jpbqs\" (UID: \"621b1853-b2ff-4523-b1f5-9661c7df7e45\") " pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.598964 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.598926 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:26.757149 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.757116 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs"] Jun 11 16:40:26.759112 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:40:26.759083 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621b1853_b2ff_4523_b1f5_9661c7df7e45.slice/crio-a617d32233a742dac9ef154f1abfc80c8f53b0197aed2a70b831db928908fd00 WatchSource:0}: Error finding container a617d32233a742dac9ef154f1abfc80c8f53b0197aed2a70b831db928908fd00: Status 404 returned error can't find the container with id a617d32233a742dac9ef154f1abfc80c8f53b0197aed2a70b831db928908fd00 Jun 11 16:40:26.825422 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.825387 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" event={"ID":"8cbf1598-7489-44d7-9fb5-78bda2123b20","Type":"ContainerStarted","Data":"5ef39ed154a3bc7b3afc6789d691337cd4949dee012ed8e4083b06c8f720ecdd"} Jun 11 16:40:26.826733 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:26.826709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" event={"ID":"621b1853-b2ff-4523-b1f5-9661c7df7e45","Type":"ContainerStarted","Data":"a617d32233a742dac9ef154f1abfc80c8f53b0197aed2a70b831db928908fd00"} Jun 11 16:40:30.850968 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:30.850928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" event={"ID":"621b1853-b2ff-4523-b1f5-9661c7df7e45","Type":"ContainerStarted","Data":"ae007c8f05ead6d32a0b34b495452000a4bb04766d8ec4cfd1942a0c7cd3cb46"} Jun 11 16:40:31.856737 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:31.856640 2565 generic.go:356] "Generic (PLEG): container finished" podID="621b1853-b2ff-4523-b1f5-9661c7df7e45" containerID="ae007c8f05ead6d32a0b34b495452000a4bb04766d8ec4cfd1942a0c7cd3cb46" exitCode=0 Jun 11 16:40:31.856737 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:31.856729 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" event={"ID":"621b1853-b2ff-4523-b1f5-9661c7df7e45","Type":"ContainerDied","Data":"ae007c8f05ead6d32a0b34b495452000a4bb04766d8ec4cfd1942a0c7cd3cb46"} Jun 11 16:40:31.858402 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:31.858383 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" event={"ID":"8cbf1598-7489-44d7-9fb5-78bda2123b20","Type":"ContainerStarted","Data":"6e6d9ea0241349d3485856766ff1cae807166b595eca3e5d5aa8a1daa681f431"} Jun 11 16:40:31.858539 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:31.858526 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:31.890930 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:31.890872 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" podStartSLOduration=1.559148107 podStartE2EDuration="6.890856265s" totalImagesPullingTime="5.331708158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:31.889533763 +0000 UTC m=+264.709100400" watchObservedRunningTime="2026-06-11 16:40:31.890856265 +0000 UTC m=+264.710422887" Jun 11 16:40:32.865004 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:32.864969 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" event={"ID":"621b1853-b2ff-4523-b1f5-9661c7df7e45","Type":"ContainerStarted","Data":"3cb3743761566af7a5c96921ad0b073845f0f8fcde24de6ce560fc8c8b66dd22"} Jun 11 16:40:32.886541 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:32.886495 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" podStartSLOduration=2.395075689 podStartE2EDuration="6.886478344s" totalImagesPullingTime="3.42922856s" totalInitContainerRuntime="1.062174095s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:32.886155797 +0000 UTC m=+265.705722420" watchObservedRunningTime="2026-06-11 16:40:32.886478344 +0000 UTC m=+265.706044965" Jun 11 16:40:33.869506 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:33.869478 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:42.867421 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:42.867387 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-555c946c64-t7wbd" Jun 11 16:40:44.876068 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:44.876041 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54b9969b5c-jpbqs" Jun 11 16:40:48.871368 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.871326 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl"] Jun 11 16:40:48.877926 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.877904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.880044 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.880021 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:40:48.880871 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.880844 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lw6j7\"" Jun 11 16:40:48.881177 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.881157 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:40:48.883150 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.883127 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl"] Jun 11 16:40:48.892123 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.892092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.892248 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.892229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.892325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.892290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25dcp\" (UniqueName: \"kubernetes.io/projected/f6dada89-354b-432d-87f6-dd5c91ee81b6-kube-api-access-25dcp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.993273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.993240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.993273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.993275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25dcp\" (UniqueName: \"kubernetes.io/projected/f6dada89-354b-432d-87f6-dd5c91ee81b6-kube-api-access-25dcp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.993501 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.993306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.993739 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.993718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:48.993783 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:48.993722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:49.000586 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:49.000534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25dcp\" (UniqueName: \"kubernetes.io/projected/f6dada89-354b-432d-87f6-dd5c91ee81b6-kube-api-access-25dcp\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:49.189213 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:49.189120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:49.336280 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:49.336243 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl"] Jun 11 16:40:49.339895 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:40:49.339850 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6dada89_354b_432d_87f6_dd5c91ee81b6.slice/crio-55a54874b8fedaefcb26e7e082e0521d5b50ed578298d950725ab86a28f0ed1e WatchSource:0}: Error finding container 55a54874b8fedaefcb26e7e082e0521d5b50ed578298d950725ab86a28f0ed1e: Status 404 returned error can't find the container with id 55a54874b8fedaefcb26e7e082e0521d5b50ed578298d950725ab86a28f0ed1e Jun 11 16:40:49.941962 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:49.941923 2565 generic.go:356] "Generic (PLEG): container finished" podID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerID="f01fd763f0b24d23a13256ba2a095237e125268a86914c215895ffa4c64f89d5" exitCode=0 Jun 11 16:40:49.942355 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:49.941998 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" event={"ID":"f6dada89-354b-432d-87f6-dd5c91ee81b6","Type":"ContainerDied","Data":"f01fd763f0b24d23a13256ba2a095237e125268a86914c215895ffa4c64f89d5"} Jun 11 16:40:49.942355 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:49.942044 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" event={"ID":"f6dada89-354b-432d-87f6-dd5c91ee81b6","Type":"ContainerStarted","Data":"55a54874b8fedaefcb26e7e082e0521d5b50ed578298d950725ab86a28f0ed1e"} Jun 11 16:40:50.948563 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:50.948514 2565 generic.go:356] "Generic (PLEG): container finished" podID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerID="829ec26dcc077e17359d5977d03f64010b62676f39531d43bc8369cf2ea02dc7" exitCode=0 Jun 11 16:40:50.948940 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:50.948573 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" event={"ID":"f6dada89-354b-432d-87f6-dd5c91ee81b6","Type":"ContainerDied","Data":"829ec26dcc077e17359d5977d03f64010b62676f39531d43bc8369cf2ea02dc7"} Jun 11 16:40:51.954759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:51.954722 2565 generic.go:356] "Generic (PLEG): container finished" podID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerID="c7d38148ff2a32a29385969acdb0391e43430e15d1e1e6c6ab80e0f89ce1bd2e" exitCode=0 Jun 11 16:40:51.954759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:51.954762 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" event={"ID":"f6dada89-354b-432d-87f6-dd5c91ee81b6","Type":"ContainerDied","Data":"c7d38148ff2a32a29385969acdb0391e43430e15d1e1e6c6ab80e0f89ce1bd2e"} Jun 11 16:40:53.085596 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.085567 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:53.128081 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.128049 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-bundle\") pod \"f6dada89-354b-432d-87f6-dd5c91ee81b6\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " Jun 11 16:40:53.128081 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.128090 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25dcp\" (UniqueName: \"kubernetes.io/projected/f6dada89-354b-432d-87f6-dd5c91ee81b6-kube-api-access-25dcp\") pod \"f6dada89-354b-432d-87f6-dd5c91ee81b6\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " Jun 11 16:40:53.128300 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.128116 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-util\") pod \"f6dada89-354b-432d-87f6-dd5c91ee81b6\" (UID: \"f6dada89-354b-432d-87f6-dd5c91ee81b6\") " Jun 11 16:40:53.129360 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.129324 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-bundle" (OuterVolumeSpecName: "bundle") pod "f6dada89-354b-432d-87f6-dd5c91ee81b6" (UID: "f6dada89-354b-432d-87f6-dd5c91ee81b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:40:53.130180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.130157 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dada89-354b-432d-87f6-dd5c91ee81b6-kube-api-access-25dcp" (OuterVolumeSpecName: "kube-api-access-25dcp") pod "f6dada89-354b-432d-87f6-dd5c91ee81b6" (UID: "f6dada89-354b-432d-87f6-dd5c91ee81b6"). InnerVolumeSpecName "kube-api-access-25dcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:40:53.133995 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.133971 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-util" (OuterVolumeSpecName: "util") pod "f6dada89-354b-432d-87f6-dd5c91ee81b6" (UID: "f6dada89-354b-432d-87f6-dd5c91ee81b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:40:53.229325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.229235 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:40:53.229325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.229263 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25dcp\" (UniqueName: \"kubernetes.io/projected/f6dada89-354b-432d-87f6-dd5c91ee81b6-kube-api-access-25dcp\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:40:53.229325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.229274 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6dada89-354b-432d-87f6-dd5c91ee81b6-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:40:53.966058 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.965982 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" Jun 11 16:40:53.966058 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.966001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06vrwfl" event={"ID":"f6dada89-354b-432d-87f6-dd5c91ee81b6","Type":"ContainerDied","Data":"55a54874b8fedaefcb26e7e082e0521d5b50ed578298d950725ab86a28f0ed1e"} Jun 11 16:40:53.966058 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:40:53.966049 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55a54874b8fedaefcb26e7e082e0521d5b50ed578298d950725ab86a28f0ed1e" Jun 11 16:41:04.011795 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.011754 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn"] Jun 11 16:41:04.012273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.012061 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerName="util" Jun 11 16:41:04.012273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.012076 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerName="util" Jun 11 16:41:04.012273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.012083 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerName="extract" Jun 11 16:41:04.012273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.012088 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerName="extract" Jun 11 16:41:04.012273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.012103 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerName="pull" Jun 11 16:41:04.012273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.012109 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerName="pull" Jun 11 16:41:04.012273 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.012167 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6dada89-354b-432d-87f6-dd5c91ee81b6" containerName="extract" Jun 11 16:41:04.018827 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.018802 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.021179 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.021146 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:41:04.021508 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.021486 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:41:04.021755 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.021488 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lw6j7\"" Jun 11 16:41:04.025204 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.025176 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn"] Jun 11 16:41:04.117776 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.117737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvhp6\" (UniqueName: \"kubernetes.io/projected/04f115f1-e203-4cf3-aea6-f18c061552e6-kube-api-access-hvhp6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.117776 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.117778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.117994 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.117817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.218470 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.218425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvhp6\" (UniqueName: \"kubernetes.io/projected/04f115f1-e203-4cf3-aea6-f18c061552e6-kube-api-access-hvhp6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.218470 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.218473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.218731 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.218514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.218905 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.218884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.218950 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.218920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.226583 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.226561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvhp6\" (UniqueName: \"kubernetes.io/projected/04f115f1-e203-4cf3-aea6-f18c061552e6-kube-api-access-hvhp6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.330075 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.330039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:04.492522 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:04.492480 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn"] Jun 11 16:41:04.495637 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:41:04.495564 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f115f1_e203_4cf3_aea6_f18c061552e6.slice/crio-7c9cfb17e8b76d53fe649e5d4fa534af695d02112dc9c774d45c2c70223c8faa WatchSource:0}: Error finding container 7c9cfb17e8b76d53fe649e5d4fa534af695d02112dc9c774d45c2c70223c8faa: Status 404 returned error can't find the container with id 7c9cfb17e8b76d53fe649e5d4fa534af695d02112dc9c774d45c2c70223c8faa Jun 11 16:41:05.028784 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:05.028697 2565 generic.go:356] "Generic (PLEG): container finished" podID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerID="174d7495ba764ced12dca76fefeb4d20b46beca2a008727dfe1c602a0b77581b" exitCode=0 Jun 11 16:41:05.028784 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:05.028747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" event={"ID":"04f115f1-e203-4cf3-aea6-f18c061552e6","Type":"ContainerDied","Data":"174d7495ba764ced12dca76fefeb4d20b46beca2a008727dfe1c602a0b77581b"} Jun 11 16:41:05.028784 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:05.028781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" event={"ID":"04f115f1-e203-4cf3-aea6-f18c061552e6","Type":"ContainerStarted","Data":"7c9cfb17e8b76d53fe649e5d4fa534af695d02112dc9c774d45c2c70223c8faa"} Jun 11 16:41:06.035105 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.035071 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" event={"ID":"04f115f1-e203-4cf3-aea6-f18c061552e6","Type":"ContainerStarted","Data":"f5e232d00d94d95b06107b9ec34de74e4556386da42cc7716293745c6031a83b"} Jun 11 16:41:06.086154 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.086119 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qfs94"] Jun 11 16:41:06.088195 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.088178 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.090109 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.090084 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 16:41:06.090256 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.090085 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6ndfb\"" Jun 11 16:41:06.090256 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.090092 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 16:41:06.102928 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.102897 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qfs94"] Jun 11 16:41:06.135476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.135448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwzfb\" (UniqueName: \"kubernetes.io/projected/6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f-kube-api-access-qwzfb\") pod \"servicemesh-operator3-57f65f65fb-qfs94\" (UID: \"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.135675 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.135493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qfs94\" (UID: \"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.236589 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.236474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwzfb\" (UniqueName: \"kubernetes.io/projected/6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f-kube-api-access-qwzfb\") pod \"servicemesh-operator3-57f65f65fb-qfs94\" (UID: \"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.236589 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.236521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qfs94\" (UID: \"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.239184 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.239161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qfs94\" (UID: \"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.251799 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.251777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwzfb\" (UniqueName: \"kubernetes.io/projected/6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f-kube-api-access-qwzfb\") pod \"servicemesh-operator3-57f65f65fb-qfs94\" (UID: \"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.397076 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.397039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:06.532537 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:06.532336 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qfs94"] Jun 11 16:41:06.535407 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:41:06.535369 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8c5fc9_991b_4d43_9f7e_662e03ddaf9f.slice/crio-90fe005260df63d9a96259678f990d28852471cbad4f88c097388be4ba3c9881 WatchSource:0}: Error finding container 90fe005260df63d9a96259678f990d28852471cbad4f88c097388be4ba3c9881: Status 404 returned error can't find the container with id 90fe005260df63d9a96259678f990d28852471cbad4f88c097388be4ba3c9881 Jun 11 16:41:07.040775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:07.040744 2565 generic.go:356] "Generic (PLEG): container finished" podID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerID="f5e232d00d94d95b06107b9ec34de74e4556386da42cc7716293745c6031a83b" exitCode=0 Jun 11 16:41:07.041204 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:07.040812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" event={"ID":"04f115f1-e203-4cf3-aea6-f18c061552e6","Type":"ContainerDied","Data":"f5e232d00d94d95b06107b9ec34de74e4556386da42cc7716293745c6031a83b"} Jun 11 16:41:07.042480 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:07.042391 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" event={"ID":"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f","Type":"ContainerStarted","Data":"90fe005260df63d9a96259678f990d28852471cbad4f88c097388be4ba3c9881"} Jun 11 16:41:07.651740 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:07.651711 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:41:07.652470 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:07.652445 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:41:07.656019 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:07.656001 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:41:08.050233 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:08.050141 2565 generic.go:356] "Generic (PLEG): container finished" podID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerID="13b3e1b48dd4a30cf5b66ec88829f2eaf481821f99856ba74a1347666f1ad007" exitCode=0 Jun 11 16:41:08.050233 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:08.050198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" event={"ID":"04f115f1-e203-4cf3-aea6-f18c061552e6","Type":"ContainerDied","Data":"13b3e1b48dd4a30cf5b66ec88829f2eaf481821f99856ba74a1347666f1ad007"} Jun 11 16:41:09.059942 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.059904 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" event={"ID":"6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f","Type":"ContainerStarted","Data":"c168fb6ebf583e9c8ec6de4cee72ac4e223394d87273a9b31d748f68a4c5a760"} Jun 11 16:41:09.060394 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.060279 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:09.082863 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.082802 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" podStartSLOduration=0.755728321 podStartE2EDuration="3.082781194s" totalImagesPullingTime="2.327052873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:09.081753884 +0000 UTC m=+301.901320506" watchObservedRunningTime="2026-06-11 16:41:09.082781194 +0000 UTC m=+301.902347816" Jun 11 16:41:09.210476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.210450 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:09.260774 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.260733 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-util\") pod \"04f115f1-e203-4cf3-aea6-f18c061552e6\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " Jun 11 16:41:09.260954 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.260785 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-bundle\") pod \"04f115f1-e203-4cf3-aea6-f18c061552e6\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " Jun 11 16:41:09.260954 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.260817 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvhp6\" (UniqueName: \"kubernetes.io/projected/04f115f1-e203-4cf3-aea6-f18c061552e6-kube-api-access-hvhp6\") pod \"04f115f1-e203-4cf3-aea6-f18c061552e6\" (UID: \"04f115f1-e203-4cf3-aea6-f18c061552e6\") " Jun 11 16:41:09.261632 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.261597 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-bundle" (OuterVolumeSpecName: "bundle") pod "04f115f1-e203-4cf3-aea6-f18c061552e6" (UID: "04f115f1-e203-4cf3-aea6-f18c061552e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:09.262957 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.262921 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f115f1-e203-4cf3-aea6-f18c061552e6-kube-api-access-hvhp6" (OuterVolumeSpecName: "kube-api-access-hvhp6") pod "04f115f1-e203-4cf3-aea6-f18c061552e6" (UID: "04f115f1-e203-4cf3-aea6-f18c061552e6"). InnerVolumeSpecName "kube-api-access-hvhp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:41:09.265953 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.265931 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-util" (OuterVolumeSpecName: "util") pod "04f115f1-e203-4cf3-aea6-f18c061552e6" (UID: "04f115f1-e203-4cf3-aea6-f18c061552e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:09.361572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.361517 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:09.361572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.361562 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f115f1-e203-4cf3-aea6-f18c061552e6-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:09.361572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:09.361576 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvhp6\" (UniqueName: \"kubernetes.io/projected/04f115f1-e203-4cf3-aea6-f18c061552e6-kube-api-access-hvhp6\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:10.066378 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:10.066340 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" Jun 11 16:41:10.066378 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:10.066362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acstfn" event={"ID":"04f115f1-e203-4cf3-aea6-f18c061552e6","Type":"ContainerDied","Data":"7c9cfb17e8b76d53fe649e5d4fa534af695d02112dc9c774d45c2c70223c8faa"} Jun 11 16:41:10.066931 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:10.066423 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c9cfb17e8b76d53fe649e5d4fa534af695d02112dc9c774d45c2c70223c8faa" Jun 11 16:41:20.068645 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:20.068614 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qfs94" Jun 11 16:41:22.699569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.699518 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7b5dc76f67-lgpcb"] Jun 11 16:41:22.700023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.699960 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerName="pull" Jun 11 16:41:22.700023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.699979 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerName="pull" Jun 11 16:41:22.700023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.699990 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerName="util" Jun 11 16:41:22.700023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.699997 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerName="util" Jun 11 16:41:22.700023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.700020 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerName="extract" Jun 11 16:41:22.700262 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.700029 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerName="extract" Jun 11 16:41:22.700262 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.700114 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f115f1-e203-4cf3-aea6-f18c061552e6" containerName="extract" Jun 11 16:41:22.702671 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.702647 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:22.704830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.704796 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:41:22.705359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.705343 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mdx5k\"" Jun 11 16:41:22.710491 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.710463 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b5dc76f67-lgpcb"] Jun 11 16:41:22.771492 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.771450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8bdcba2c-4af6-440e-925f-b7e2303f03e1-redirect-config\") pod \"dashboard-redirect-7b5dc76f67-lgpcb\" (UID: \"8bdcba2c-4af6-440e-925f-b7e2303f03e1\") " pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:22.771723 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.771604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg7f5\" (UniqueName: \"kubernetes.io/projected/8bdcba2c-4af6-440e-925f-b7e2303f03e1-kube-api-access-tg7f5\") pod \"dashboard-redirect-7b5dc76f67-lgpcb\" (UID: \"8bdcba2c-4af6-440e-925f-b7e2303f03e1\") " pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:22.872809 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.872773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg7f5\" (UniqueName: \"kubernetes.io/projected/8bdcba2c-4af6-440e-925f-b7e2303f03e1-kube-api-access-tg7f5\") pod \"dashboard-redirect-7b5dc76f67-lgpcb\" (UID: \"8bdcba2c-4af6-440e-925f-b7e2303f03e1\") " pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:22.872989 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.872832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8bdcba2c-4af6-440e-925f-b7e2303f03e1-redirect-config\") pod \"dashboard-redirect-7b5dc76f67-lgpcb\" (UID: \"8bdcba2c-4af6-440e-925f-b7e2303f03e1\") " pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:22.873473 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.873455 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8bdcba2c-4af6-440e-925f-b7e2303f03e1-redirect-config\") pod \"dashboard-redirect-7b5dc76f67-lgpcb\" (UID: \"8bdcba2c-4af6-440e-925f-b7e2303f03e1\") " pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:22.882034 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:22.882001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg7f5\" (UniqueName: \"kubernetes.io/projected/8bdcba2c-4af6-440e-925f-b7e2303f03e1-kube-api-access-tg7f5\") pod \"dashboard-redirect-7b5dc76f67-lgpcb\" (UID: \"8bdcba2c-4af6-440e-925f-b7e2303f03e1\") " pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:23.015499 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:23.015402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" Jun 11 16:41:23.143861 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:23.143719 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b5dc76f67-lgpcb"] Jun 11 16:41:23.146415 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:41:23.146390 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdcba2c_4af6_440e_925f_b7e2303f03e1.slice/crio-3c7366f576a4c91bbf55d5ce28ed1e82d4035e67d4406b4616cb9c6cf8fe550c WatchSource:0}: Error finding container 3c7366f576a4c91bbf55d5ce28ed1e82d4035e67d4406b4616cb9c6cf8fe550c: Status 404 returned error can't find the container with id 3c7366f576a4c91bbf55d5ce28ed1e82d4035e67d4406b4616cb9c6cf8fe550c Jun 11 16:41:23.147888 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:23.147869 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:41:24.133719 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:24.133675 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" event={"ID":"8bdcba2c-4af6-440e-925f-b7e2303f03e1","Type":"ContainerStarted","Data":"3c7366f576a4c91bbf55d5ce28ed1e82d4035e67d4406b4616cb9c6cf8fe550c"} Jun 11 16:41:29.163068 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:29.163027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" event={"ID":"8bdcba2c-4af6-440e-925f-b7e2303f03e1","Type":"ContainerStarted","Data":"9e454539d1d4e9b73baa7889d94579702c1bbdb397f1c0c31430a509b1d19b4a"} Jun 11 16:41:29.177411 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:29.177363 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7b5dc76f67-lgpcb" podStartSLOduration=1.985976522 podStartE2EDuration="7.177347923s" totalImagesPullingTime="5.191371401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:29.176829706 +0000 UTC m=+321.996396332" watchObservedRunningTime="2026-06-11 16:41:29.177347923 +0000 UTC m=+321.996914546" Jun 11 16:41:39.699954 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.699914 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k"] Jun 11 16:41:39.730316 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.730282 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k"] Jun 11 16:41:39.730480 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.730405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.732487 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.732454 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:41:39.732677 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.732505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:41:39.732677 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.732523 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:41:39.732677 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.732626 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wtmth\"" Jun 11 16:41:39.773325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.773287 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n"] Jun 11 16:41:39.779696 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.779671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.787584 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.787527 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n"] Jun 11 16:41:39.829264 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.829438 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a864c2a-92ab-49fd-8a45-a0501a633361-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.829438 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxjwz\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-kube-api-access-mxjwz\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.829438 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.829438 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.829438 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c18360-eca1-4ef2-a276-1165d5808d13-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829607 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.829653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.830008 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.830008 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.830008 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.830008 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.829753 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jvwz\" (UniqueName: \"kubernetes.io/projected/f7c18360-eca1-4ef2-a276-1165d5808d13-kube-api-access-4jvwz\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930176 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930176 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c18360-eca1-4ef2-a276-1165d5808d13-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930405 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930434 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930434 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwz\" (UniqueName: \"kubernetes.io/projected/f7c18360-eca1-4ef2-a276-1165d5808d13-kube-api-access-4jvwz\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a864c2a-92ab-49fd-8a45-a0501a633361-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930669 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxjwz\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-kube-api-access-mxjwz\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930695 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.930917 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930822 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.931568 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.930984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.931568 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.931039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.931568 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.931364 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c18360-eca1-4ef2-a276-1165d5808d13-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.931568 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.931399 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.931568 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.931455 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a864c2a-92ab-49fd-8a45-a0501a633361-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.931568 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.931467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.933276 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.933244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.933478 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.933457 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.933578 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.933461 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.933645 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.933577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.938253 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.938227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:39.938582 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.938512 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c18360-eca1-4ef2-a276-1165d5808d13-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.939685 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.939358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jvwz\" (UniqueName: \"kubernetes.io/projected/f7c18360-eca1-4ef2-a276-1165d5808d13-kube-api-access-4jvwz\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mll6n\" (UID: \"f7c18360-eca1-4ef2-a276-1165d5808d13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:39.940252 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:39.940227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxjwz\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-kube-api-access-mxjwz\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:40.040482 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:40.040386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:40.092147 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:40.092103 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:40.195381 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:40.195144 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k"] Jun 11 16:41:40.200160 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:41:40.200128 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a864c2a_92ab_49fd_8a45_a0501a633361.slice/crio-f169cc33387fe982efcd6a2b2f5d2c85d1ce1430c6fbeac22ec21fb583d3e4f2 WatchSource:0}: Error finding container f169cc33387fe982efcd6a2b2f5d2c85d1ce1430c6fbeac22ec21fb583d3e4f2: Status 404 returned error can't find the container with id f169cc33387fe982efcd6a2b2f5d2c85d1ce1430c6fbeac22ec21fb583d3e4f2 Jun 11 16:41:40.224209 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:40.224163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" event={"ID":"8a864c2a-92ab-49fd-8a45-a0501a633361","Type":"ContainerStarted","Data":"f169cc33387fe982efcd6a2b2f5d2c85d1ce1430c6fbeac22ec21fb583d3e4f2"} Jun 11 16:41:40.252698 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:40.252662 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n"] Jun 11 16:41:40.255724 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:41:40.255692 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c18360_eca1_4ef2_a276_1165d5808d13.slice/crio-a4f17ecc2b8699e123e2b2dd1ac28c69da444c22401d21a89d110ecbb0969c76 WatchSource:0}: Error finding container a4f17ecc2b8699e123e2b2dd1ac28c69da444c22401d21a89d110ecbb0969c76: Status 404 returned error can't find the container with id a4f17ecc2b8699e123e2b2dd1ac28c69da444c22401d21a89d110ecbb0969c76 Jun 11 16:41:41.233022 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:41.232981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" event={"ID":"f7c18360-eca1-4ef2-a276-1165d5808d13","Type":"ContainerStarted","Data":"a4f17ecc2b8699e123e2b2dd1ac28c69da444c22401d21a89d110ecbb0969c76"} Jun 11 16:41:42.958161 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:42.958118 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:41:42.958557 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:42.958197 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:41:42.958557 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:42.958226 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:41:42.964737 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:42.964697 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:41:42.964812 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:42.964788 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:41:42.964857 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:42.964831 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:41:43.246413 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:43.246303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" event={"ID":"f7c18360-eca1-4ef2-a276-1165d5808d13","Type":"ContainerStarted","Data":"987e7382e0f36e86a7772e435fb8b8ce675c8631bc88511e98087c5850a5268f"} Jun 11 16:41:43.248005 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:43.247980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" event={"ID":"8a864c2a-92ab-49fd-8a45-a0501a633361","Type":"ContainerStarted","Data":"dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b"} Jun 11 16:41:43.264650 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:43.264576 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" podStartSLOduration=1.5645110519999998 podStartE2EDuration="4.264538376s" totalImagesPullingTime="2.700027324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:43.263650353 +0000 UTC m=+336.083216998" watchObservedRunningTime="2026-06-11 16:41:43.264538376 +0000 UTC m=+336.084105001" Jun 11 16:41:43.283130 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:43.282464 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" podStartSLOduration=1.5210732820000001 podStartE2EDuration="4.282440364s" totalImagesPullingTime="2.761367082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:43.280262095 +0000 UTC m=+336.099828718" watchObservedRunningTime="2026-06-11 16:41:43.282440364 +0000 UTC m=+336.102006989" Jun 11 16:41:44.041293 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.041254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:44.042682 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.042650 2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jun 11 16:41:44.042818 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.042704 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jun 11 16:41:44.092537 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.092505 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:44.097265 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.097242 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:44.252600 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.252568 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:44.253499 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.253482 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mll6n" Jun 11 16:41:44.299409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:44.299327 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k"] Jun 11 16:41:45.041183 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:45.041146 2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jun 11 16:41:45.041368 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:45.041207 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jun 11 16:41:46.041157 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:46.041118 2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jun 11 16:41:46.041345 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:46.041180 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jun 11 16:41:46.262569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:46.262502 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerName="istio-proxy" containerID="cri-o://dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b" gracePeriod=30 Jun 11 16:41:48.161642 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.161601 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hkx6"] Jun 11 16:41:48.164144 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.164118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" Jun 11 16:41:48.166616 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.166541 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:41:48.167045 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.167003 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:41:48.167143 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.167069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rmt9n\"" Jun 11 16:41:48.174283 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.174258 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hkx6"] Jun 11 16:41:48.209523 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.209484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv8fp\" (UniqueName: \"kubernetes.io/projected/0eb9e6ad-0434-43df-a224-581eae41ae0a-kube-api-access-jv8fp\") pod \"kuadrant-operator-catalog-2hkx6\" (UID: \"0eb9e6ad-0434-43df-a224-581eae41ae0a\") " pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" Jun 11 16:41:48.310272 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.310233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv8fp\" (UniqueName: \"kubernetes.io/projected/0eb9e6ad-0434-43df-a224-581eae41ae0a-kube-api-access-jv8fp\") pod \"kuadrant-operator-catalog-2hkx6\" (UID: \"0eb9e6ad-0434-43df-a224-581eae41ae0a\") " pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" Jun 11 16:41:48.317885 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.317854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv8fp\" (UniqueName: \"kubernetes.io/projected/0eb9e6ad-0434-43df-a224-581eae41ae0a-kube-api-access-jv8fp\") pod \"kuadrant-operator-catalog-2hkx6\" (UID: \"0eb9e6ad-0434-43df-a224-581eae41ae0a\") " pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" Jun 11 16:41:48.475995 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.475902 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" Jun 11 16:41:48.533525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.533491 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hkx6"] Jun 11 16:41:48.617950 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.617924 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hkx6"] Jun 11 16:41:48.620283 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:41:48.620248 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb9e6ad_0434_43df_a224_581eae41ae0a.slice/crio-0d89d0ae49119bae3bdbf75b53ab80ea803fc03262af5c828c34c129b4cb564a WatchSource:0}: Error finding container 0d89d0ae49119bae3bdbf75b53ab80ea803fc03262af5c828c34c129b4cb564a: Status 404 returned error can't find the container with id 0d89d0ae49119bae3bdbf75b53ab80ea803fc03262af5c828c34c129b4cb564a Jun 11 16:41:48.738535 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.738438 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7hgw"] Jun 11 16:41:48.741202 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.741178 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:48.748564 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.748517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7hgw"] Jun 11 16:41:48.814448 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.814407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvtn\" (UniqueName: \"kubernetes.io/projected/d91f3b60-260d-4b44-8c33-5e522f368efd-kube-api-access-sjvtn\") pod \"kuadrant-operator-catalog-n7hgw\" (UID: \"d91f3b60-260d-4b44-8c33-5e522f368efd\") " pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:48.915212 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.915176 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvtn\" (UniqueName: \"kubernetes.io/projected/d91f3b60-260d-4b44-8c33-5e522f368efd-kube-api-access-sjvtn\") pod \"kuadrant-operator-catalog-n7hgw\" (UID: \"d91f3b60-260d-4b44-8c33-5e522f368efd\") " pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:48.924118 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:48.924089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvtn\" (UniqueName: \"kubernetes.io/projected/d91f3b60-260d-4b44-8c33-5e522f368efd-kube-api-access-sjvtn\") pod \"kuadrant-operator-catalog-n7hgw\" (UID: \"d91f3b60-260d-4b44-8c33-5e522f368efd\") " pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:49.052626 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:49.052582 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:49.195764 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:49.195738 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7hgw"] Jun 11 16:41:49.216183 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:41:49.216149 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91f3b60_260d_4b44_8c33_5e522f368efd.slice/crio-04e481eccb96cab49d87e408469280b47be1e0919fd2a2824319cebc6f25b601 WatchSource:0}: Error finding container 04e481eccb96cab49d87e408469280b47be1e0919fd2a2824319cebc6f25b601: Status 404 returned error can't find the container with id 04e481eccb96cab49d87e408469280b47be1e0919fd2a2824319cebc6f25b601 Jun 11 16:41:49.277914 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:49.277874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" event={"ID":"0eb9e6ad-0434-43df-a224-581eae41ae0a","Type":"ContainerStarted","Data":"0d89d0ae49119bae3bdbf75b53ab80ea803fc03262af5c828c34c129b4cb564a"} Jun 11 16:41:49.279114 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:49.279081 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" event={"ID":"d91f3b60-260d-4b44-8c33-5e522f368efd","Type":"ContainerStarted","Data":"04e481eccb96cab49d87e408469280b47be1e0919fd2a2824319cebc6f25b601"} Jun 11 16:41:51.291407 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.291353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" event={"ID":"0eb9e6ad-0434-43df-a224-581eae41ae0a","Type":"ContainerStarted","Data":"7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc"} Jun 11 16:41:51.291407 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.291394 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" podUID="0eb9e6ad-0434-43df-a224-581eae41ae0a" containerName="registry-server" containerID="cri-o://7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc" gracePeriod=2 Jun 11 16:41:51.292930 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.292903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" event={"ID":"d91f3b60-260d-4b44-8c33-5e522f368efd","Type":"ContainerStarted","Data":"5db9c81e45a92dcc7a1c6050a0ba248ca6d414c5ffb42b97eccff4d4dc90a56c"} Jun 11 16:41:51.306166 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.306121 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" podStartSLOduration=1.395228758 podStartE2EDuration="3.306106214s" totalImagesPullingTime="1.910877456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:51.30488119 +0000 UTC m=+344.124447812" watchObservedRunningTime="2026-06-11 16:41:51.306106214 +0000 UTC m=+344.125672835" Jun 11 16:41:51.319489 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.319440 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" podStartSLOduration=2.003826503 podStartE2EDuration="3.319424129s" totalImagesPullingTime="1.315597626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:51.318266698 +0000 UTC m=+344.137833346" watchObservedRunningTime="2026-06-11 16:41:51.319424129 +0000 UTC m=+344.138990751" Jun 11 16:41:51.554099 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.554072 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:51.565003 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.564981 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" Jun 11 16:41:51.640067 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640026 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a864c2a-92ab-49fd-8a45-a0501a633361-istiod-ca-cert\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640237 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640109 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-socket\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640237 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640144 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-envoy\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640237 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640169 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv8fp\" (UniqueName: \"kubernetes.io/projected/0eb9e6ad-0434-43df-a224-581eae41ae0a-kube-api-access-jv8fp\") pod \"0eb9e6ad-0434-43df-a224-581eae41ae0a\" (UID: \"0eb9e6ad-0434-43df-a224-581eae41ae0a\") " Jun 11 16:41:51.640237 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640204 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-credential-socket\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640237 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640231 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-data\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640262 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-certs\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640293 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxjwz\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-kube-api-access-mxjwz\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640379 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-podinfo\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640405 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-token\") pod \"8a864c2a-92ab-49fd-8a45-a0501a633361\" (UID: \"8a864c2a-92ab-49fd-8a45-a0501a633361\") " Jun 11 16:41:51.640475 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640405 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:51.640744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640514 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:51.640744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640577 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a864c2a-92ab-49fd-8a45-a0501a633361-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:41:51.640744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640581 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:51.640744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640603 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:51.640744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640734 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a864c2a-92ab-49fd-8a45-a0501a633361-istiod-ca-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.640938 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640753 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-socket\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.640938 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640769 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-credential-socket\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.640938 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640784 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-data\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.640938 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.640797 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-workload-certs\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.642743 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.642713 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:41:51.643002 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.642966 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:41:51.643129 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.643038 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:51.643129 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.643085 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb9e6ad-0434-43df-a224-581eae41ae0a-kube-api-access-jv8fp" (OuterVolumeSpecName: "kube-api-access-jv8fp") pod "0eb9e6ad-0434-43df-a224-581eae41ae0a" (UID: "0eb9e6ad-0434-43df-a224-581eae41ae0a"). InnerVolumeSpecName "kube-api-access-jv8fp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:41:51.643129 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.643093 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-kube-api-access-mxjwz" (OuterVolumeSpecName: "kube-api-access-mxjwz") pod "8a864c2a-92ab-49fd-8a45-a0501a633361" (UID: "8a864c2a-92ab-49fd-8a45-a0501a633361"). InnerVolumeSpecName "kube-api-access-mxjwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:41:51.741701 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.741664 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-envoy\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.741701 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.741697 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv8fp\" (UniqueName: \"kubernetes.io/projected/0eb9e6ad-0434-43df-a224-581eae41ae0a-kube-api-access-jv8fp\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.741701 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.741709 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxjwz\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-kube-api-access-mxjwz\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.741934 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.741718 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-podinfo\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:51.741934 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:51.741727 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a864c2a-92ab-49fd-8a45-a0501a633361-istio-token\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:41:52.298776 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.298740 2565 generic.go:356] "Generic (PLEG): container finished" podID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerID="dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b" exitCode=0 Jun 11 16:41:52.299167 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.298787 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" Jun 11 16:41:52.299167 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.298831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" event={"ID":"8a864c2a-92ab-49fd-8a45-a0501a633361","Type":"ContainerDied","Data":"dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b"} Jun 11 16:41:52.299167 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.298905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k" event={"ID":"8a864c2a-92ab-49fd-8a45-a0501a633361","Type":"ContainerDied","Data":"f169cc33387fe982efcd6a2b2f5d2c85d1ce1430c6fbeac22ec21fb583d3e4f2"} Jun 11 16:41:52.299167 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.298940 2565 scope.go:117] "RemoveContainer" containerID="dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b" Jun 11 16:41:52.300167 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.300148 2565 generic.go:356] "Generic (PLEG): container finished" podID="0eb9e6ad-0434-43df-a224-581eae41ae0a" containerID="7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc" exitCode=0 Jun 11 16:41:52.300236 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.300194 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" Jun 11 16:41:52.300291 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.300230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" event={"ID":"0eb9e6ad-0434-43df-a224-581eae41ae0a","Type":"ContainerDied","Data":"7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc"} Jun 11 16:41:52.300291 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.300282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hkx6" event={"ID":"0eb9e6ad-0434-43df-a224-581eae41ae0a","Type":"ContainerDied","Data":"0d89d0ae49119bae3bdbf75b53ab80ea803fc03262af5c828c34c129b4cb564a"} Jun 11 16:41:52.308187 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.308170 2565 scope.go:117] "RemoveContainer" containerID="dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b" Jun 11 16:41:52.308456 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:41:52.308440 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b\": container with ID starting with dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b not found: ID does not exist" containerID="dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b" Jun 11 16:41:52.308491 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.308466 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b"} err="failed to get container status \"dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b\": rpc error: code = NotFound desc = could not find container \"dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b\": container with ID starting with dd38452ce01b74a3df03f6aac53b41e4a0c12865ec1fa1c370fb7921aac6744b not found: ID does not exist" Jun 11 16:41:52.308491 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.308482 2565 scope.go:117] "RemoveContainer" containerID="7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc" Jun 11 16:41:52.314770 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.314745 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hkx6"] Jun 11 16:41:52.317650 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.317632 2565 scope.go:117] "RemoveContainer" containerID="7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc" Jun 11 16:41:52.317975 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:41:52.317959 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc\": container with ID starting with 7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc not found: ID does not exist" containerID="7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc" Jun 11 16:41:52.318014 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.317984 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc"} err="failed to get container status \"7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc\": rpc error: code = NotFound desc = could not find container \"7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc\": container with ID starting with 7b481b0f93db7f692523cb445b85c5d770837d750628552ff61a5442fd9b6afc not found: ID does not exist" Jun 11 16:41:52.318667 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.318648 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hkx6"] Jun 11 16:41:52.328863 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.328835 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k"] Jun 11 16:41:52.333361 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:52.333328 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fzjn7k"] Jun 11 16:41:53.696599 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:53.696501 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb9e6ad-0434-43df-a224-581eae41ae0a" path="/var/lib/kubelet/pods/0eb9e6ad-0434-43df-a224-581eae41ae0a/volumes" Jun 11 16:41:53.696982 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:53.696963 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" path="/var/lib/kubelet/pods/8a864c2a-92ab-49fd-8a45-a0501a633361/volumes" Jun 11 16:41:59.053813 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:59.053770 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:59.054211 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:59.053881 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:59.076384 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:59.076347 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:41:59.361469 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:41:59.361395 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n7hgw" Jun 11 16:42:03.565509 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.565474 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss"] Jun 11 16:42:03.565909 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.565799 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerName="istio-proxy" Jun 11 16:42:03.565909 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.565810 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerName="istio-proxy" Jun 11 16:42:03.565909 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.565884 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb9e6ad-0434-43df-a224-581eae41ae0a" containerName="registry-server" Jun 11 16:42:03.565909 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.565896 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb9e6ad-0434-43df-a224-581eae41ae0a" containerName="registry-server" Jun 11 16:42:03.566061 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.565981 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb9e6ad-0434-43df-a224-581eae41ae0a" containerName="registry-server" Jun 11 16:42:03.566061 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.565990 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a864c2a-92ab-49fd-8a45-a0501a633361" containerName="istio-proxy" Jun 11 16:42:03.587935 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.587898 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss"] Jun 11 16:42:03.588127 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.588023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.590654 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.590631 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7bfdt\"" Jun 11 16:42:03.649784 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.649740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.649958 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.649833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.649958 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.649858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd9rn\" (UniqueName: \"kubernetes.io/projected/1557467c-080a-479f-abcb-2ff5b9bd7a44-kube-api-access-qd9rn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.751223 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.751182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.751223 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.751222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd9rn\" (UniqueName: \"kubernetes.io/projected/1557467c-080a-479f-abcb-2ff5b9bd7a44-kube-api-access-qd9rn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.751487 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.751387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.751743 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.751721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.751799 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.751738 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.759043 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.759009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd9rn\" (UniqueName: \"kubernetes.io/projected/1557467c-080a-479f-abcb-2ff5b9bd7a44-kube-api-access-qd9rn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.897583 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.897461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:03.972470 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.972438 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7"] Jun 11 16:42:03.977184 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.977158 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:03.983743 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:03.983681 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7"] Jun 11 16:42:04.036595 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.036534 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss"] Jun 11 16:42:04.039008 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:04.038977 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1557467c_080a_479f_abcb_2ff5b9bd7a44.slice/crio-b0b8b6e8ce838776918e7f4c3e013105b0ad2af10d83c8d0a3e5c1cc7f82b027 WatchSource:0}: Error finding container b0b8b6e8ce838776918e7f4c3e013105b0ad2af10d83c8d0a3e5c1cc7f82b027: Status 404 returned error can't find the container with id b0b8b6e8ce838776918e7f4c3e013105b0ad2af10d83c8d0a3e5c1cc7f82b027 Jun 11 16:42:04.053887 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.053856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.054002 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.053895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7r5j\" (UniqueName: \"kubernetes.io/projected/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-kube-api-access-l7r5j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.054002 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.053957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.154772 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.154703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.154772 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.154737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7r5j\" (UniqueName: \"kubernetes.io/projected/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-kube-api-access-l7r5j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.154772 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.154768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.155075 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.155054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.155075 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.155065 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.162609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.162586 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7r5j\" (UniqueName: \"kubernetes.io/projected/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-kube-api-access-l7r5j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.289219 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.289178 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:04.365658 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.365624 2565 generic.go:356] "Generic (PLEG): container finished" podID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerID="0eaa4fda12ec6e1c5f2fd1168e1559110626be52b65220e9adb90c615c9cf83b" exitCode=0 Jun 11 16:42:04.365841 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.365708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" event={"ID":"1557467c-080a-479f-abcb-2ff5b9bd7a44","Type":"ContainerDied","Data":"0eaa4fda12ec6e1c5f2fd1168e1559110626be52b65220e9adb90c615c9cf83b"} Jun 11 16:42:04.365841 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.365768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" event={"ID":"1557467c-080a-479f-abcb-2ff5b9bd7a44","Type":"ContainerStarted","Data":"b0b8b6e8ce838776918e7f4c3e013105b0ad2af10d83c8d0a3e5c1cc7f82b027"} Jun 11 16:42:04.370376 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.370352 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl"] Jun 11 16:42:04.375228 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.375162 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.385905 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.385872 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl"] Jun 11 16:42:04.432440 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.432412 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7"] Jun 11 16:42:04.434152 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:04.434127 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd599946a_1eb8_4bbe_8cb9_d666a0667ab0.slice/crio-00cd71be9d37b707d44a51dc7d7e8d535e81499d52811e66ee4937eebc486be0 WatchSource:0}: Error finding container 00cd71be9d37b707d44a51dc7d7e8d535e81499d52811e66ee4937eebc486be0: Status 404 returned error can't find the container with id 00cd71be9d37b707d44a51dc7d7e8d535e81499d52811e66ee4937eebc486be0 Jun 11 16:42:04.457403 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.457374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.457521 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.457472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hlkh\" (UniqueName: \"kubernetes.io/projected/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-kube-api-access-6hlkh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.457521 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.457515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.558395 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.558361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.558609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.558464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.558609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.558512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hlkh\" (UniqueName: \"kubernetes.io/projected/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-kube-api-access-6hlkh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.558769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.558748 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.558809 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.558779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.566492 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.566467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hlkh\" (UniqueName: \"kubernetes.io/projected/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-kube-api-access-6hlkh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.688986 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.688877 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:04.770936 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.770748 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t"] Jun 11 16:42:04.774986 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.774949 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.783321 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.783288 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t"] Jun 11 16:42:04.833019 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.832985 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl"] Jun 11 16:42:04.835093 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:04.835065 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0fbffd_e71c_4bc4_b6a5_7daa117ccdad.slice/crio-8a99a9915dbdfeb38020db0eb8d36867d685e36d2d7f7522e811ef3f6e283642 WatchSource:0}: Error finding container 8a99a9915dbdfeb38020db0eb8d36867d685e36d2d7f7522e811ef3f6e283642: Status 404 returned error can't find the container with id 8a99a9915dbdfeb38020db0eb8d36867d685e36d2d7f7522e811ef3f6e283642 Jun 11 16:42:04.861834 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.861801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mklf2\" (UniqueName: \"kubernetes.io/projected/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-kube-api-access-mklf2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.861986 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.861855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.861986 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.861923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.962449 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.962420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.962649 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.962616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.962757 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.962731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mklf2\" (UniqueName: \"kubernetes.io/projected/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-kube-api-access-mklf2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.962900 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.962881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.963013 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.962991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:04.970630 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:04.970601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mklf2\" (UniqueName: \"kubernetes.io/projected/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-kube-api-access-mklf2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:05.090529 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.090488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:05.222920 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.222894 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t"] Jun 11 16:42:05.224861 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:05.224835 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c2f43e_8a50_481e_83bd_3c20c09ce0a9.slice/crio-5ec8674898b603ea5a81adbac0187dc653b191f86999f86ba4472506e8434308 WatchSource:0}: Error finding container 5ec8674898b603ea5a81adbac0187dc653b191f86999f86ba4472506e8434308: Status 404 returned error can't find the container with id 5ec8674898b603ea5a81adbac0187dc653b191f86999f86ba4472506e8434308 Jun 11 16:42:05.371987 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.371951 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerID="f0f5bd67321efa12e22f8c582d7901759acf12ecd0d0a9ec82ca791dc85cdb99" exitCode=0 Jun 11 16:42:05.372163 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.372044 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" event={"ID":"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad","Type":"ContainerDied","Data":"f0f5bd67321efa12e22f8c582d7901759acf12ecd0d0a9ec82ca791dc85cdb99"} Jun 11 16:42:05.372163 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.372098 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" event={"ID":"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad","Type":"ContainerStarted","Data":"8a99a9915dbdfeb38020db0eb8d36867d685e36d2d7f7522e811ef3f6e283642"} Jun 11 16:42:05.374070 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.374036 2565 generic.go:356] "Generic (PLEG): container finished" podID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerID="5ba71e07606fb10b887b7e69955aa03d029cdd3ad12be8031bf868e675a83d02" exitCode=0 Jun 11 16:42:05.374199 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.374074 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" event={"ID":"1557467c-080a-479f-abcb-2ff5b9bd7a44","Type":"ContainerDied","Data":"5ba71e07606fb10b887b7e69955aa03d029cdd3ad12be8031bf868e675a83d02"} Jun 11 16:42:05.375854 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.375831 2565 generic.go:356] "Generic (PLEG): container finished" podID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerID="72d8e5f50db934d3b784fc354e18a0172943c1f6800a57e982972e73b553141a" exitCode=0 Jun 11 16:42:05.376101 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.375880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" event={"ID":"d599946a-1eb8-4bbe-8cb9-d666a0667ab0","Type":"ContainerDied","Data":"72d8e5f50db934d3b784fc354e18a0172943c1f6800a57e982972e73b553141a"} Jun 11 16:42:05.376101 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.375928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" event={"ID":"d599946a-1eb8-4bbe-8cb9-d666a0667ab0","Type":"ContainerStarted","Data":"00cd71be9d37b707d44a51dc7d7e8d535e81499d52811e66ee4937eebc486be0"} Jun 11 16:42:05.377524 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.377504 2565 generic.go:356] "Generic (PLEG): container finished" podID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerID="22395bac6466a14fbfbeed79a1085d347cbebde49af1682bad1dc67ddfba2a58" exitCode=0 Jun 11 16:42:05.377634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.377540 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" event={"ID":"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9","Type":"ContainerDied","Data":"22395bac6466a14fbfbeed79a1085d347cbebde49af1682bad1dc67ddfba2a58"} Jun 11 16:42:05.377634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:05.377588 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" event={"ID":"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9","Type":"ContainerStarted","Data":"5ec8674898b603ea5a81adbac0187dc653b191f86999f86ba4472506e8434308"} Jun 11 16:42:06.385041 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.385009 2565 generic.go:356] "Generic (PLEG): container finished" podID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerID="36687bbb9361e8c7f63bd22cc6bafe63976422b202fa251434b16ad697df882d" exitCode=0 Jun 11 16:42:06.385392 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.385097 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" event={"ID":"1557467c-080a-479f-abcb-2ff5b9bd7a44","Type":"ContainerDied","Data":"36687bbb9361e8c7f63bd22cc6bafe63976422b202fa251434b16ad697df882d"} Jun 11 16:42:06.386895 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.386867 2565 generic.go:356] "Generic (PLEG): container finished" podID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerID="560ad0ed6413e3e3b0730f4cf9a2014b670031ba5386dab450689de9544cf9f0" exitCode=0 Jun 11 16:42:06.387001 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.386944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" event={"ID":"d599946a-1eb8-4bbe-8cb9-d666a0667ab0","Type":"ContainerDied","Data":"560ad0ed6413e3e3b0730f4cf9a2014b670031ba5386dab450689de9544cf9f0"} Jun 11 16:42:06.389048 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.389027 2565 generic.go:356] "Generic (PLEG): container finished" podID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerID="505243f2393848667fb72e466ebef549250112955a4b2b89ea4c01e19648ff7d" exitCode=0 Jun 11 16:42:06.389142 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.389105 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" event={"ID":"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9","Type":"ContainerDied","Data":"505243f2393848667fb72e466ebef549250112955a4b2b89ea4c01e19648ff7d"} Jun 11 16:42:06.391053 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.391031 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerID="6d8a683e1b12a3348693a0bd38f6c06fa33ec23505aea7161aff7c2c7fd89f72" exitCode=0 Jun 11 16:42:06.391146 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:06.391066 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" event={"ID":"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad","Type":"ContainerDied","Data":"6d8a683e1b12a3348693a0bd38f6c06fa33ec23505aea7161aff7c2c7fd89f72"} Jun 11 16:42:07.398104 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.398072 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerID="f8f00b33c8fa8e355555069023124da3ab9184b6f5cbb237a1912acd3a7fd15b" exitCode=0 Jun 11 16:42:07.398616 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.398165 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" event={"ID":"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad","Type":"ContainerDied","Data":"f8f00b33c8fa8e355555069023124da3ab9184b6f5cbb237a1912acd3a7fd15b"} Jun 11 16:42:07.400128 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.400104 2565 generic.go:356] "Generic (PLEG): container finished" podID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerID="28a0af9f5aca48e1d42f4ec9ad420229eb087752e97c6b1ba4f8193b7a0ff5f7" exitCode=0 Jun 11 16:42:07.400236 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.400179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" event={"ID":"d599946a-1eb8-4bbe-8cb9-d666a0667ab0","Type":"ContainerDied","Data":"28a0af9f5aca48e1d42f4ec9ad420229eb087752e97c6b1ba4f8193b7a0ff5f7"} Jun 11 16:42:07.402407 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.402378 2565 generic.go:356] "Generic (PLEG): container finished" podID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerID="d0ddddfa235c2f1acf4c1777980858f00f59c5e8fd3378fe97b19a36a00ee36e" exitCode=0 Jun 11 16:42:07.402496 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.402446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" event={"ID":"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9","Type":"ContainerDied","Data":"d0ddddfa235c2f1acf4c1777980858f00f59c5e8fd3378fe97b19a36a00ee36e"} Jun 11 16:42:07.537184 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.537159 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:07.689165 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.689135 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-bundle\") pod \"1557467c-080a-479f-abcb-2ff5b9bd7a44\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " Jun 11 16:42:07.689300 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.689190 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-util\") pod \"1557467c-080a-479f-abcb-2ff5b9bd7a44\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " Jun 11 16:42:07.689300 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.689274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd9rn\" (UniqueName: \"kubernetes.io/projected/1557467c-080a-479f-abcb-2ff5b9bd7a44-kube-api-access-qd9rn\") pod \"1557467c-080a-479f-abcb-2ff5b9bd7a44\" (UID: \"1557467c-080a-479f-abcb-2ff5b9bd7a44\") " Jun 11 16:42:07.689662 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.689634 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-bundle" (OuterVolumeSpecName: "bundle") pod "1557467c-080a-479f-abcb-2ff5b9bd7a44" (UID: "1557467c-080a-479f-abcb-2ff5b9bd7a44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:07.691393 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.691369 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1557467c-080a-479f-abcb-2ff5b9bd7a44-kube-api-access-qd9rn" (OuterVolumeSpecName: "kube-api-access-qd9rn") pod "1557467c-080a-479f-abcb-2ff5b9bd7a44" (UID: "1557467c-080a-479f-abcb-2ff5b9bd7a44"). InnerVolumeSpecName "kube-api-access-qd9rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:07.695533 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.695506 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-util" (OuterVolumeSpecName: "util") pod "1557467c-080a-479f-abcb-2ff5b9bd7a44" (UID: "1557467c-080a-479f-abcb-2ff5b9bd7a44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:07.790862 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.790825 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd9rn\" (UniqueName: \"kubernetes.io/projected/1557467c-080a-479f-abcb-2ff5b9bd7a44-kube-api-access-qd9rn\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:07.790862 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.790855 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:07.790862 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:07.790867 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1557467c-080a-479f-abcb-2ff5b9bd7a44-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.409510 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.409480 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" Jun 11 16:42:08.409510 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.409489 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss" event={"ID":"1557467c-080a-479f-abcb-2ff5b9bd7a44","Type":"ContainerDied","Data":"b0b8b6e8ce838776918e7f4c3e013105b0ad2af10d83c8d0a3e5c1cc7f82b027"} Jun 11 16:42:08.410000 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.409559 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0b8b6e8ce838776918e7f4c3e013105b0ad2af10d83c8d0a3e5c1cc7f82b027" Jun 11 16:42:08.554892 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.554856 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:08.589183 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.589156 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:08.599717 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.599689 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:08.697755 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.697652 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7r5j\" (UniqueName: \"kubernetes.io/projected/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-kube-api-access-l7r5j\") pod \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " Jun 11 16:42:08.697755 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.697745 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mklf2\" (UniqueName: \"kubernetes.io/projected/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-kube-api-access-mklf2\") pod \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " Jun 11 16:42:08.697966 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.697781 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-util\") pod \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " Jun 11 16:42:08.697966 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.697830 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-bundle\") pod \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\" (UID: \"d599946a-1eb8-4bbe-8cb9-d666a0667ab0\") " Jun 11 16:42:08.697966 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.697875 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-bundle\") pod \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " Jun 11 16:42:08.697966 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.697959 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hlkh\" (UniqueName: \"kubernetes.io/projected/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-kube-api-access-6hlkh\") pod \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " Jun 11 16:42:08.698180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.697989 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-util\") pod \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\" (UID: \"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad\") " Jun 11 16:42:08.698180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.698022 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-util\") pod \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " Jun 11 16:42:08.698180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.698061 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-bundle\") pod \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\" (UID: \"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9\") " Jun 11 16:42:08.698583 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.698417 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-bundle" (OuterVolumeSpecName: "bundle") pod "d599946a-1eb8-4bbe-8cb9-d666a0667ab0" (UID: "d599946a-1eb8-4bbe-8cb9-d666a0667ab0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:08.699890 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.698965 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-bundle" (OuterVolumeSpecName: "bundle") pod "c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" (UID: "c3c2f43e-8a50-481e-83bd-3c20c09ce0a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:08.699890 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.699720 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-bundle" (OuterVolumeSpecName: "bundle") pod "2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" (UID: "2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:08.700429 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.700404 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-kube-api-access-l7r5j" (OuterVolumeSpecName: "kube-api-access-l7r5j") pod "d599946a-1eb8-4bbe-8cb9-d666a0667ab0" (UID: "d599946a-1eb8-4bbe-8cb9-d666a0667ab0"). InnerVolumeSpecName "kube-api-access-l7r5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:08.700530 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.700436 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-kube-api-access-mklf2" (OuterVolumeSpecName: "kube-api-access-mklf2") pod "c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" (UID: "c3c2f43e-8a50-481e-83bd-3c20c09ce0a9"). InnerVolumeSpecName "kube-api-access-mklf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:08.700808 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.700782 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-kube-api-access-6hlkh" (OuterVolumeSpecName: "kube-api-access-6hlkh") pod "2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" (UID: "2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad"). InnerVolumeSpecName "kube-api-access-6hlkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:08.707059 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.707028 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-util" (OuterVolumeSpecName: "util") pod "d599946a-1eb8-4bbe-8cb9-d666a0667ab0" (UID: "d599946a-1eb8-4bbe-8cb9-d666a0667ab0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:08.707183 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.707147 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-util" (OuterVolumeSpecName: "util") pod "2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" (UID: "2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:08.708293 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.708268 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-util" (OuterVolumeSpecName: "util") pod "c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" (UID: "c3c2f43e-8a50-481e-83bd-3c20c09ce0a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:08.799443 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799398 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mklf2\" (UniqueName: \"kubernetes.io/projected/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-kube-api-access-mklf2\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799443 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799437 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799443 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799451 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799730 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799465 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799730 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799476 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hlkh\" (UniqueName: \"kubernetes.io/projected/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-kube-api-access-6hlkh\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799730 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799486 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799730 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799499 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799730 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799508 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c2f43e-8a50-481e-83bd-3c20c09ce0a9-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:08.799730 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:08.799518 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7r5j\" (UniqueName: \"kubernetes.io/projected/d599946a-1eb8-4bbe-8cb9-d666a0667ab0-kube-api-access-l7r5j\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:09.417646 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.417617 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" Jun 11 16:42:09.417646 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.417636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t" event={"ID":"c3c2f43e-8a50-481e-83bd-3c20c09ce0a9","Type":"ContainerDied","Data":"5ec8674898b603ea5a81adbac0187dc653b191f86999f86ba4472506e8434308"} Jun 11 16:42:09.418129 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.417686 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ec8674898b603ea5a81adbac0187dc653b191f86999f86ba4472506e8434308" Jun 11 16:42:09.419667 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.419640 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" event={"ID":"2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad","Type":"ContainerDied","Data":"8a99a9915dbdfeb38020db0eb8d36867d685e36d2d7f7522e811ef3f6e283642"} Jun 11 16:42:09.419791 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.419675 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl" Jun 11 16:42:09.419791 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.419687 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a99a9915dbdfeb38020db0eb8d36867d685e36d2d7f7522e811ef3f6e283642" Jun 11 16:42:09.421634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.421605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" event={"ID":"d599946a-1eb8-4bbe-8cb9-d666a0667ab0","Type":"ContainerDied","Data":"00cd71be9d37b707d44a51dc7d7e8d535e81499d52811e66ee4937eebc486be0"} Jun 11 16:42:09.421710 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.421631 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7" Jun 11 16:42:09.421710 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:09.421643 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00cd71be9d37b707d44a51dc7d7e8d535e81499d52811e66ee4937eebc486be0" Jun 11 16:42:14.869054 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869012 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s"] Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869330 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869340 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869355 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869360 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869366 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869372 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869382 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869389 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869394 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869400 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869407 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869411 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869416 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869421 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerName="pull" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869429 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869434 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869441 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869446 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869450 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869455 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869461 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869466 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerName="util" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869477 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869482 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerName="extract" Jun 11 16:42:14.869520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869530 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1557467c-080a-479f-abcb-2ff5b9bd7a44" containerName="extract" Jun 11 16:42:14.870261 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869538 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c2f43e-8a50-481e-83bd-3c20c09ce0a9" containerName="extract" Jun 11 16:42:14.870261 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869564 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d599946a-1eb8-4bbe-8cb9-d666a0667ab0" containerName="extract" Jun 11 16:42:14.870261 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.869573 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad" containerName="extract" Jun 11 16:42:14.876225 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.876200 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" Jun 11 16:42:14.878764 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.878742 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6qqfq\"" Jun 11 16:42:14.884736 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.884711 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s"] Jun 11 16:42:14.955097 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:14.955054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8v8\" (UniqueName: \"kubernetes.io/projected/ec121bea-250b-4cc9-ac80-39e70b25a1e2-kube-api-access-rr8v8\") pod \"authorino-operator-75cc8d5cb7-hmf9s\" (UID: \"ec121bea-250b-4cc9-ac80-39e70b25a1e2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" Jun 11 16:42:15.056488 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:15.056458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8v8\" (UniqueName: \"kubernetes.io/projected/ec121bea-250b-4cc9-ac80-39e70b25a1e2-kube-api-access-rr8v8\") pod \"authorino-operator-75cc8d5cb7-hmf9s\" (UID: \"ec121bea-250b-4cc9-ac80-39e70b25a1e2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" Jun 11 16:42:15.064444 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:15.064415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8v8\" (UniqueName: \"kubernetes.io/projected/ec121bea-250b-4cc9-ac80-39e70b25a1e2-kube-api-access-rr8v8\") pod \"authorino-operator-75cc8d5cb7-hmf9s\" (UID: \"ec121bea-250b-4cc9-ac80-39e70b25a1e2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" Jun 11 16:42:15.187977 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:15.187876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" Jun 11 16:42:15.326788 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:15.326762 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s"] Jun 11 16:42:15.328977 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:15.328946 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec121bea_250b_4cc9_ac80_39e70b25a1e2.slice/crio-e2aab6a5612140f29e671b094705beabe3ba8ba890bc8ecd49019776565ec344 WatchSource:0}: Error finding container e2aab6a5612140f29e671b094705beabe3ba8ba890bc8ecd49019776565ec344: Status 404 returned error can't find the container with id e2aab6a5612140f29e671b094705beabe3ba8ba890bc8ecd49019776565ec344 Jun 11 16:42:15.453236 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:15.453151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" event={"ID":"ec121bea-250b-4cc9-ac80-39e70b25a1e2","Type":"ContainerStarted","Data":"e2aab6a5612140f29e671b094705beabe3ba8ba890bc8ecd49019776565ec344"} Jun 11 16:42:17.468109 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:17.468073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" event={"ID":"ec121bea-250b-4cc9-ac80-39e70b25a1e2","Type":"ContainerStarted","Data":"7d76a8fadd5eb2442371d4ca304887707e4a1d95ae1ac27b965b1a5e7a0dcbef"} Jun 11 16:42:17.468497 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:17.468256 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" Jun 11 16:42:17.484236 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:17.484176 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" podStartSLOduration=1.482094735 podStartE2EDuration="3.484159651s" totalImagesPullingTime="2.002064916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:17.481916009 +0000 UTC m=+370.301482633" watchObservedRunningTime="2026-06-11 16:42:17.484159651 +0000 UTC m=+370.303726273" Jun 11 16:42:28.042709 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.042672 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh"] Jun 11 16:42:28.050028 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.049995 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.052613 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.052590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-22rsl\"" Jun 11 16:42:28.062083 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.062050 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh"] Jun 11 16:42:28.076533 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.076499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxx59\" (UniqueName: \"kubernetes.io/projected/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-kube-api-access-mxx59\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.076710 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.076536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.177174 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.177136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxx59\" (UniqueName: \"kubernetes.io/projected/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-kube-api-access-mxx59\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.177174 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.177176 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.177604 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.177585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.185852 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.185826 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxx59\" (UniqueName: \"kubernetes.io/projected/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-kube-api-access-mxx59\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.360648 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.360606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:28.475732 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.475701 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmf9s" Jun 11 16:42:28.499474 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.499423 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh"] Jun 11 16:42:28.502499 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:28.502464 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abd8ec0_1d58_4e7a_b785_0c82b61f0f0d.slice/crio-97f5143157982acb57644143ddd598105e435d138cd1b9b862e20eb900975cd4 WatchSource:0}: Error finding container 97f5143157982acb57644143ddd598105e435d138cd1b9b862e20eb900975cd4: Status 404 returned error can't find the container with id 97f5143157982acb57644143ddd598105e435d138cd1b9b862e20eb900975cd4 Jun 11 16:42:28.530211 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:28.530181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" event={"ID":"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d","Type":"ContainerStarted","Data":"97f5143157982acb57644143ddd598105e435d138cd1b9b862e20eb900975cd4"} Jun 11 16:42:33.561061 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:33.561022 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" event={"ID":"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d","Type":"ContainerStarted","Data":"96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb"} Jun 11 16:42:33.561520 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:33.561128 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:33.584947 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:33.584890 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" podStartSLOduration=1.266017683 podStartE2EDuration="5.584870418s" totalImagesPullingTime="4.318852735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:33.5829487 +0000 UTC m=+386.402515322" watchObservedRunningTime="2026-06-11 16:42:33.584870418 +0000 UTC m=+386.404437039" Jun 11 16:42:44.569974 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:44.569941 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:45.473308 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.473268 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45"] Jun 11 16:42:45.478323 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.478302 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.493677 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.493648 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45"] Jun 11 16:42:45.528951 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.528909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhhb\" (UniqueName: \"kubernetes.io/projected/018dec6f-8f26-44e9-b5c8-28267c91af61-kube-api-access-blhhb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.529137 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.529014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/018dec6f-8f26-44e9-b5c8-28267c91af61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.630372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.630335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/018dec6f-8f26-44e9-b5c8-28267c91af61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.630875 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.630399 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhhb\" (UniqueName: \"kubernetes.io/projected/018dec6f-8f26-44e9-b5c8-28267c91af61-kube-api-access-blhhb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.630875 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.630830 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/018dec6f-8f26-44e9-b5c8-28267c91af61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.640308 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.640284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhhb\" (UniqueName: \"kubernetes.io/projected/018dec6f-8f26-44e9-b5c8-28267c91af61-kube-api-access-blhhb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.787958 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.787876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:45.939850 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:45.939819 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45"] Jun 11 16:42:45.941703 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:45.941665 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018dec6f_8f26_44e9_b5c8_28267c91af61.slice/crio-27217f84edee90723e38a3c6a5c0ed3be39870c4e5c51ae0e74ee40b392e8951 WatchSource:0}: Error finding container 27217f84edee90723e38a3c6a5c0ed3be39870c4e5c51ae0e74ee40b392e8951: Status 404 returned error can't find the container with id 27217f84edee90723e38a3c6a5c0ed3be39870c4e5c51ae0e74ee40b392e8951 Jun 11 16:42:46.196483 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.196443 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45"] Jun 11 16:42:46.200894 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.200867 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45"] Jun 11 16:42:46.211258 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.211219 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh"] Jun 11 16:42:46.211463 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.211437 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" containerName="manager" containerID="cri-o://96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb" gracePeriod=2 Jun 11 16:42:46.222835 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.222797 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh"] Jun 11 16:42:46.223793 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.223754 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-85dvh\": pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.227231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.226587 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99"] Jun 11 16:42:46.227231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.227063 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" containerName="manager" Jun 11 16:42:46.227231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.227080 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" containerName="manager" Jun 11 16:42:46.227231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.227097 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" containerName="manager" Jun 11 16:42:46.227231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.227105 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" containerName="manager" Jun 11 16:42:46.227231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.227184 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" containerName="manager" Jun 11 16:42:46.227231 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.227198 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" containerName="manager" Jun 11 16:42:46.232722 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.232702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.235812 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.235765 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.239507 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.239477 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq"] Jun 11 16:42:46.242944 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.242912 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99"] Jun 11 16:42:46.243084 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.243052 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.260066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.260033 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq"] Jun 11 16:42:46.265912 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.265872 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.336857 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.336827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76ffz\" (UniqueName: \"kubernetes.io/projected/7f9132e0-94ea-464c-a81b-40ac3718e7b3-kube-api-access-76ffz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpmlq\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.337007 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.336866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317ab1d3-3eab-43af-aeb3-bd00e58cc360-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hkn99\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.337007 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.336938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9132e0-94ea-464c-a81b-40ac3718e7b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpmlq\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.337122 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.337068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctq7b\" (UniqueName: \"kubernetes.io/projected/317ab1d3-3eab-43af-aeb3-bd00e58cc360-kube-api-access-ctq7b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hkn99\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.437794 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.437767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctq7b\" (UniqueName: \"kubernetes.io/projected/317ab1d3-3eab-43af-aeb3-bd00e58cc360-kube-api-access-ctq7b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hkn99\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.437874 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.437814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76ffz\" (UniqueName: \"kubernetes.io/projected/7f9132e0-94ea-464c-a81b-40ac3718e7b3-kube-api-access-76ffz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpmlq\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.437874 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.437839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317ab1d3-3eab-43af-aeb3-bd00e58cc360-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hkn99\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.437874 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.437869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9132e0-94ea-464c-a81b-40ac3718e7b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpmlq\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.438275 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.438254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9132e0-94ea-464c-a81b-40ac3718e7b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpmlq\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.438317 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.438254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317ab1d3-3eab-43af-aeb3-bd00e58cc360-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hkn99\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.445355 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.445331 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.447832 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.447775 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.459359 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.459337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76ffz\" (UniqueName: \"kubernetes.io/projected/7f9132e0-94ea-464c-a81b-40ac3718e7b3-kube-api-access-76ffz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cpmlq\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.459487 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.459432 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctq7b\" (UniqueName: \"kubernetes.io/projected/317ab1d3-3eab-43af-aeb3-bd00e58cc360-kube-api-access-ctq7b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hkn99\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.538408 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.538366 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-extensions-socket-volume\") pod \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " Jun 11 16:42:46.538630 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.538473 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxx59\" (UniqueName: \"kubernetes.io/projected/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-kube-api-access-mxx59\") pod \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\" (UID: \"0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d\") " Jun 11 16:42:46.538984 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.538957 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" (UID: "0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:46.540485 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.540466 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-kube-api-access-mxx59" (OuterVolumeSpecName: "kube-api-access-mxx59") pod "0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" (UID: "0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d"). InnerVolumeSpecName "kube-api-access-mxx59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:46.577812 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.577761 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:46.583935 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.583913 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:46.648252 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.647728 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-extensions-socket-volume\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:46.648252 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.647777 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxx59\" (UniqueName: \"kubernetes.io/projected/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d-kube-api-access-mxx59\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:46.648252 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.648116 2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" container="manager" Jun 11 16:42:46.652198 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.652163 2565 generic.go:356] "Generic (PLEG): container finished" podID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" containerID="96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb" exitCode=0 Jun 11 16:42:46.652325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.652248 2565 scope.go:117] "RemoveContainer" containerID="96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb" Jun 11 16:42:46.652325 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.652263 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.652514 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.652495 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.656110 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.656052 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:46.657987 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.657866 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.659216 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.659184 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:46.670516 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.670486 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:46.672121 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.672096 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:46.673708 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.673688 2565 scope.go:117] "RemoveContainer" containerID="96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb" Jun 11 16:42:46.674013 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:46.673990 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb\": container with ID starting with 96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb not found: ID does not exist" containerID="96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb" Jun 11 16:42:46.674086 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.674026 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb"} err="failed to get container status \"96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb\": rpc error: code = NotFound desc = could not find container \"96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb\": container with ID starting with 96dfdd0eb1c57e3f6d6a799050e886e9131495b8d9df32a6ed519f38b4c3dddb not found: ID does not exist" Jun 11 16:42:46.741123 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.741097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99"] Jun 11 16:42:46.743725 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:46.743696 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317ab1d3_3eab_43af_aeb3_bd00e58cc360.slice/crio-8d17010dc26ed79a77341af3c603d69d34c8d2de4df4fae958456d3ddde340f2 WatchSource:0}: Error finding container 8d17010dc26ed79a77341af3c603d69d34c8d2de4df4fae958456d3ddde340f2: Status 404 returned error can't find the container with id 8d17010dc26ed79a77341af3c603d69d34c8d2de4df4fae958456d3ddde340f2 Jun 11 16:42:46.758707 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:46.758684 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq"] Jun 11 16:42:46.761133 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:46.761108 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9132e0_94ea_464c_a81b_40ac3718e7b3.slice/crio-945909479f3f9282378bad3c5c8677db5733a2f06f89bf55520b20b97fcce8af WatchSource:0}: Error finding container 945909479f3f9282378bad3c5c8677db5733a2f06f89bf55520b20b97fcce8af: Status 404 returned error can't find the container with id 945909479f3f9282378bad3c5c8677db5733a2f06f89bf55520b20b97fcce8af Jun 11 16:42:47.660256 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.660216 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" containerName="manager" containerID="cri-o://8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842" gracePeriod=2 Jun 11 16:42:47.662015 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:47.661986 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:47.662146 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.662013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" event={"ID":"317ab1d3-3eab-43af-aeb3-bd00e58cc360","Type":"ContainerStarted","Data":"23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a"} Jun 11 16:42:47.662146 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.662078 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:47.662146 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.662104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" event={"ID":"317ab1d3-3eab-43af-aeb3-bd00e58cc360","Type":"ContainerStarted","Data":"8d17010dc26ed79a77341af3c603d69d34c8d2de4df4fae958456d3ddde340f2"} Jun 11 16:42:47.663446 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:47.663419 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:47.664688 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.664607 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" event={"ID":"7f9132e0-94ea-464c-a81b-40ac3718e7b3","Type":"ContainerStarted","Data":"03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930"} Jun 11 16:42:47.664688 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.664651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" event={"ID":"7f9132e0-94ea-464c-a81b-40ac3718e7b3","Type":"ContainerStarted","Data":"945909479f3f9282378bad3c5c8677db5733a2f06f89bf55520b20b97fcce8af"} Jun 11 16:42:47.664688 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.664676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:47.664931 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:47.664905 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:47.666370 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:47.666350 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:47.688333 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:47.688286 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:47.688564 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.688511 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" podStartSLOduration=1.6884962510000001 podStartE2EDuration="1.688496251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:47.686414569 +0000 UTC m=+400.505981192" watchObservedRunningTime="2026-06-11 16:42:47.688496251 +0000 UTC m=+400.508062873" Jun 11 16:42:47.689611 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:47.689586 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-85dvh\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85dvh" Jun 11 16:42:47.697211 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.697183 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d" path="/var/lib/kubelet/pods/0abd8ec0-1d58-4e7a-b785-0c82b61f0f0d/volumes" Jun 11 16:42:47.710621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.710574 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" podStartSLOduration=1.710537416 podStartE2EDuration="1.710537416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:47.707773099 +0000 UTC m=+400.527339722" watchObservedRunningTime="2026-06-11 16:42:47.710537416 +0000 UTC m=+400.530104037" Jun 11 16:42:47.908482 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.908458 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:47.910296 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:47.910246 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:47.958604 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.958532 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blhhb\" (UniqueName: \"kubernetes.io/projected/018dec6f-8f26-44e9-b5c8-28267c91af61-kube-api-access-blhhb\") pod \"018dec6f-8f26-44e9-b5c8-28267c91af61\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " Jun 11 16:42:47.958764 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.958658 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/018dec6f-8f26-44e9-b5c8-28267c91af61-extensions-socket-volume\") pod \"018dec6f-8f26-44e9-b5c8-28267c91af61\" (UID: \"018dec6f-8f26-44e9-b5c8-28267c91af61\") " Jun 11 16:42:47.958955 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.958927 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018dec6f-8f26-44e9-b5c8-28267c91af61-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "018dec6f-8f26-44e9-b5c8-28267c91af61" (UID: "018dec6f-8f26-44e9-b5c8-28267c91af61"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:47.960694 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:47.960663 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018dec6f-8f26-44e9-b5c8-28267c91af61-kube-api-access-blhhb" (OuterVolumeSpecName: "kube-api-access-blhhb") pod "018dec6f-8f26-44e9-b5c8-28267c91af61" (UID: "018dec6f-8f26-44e9-b5c8-28267c91af61"). InnerVolumeSpecName "kube-api-access-blhhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:48.059175 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:48.059136 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/018dec6f-8f26-44e9-b5c8-28267c91af61-extensions-socket-volume\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:48.059175 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:48.059170 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blhhb\" (UniqueName: \"kubernetes.io/projected/018dec6f-8f26-44e9-b5c8-28267c91af61-kube-api-access-blhhb\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:48.671574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:48.671516 2565 generic.go:356] "Generic (PLEG): container finished" podID="018dec6f-8f26-44e9-b5c8-28267c91af61" containerID="8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842" exitCode=2 Jun 11 16:42:48.672020 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:48.671584 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:48.672020 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:48.671596 2565 scope.go:117] "RemoveContainer" containerID="8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842" Jun 11 16:42:48.673678 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:48.673648 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:48.682929 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:48.682905 2565 scope.go:117] "RemoveContainer" containerID="8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842" Jun 11 16:42:48.683038 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:48.682984 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pmh45\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pmh45" Jun 11 16:42:48.683441 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:48.683424 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842\": container with ID starting with 8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842 not found: ID does not exist" containerID="8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842" Jun 11 16:42:48.683481 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:48.683449 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842"} err="failed to get container status \"8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842\": rpc error: code = NotFound desc = could not find container \"8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842\": container with ID starting with 8782f81168a1d41bcd2428715befcfb224946b4e11a76a410a04521818290842 not found: ID does not exist" Jun 11 16:42:49.697431 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:49.697396 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018dec6f-8f26-44e9-b5c8-28267c91af61" path="/var/lib/kubelet/pods/018dec6f-8f26-44e9-b5c8-28267c91af61/volumes" Jun 11 16:42:58.674023 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:58.673990 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:58.674390 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:58.674062 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:42:58.747771 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:58.747738 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq"] Jun 11 16:42:58.747978 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:58.747956 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" podUID="7f9132e0-94ea-464c-a81b-40ac3718e7b3" containerName="manager" containerID="cri-o://03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930" gracePeriod=10 Jun 11 16:42:59.015187 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.015164 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:59.063642 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.063512 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4"] Jun 11 16:42:59.063895 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.063881 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f9132e0-94ea-464c-a81b-40ac3718e7b3" containerName="manager" Jun 11 16:42:59.063965 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.063897 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f9132e0-94ea-464c-a81b-40ac3718e7b3" containerName="manager" Jun 11 16:42:59.064004 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.063976 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f9132e0-94ea-464c-a81b-40ac3718e7b3" containerName="manager" Jun 11 16:42:59.066783 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.066763 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.082476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.082445 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4"] Jun 11 16:42:59.162832 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.162796 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76ffz\" (UniqueName: \"kubernetes.io/projected/7f9132e0-94ea-464c-a81b-40ac3718e7b3-kube-api-access-76ffz\") pod \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " Jun 11 16:42:59.162983 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.162882 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9132e0-94ea-464c-a81b-40ac3718e7b3-extensions-socket-volume\") pod \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\" (UID: \"7f9132e0-94ea-464c-a81b-40ac3718e7b3\") " Jun 11 16:42:59.163055 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.163009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h8hk4\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.163097 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.163057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqwcw\" (UniqueName: \"kubernetes.io/projected/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-kube-api-access-qqwcw\") pod \"kuadrant-operator-controller-manager-86878c769f-h8hk4\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.163286 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.163261 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9132e0-94ea-464c-a81b-40ac3718e7b3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7f9132e0-94ea-464c-a81b-40ac3718e7b3" (UID: "7f9132e0-94ea-464c-a81b-40ac3718e7b3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:59.164969 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.164947 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f9132e0-94ea-464c-a81b-40ac3718e7b3-kube-api-access-76ffz" (OuterVolumeSpecName: "kube-api-access-76ffz") pod "7f9132e0-94ea-464c-a81b-40ac3718e7b3" (UID: "7f9132e0-94ea-464c-a81b-40ac3718e7b3"). InnerVolumeSpecName "kube-api-access-76ffz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:59.263531 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.263438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h8hk4\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.263531 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.263501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqwcw\" (UniqueName: \"kubernetes.io/projected/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-kube-api-access-qqwcw\") pod \"kuadrant-operator-controller-manager-86878c769f-h8hk4\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.263737 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.263582 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76ffz\" (UniqueName: \"kubernetes.io/projected/7f9132e0-94ea-464c-a81b-40ac3718e7b3-kube-api-access-76ffz\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:59.263737 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.263600 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f9132e0-94ea-464c-a81b-40ac3718e7b3-extensions-socket-volume\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:42:59.263841 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.263823 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h8hk4\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.276721 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.276691 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqwcw\" (UniqueName: \"kubernetes.io/projected/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-kube-api-access-qqwcw\") pod \"kuadrant-operator-controller-manager-86878c769f-h8hk4\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.379269 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.379228 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.530629 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.530603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4"] Jun 11 16:42:59.532668 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:42:59.532642 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91fa76cc_7f69_4126_8b5a_f310dc1da9ac.slice/crio-7491c626e98efd2f5a6f5749d5d4db33117b5a61c99a683a6088e0c26e0336ad WatchSource:0}: Error finding container 7491c626e98efd2f5a6f5749d5d4db33117b5a61c99a683a6088e0c26e0336ad: Status 404 returned error can't find the container with id 7491c626e98efd2f5a6f5749d5d4db33117b5a61c99a683a6088e0c26e0336ad Jun 11 16:42:59.734572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.734512 2565 generic.go:356] "Generic (PLEG): container finished" podID="7f9132e0-94ea-464c-a81b-40ac3718e7b3" containerID="03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930" exitCode=0 Jun 11 16:42:59.735051 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.734576 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" Jun 11 16:42:59.735051 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.734608 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" event={"ID":"7f9132e0-94ea-464c-a81b-40ac3718e7b3","Type":"ContainerDied","Data":"03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930"} Jun 11 16:42:59.735051 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.734664 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq" event={"ID":"7f9132e0-94ea-464c-a81b-40ac3718e7b3","Type":"ContainerDied","Data":"945909479f3f9282378bad3c5c8677db5733a2f06f89bf55520b20b97fcce8af"} Jun 11 16:42:59.735051 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.734703 2565 scope.go:117] "RemoveContainer" containerID="03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930" Jun 11 16:42:59.736462 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.736437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" event={"ID":"91fa76cc-7f69-4126-8b5a-f310dc1da9ac","Type":"ContainerStarted","Data":"8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9"} Jun 11 16:42:59.736582 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.736486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" event={"ID":"91fa76cc-7f69-4126-8b5a-f310dc1da9ac","Type":"ContainerStarted","Data":"7491c626e98efd2f5a6f5749d5d4db33117b5a61c99a683a6088e0c26e0336ad"} Jun 11 16:42:59.736641 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.736617 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:42:59.743814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.743795 2565 scope.go:117] "RemoveContainer" containerID="03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930" Jun 11 16:42:59.744095 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:42:59.744077 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930\": container with ID starting with 03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930 not found: ID does not exist" containerID="03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930" Jun 11 16:42:59.744160 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.744108 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930"} err="failed to get container status \"03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930\": rpc error: code = NotFound desc = could not find container \"03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930\": container with ID starting with 03c206dd581318ffe5aa0bafea44070219a4c689be620139e821dd4a1b2a8930 not found: ID does not exist" Jun 11 16:42:59.763602 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.763531 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" podStartSLOduration=0.763512001 podStartE2EDuration="763.512001ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:59.760300189 +0000 UTC m=+412.579866835" watchObservedRunningTime="2026-06-11 16:42:59.763512001 +0000 UTC m=+412.583078623" Jun 11 16:42:59.781872 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.781789 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq"] Jun 11 16:42:59.788878 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:42:59.788851 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cpmlq"] Jun 11 16:43:01.697333 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:01.697294 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f9132e0-94ea-464c-a81b-40ac3718e7b3" path="/var/lib/kubelet/pods/7f9132e0-94ea-464c-a81b-40ac3718e7b3/volumes" Jun 11 16:43:10.747035 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:10.746998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 16:43:10.802381 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:10.802343 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99"] Jun 11 16:43:10.802621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:10.802592 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" podUID="317ab1d3-3eab-43af-aeb3-bd00e58cc360" containerName="manager" containerID="cri-o://23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a" gracePeriod=10 Jun 11 16:43:11.077002 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.076976 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:43:11.269175 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.269142 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctq7b\" (UniqueName: \"kubernetes.io/projected/317ab1d3-3eab-43af-aeb3-bd00e58cc360-kube-api-access-ctq7b\") pod \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " Jun 11 16:43:11.269372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.269254 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317ab1d3-3eab-43af-aeb3-bd00e58cc360-extensions-socket-volume\") pod \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\" (UID: \"317ab1d3-3eab-43af-aeb3-bd00e58cc360\") " Jun 11 16:43:11.269690 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.269661 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317ab1d3-3eab-43af-aeb3-bd00e58cc360-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "317ab1d3-3eab-43af-aeb3-bd00e58cc360" (UID: "317ab1d3-3eab-43af-aeb3-bd00e58cc360"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:43:11.271347 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.271313 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317ab1d3-3eab-43af-aeb3-bd00e58cc360-kube-api-access-ctq7b" (OuterVolumeSpecName: "kube-api-access-ctq7b") pod "317ab1d3-3eab-43af-aeb3-bd00e58cc360" (UID: "317ab1d3-3eab-43af-aeb3-bd00e58cc360"). InnerVolumeSpecName "kube-api-access-ctq7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:43:11.370896 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.370804 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317ab1d3-3eab-43af-aeb3-bd00e58cc360-extensions-socket-volume\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:43:11.370896 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.370839 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctq7b\" (UniqueName: \"kubernetes.io/projected/317ab1d3-3eab-43af-aeb3-bd00e58cc360-kube-api-access-ctq7b\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:43:11.813320 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.813287 2565 generic.go:356] "Generic (PLEG): container finished" podID="317ab1d3-3eab-43af-aeb3-bd00e58cc360" containerID="23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a" exitCode=0 Jun 11 16:43:11.813734 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.813331 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" Jun 11 16:43:11.813734 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.813375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" event={"ID":"317ab1d3-3eab-43af-aeb3-bd00e58cc360","Type":"ContainerDied","Data":"23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a"} Jun 11 16:43:11.813734 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.813427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99" event={"ID":"317ab1d3-3eab-43af-aeb3-bd00e58cc360","Type":"ContainerDied","Data":"8d17010dc26ed79a77341af3c603d69d34c8d2de4df4fae958456d3ddde340f2"} Jun 11 16:43:11.813734 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.813450 2565 scope.go:117] "RemoveContainer" containerID="23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a" Jun 11 16:43:11.822372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.822355 2565 scope.go:117] "RemoveContainer" containerID="23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a" Jun 11 16:43:11.822693 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:43:11.822673 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a\": container with ID starting with 23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a not found: ID does not exist" containerID="23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a" Jun 11 16:43:11.822759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.822702 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a"} err="failed to get container status \"23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a\": rpc error: code = NotFound desc = could not find container \"23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a\": container with ID starting with 23434d6a08a1749883eee250b395ef5523a8ce715886e199c47aaa5983bd715a not found: ID does not exist" Jun 11 16:43:11.837063 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.837027 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99"] Jun 11 16:43:11.843363 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:11.843332 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hkn99"] Jun 11 16:43:13.697353 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:13.697305 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="317ab1d3-3eab-43af-aeb3-bd00e58cc360" path="/var/lib/kubelet/pods/317ab1d3-3eab-43af-aeb3-bd00e58cc360/volumes" Jun 11 16:43:15.129931 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.129895 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp"] Jun 11 16:43:15.130572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.130358 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317ab1d3-3eab-43af-aeb3-bd00e58cc360" containerName="manager" Jun 11 16:43:15.130572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.130376 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="317ab1d3-3eab-43af-aeb3-bd00e58cc360" containerName="manager" Jun 11 16:43:15.130572 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.130471 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="317ab1d3-3eab-43af-aeb3-bd00e58cc360" containerName="manager" Jun 11 16:43:15.135443 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.135421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.137303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.137284 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j4zmf\"" Jun 11 16:43:15.144144 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.144118 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp"] Jun 11 16:43:15.198457 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198643 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198643 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198643 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198643 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198843 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198843 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198720 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198843 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.198843 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.198792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdjnn\" (UniqueName: \"kubernetes.io/projected/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-kube-api-access-hdjnn\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299342 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdjnn\" (UniqueName: \"kubernetes.io/projected/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-kube-api-access-hdjnn\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299421 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299889 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.299889 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.300022 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.299990 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.300081 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.300041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.300154 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.300112 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.300343 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.300278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.300606 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.300581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.301913 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.301884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.302223 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.302203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.310183 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.310162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.311498 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.311477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdjnn\" (UniqueName: \"kubernetes.io/projected/f974f8ec-5287-4ae6-841f-4c8505ef6d2b-kube-api-access-hdjnn\") pod \"maas-default-gateway-openshift-default-687ff6996-fd7hp\" (UID: \"f974f8ec-5287-4ae6-841f-4c8505ef6d2b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.448180 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.448085 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:15.597058 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.597026 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp"] Jun 11 16:43:15.598563 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:43:15.598508 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf974f8ec_5287_4ae6_841f_4c8505ef6d2b.slice/crio-35ec754d7431e36c0f1fbc3559e0cdef00a89d374f4f1c7ed63c8ef3a1214c81 WatchSource:0}: Error finding container 35ec754d7431e36c0f1fbc3559e0cdef00a89d374f4f1c7ed63c8ef3a1214c81: Status 404 returned error can't find the container with id 35ec754d7431e36c0f1fbc3559e0cdef00a89d374f4f1c7ed63c8ef3a1214c81 Jun 11 16:43:15.600505 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.600476 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:43:15.600609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.600537 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:43:15.600609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.600583 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:43:15.843619 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.843581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" event={"ID":"f974f8ec-5287-4ae6-841f-4c8505ef6d2b","Type":"ContainerStarted","Data":"e1b028e6cc130310116d27a18539c8763c6e1a9eca5a1a8c47eeb73f22d77a69"} Jun 11 16:43:15.843829 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.843649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" event={"ID":"f974f8ec-5287-4ae6-841f-4c8505ef6d2b","Type":"ContainerStarted","Data":"35ec754d7431e36c0f1fbc3559e0cdef00a89d374f4f1c7ed63c8ef3a1214c81"} Jun 11 16:43:15.864258 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:15.864154 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" podStartSLOduration=0.864131374 podStartE2EDuration="864.131374ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:15.861990505 +0000 UTC m=+428.681557140" watchObservedRunningTime="2026-06-11 16:43:15.864131374 +0000 UTC m=+428.683697997" Jun 11 16:43:16.448664 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:16.448628 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:16.453633 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:16.453603 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:16.849176 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:16.849144 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:16.850083 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:16.850065 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:43:29.833988 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:29.833902 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hcq6m"] Jun 11 16:43:29.837503 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:29.837481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hcq6m" Jun 11 16:43:29.845887 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:29.839706 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hw48p\"" Jun 11 16:43:29.848606 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:29.848580 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hcq6m"] Jun 11 16:43:29.916874 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:29.916840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhcj\" (UniqueName: \"kubernetes.io/projected/436f4e53-f1e8-4d48-b8dc-c2fca8e079e9-kube-api-access-bdhcj\") pod \"authorino-58cd955675-hcq6m\" (UID: \"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9\") " pod="kuadrant-system/authorino-58cd955675-hcq6m" Jun 11 16:43:30.017701 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.017665 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhcj\" (UniqueName: \"kubernetes.io/projected/436f4e53-f1e8-4d48-b8dc-c2fca8e079e9-kube-api-access-bdhcj\") pod \"authorino-58cd955675-hcq6m\" (UID: \"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9\") " pod="kuadrant-system/authorino-58cd955675-hcq6m" Jun 11 16:43:30.025824 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.025793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhcj\" (UniqueName: \"kubernetes.io/projected/436f4e53-f1e8-4d48-b8dc-c2fca8e079e9-kube-api-access-bdhcj\") pod \"authorino-58cd955675-hcq6m\" (UID: \"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9\") " pod="kuadrant-system/authorino-58cd955675-hcq6m" Jun 11 16:43:30.045056 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.045023 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b4wk5"] Jun 11 16:43:30.048418 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.048396 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b4wk5" Jun 11 16:43:30.054728 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.054704 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b4wk5"] Jun 11 16:43:30.118681 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.118596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42tp\" (UniqueName: \"kubernetes.io/projected/f5e0d286-7390-4231-93fb-39ebad11eba7-kube-api-access-r42tp\") pod \"authorino-75d556bd77-b4wk5\" (UID: \"f5e0d286-7390-4231-93fb-39ebad11eba7\") " pod="kuadrant-system/authorino-75d556bd77-b4wk5" Jun 11 16:43:30.154506 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.154467 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hcq6m" Jun 11 16:43:30.220171 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.220029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42tp\" (UniqueName: \"kubernetes.io/projected/f5e0d286-7390-4231-93fb-39ebad11eba7-kube-api-access-r42tp\") pod \"authorino-75d556bd77-b4wk5\" (UID: \"f5e0d286-7390-4231-93fb-39ebad11eba7\") " pod="kuadrant-system/authorino-75d556bd77-b4wk5" Jun 11 16:43:30.228088 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.228035 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42tp\" (UniqueName: \"kubernetes.io/projected/f5e0d286-7390-4231-93fb-39ebad11eba7-kube-api-access-r42tp\") pod \"authorino-75d556bd77-b4wk5\" (UID: \"f5e0d286-7390-4231-93fb-39ebad11eba7\") " pod="kuadrant-system/authorino-75d556bd77-b4wk5" Jun 11 16:43:30.288844 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.288816 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hcq6m"] Jun 11 16:43:30.290884 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:43:30.290852 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod436f4e53_f1e8_4d48_b8dc_c2fca8e079e9.slice/crio-9059e57409ba492c36bbb53a38c2355680c24b0aca89c853d26ec7aa53ce8011 WatchSource:0}: Error finding container 9059e57409ba492c36bbb53a38c2355680c24b0aca89c853d26ec7aa53ce8011: Status 404 returned error can't find the container with id 9059e57409ba492c36bbb53a38c2355680c24b0aca89c853d26ec7aa53ce8011 Jun 11 16:43:30.359451 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.359421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b4wk5" Jun 11 16:43:30.489593 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.489563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b4wk5"] Jun 11 16:43:30.491090 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:43:30.491064 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5e0d286_7390_4231_93fb_39ebad11eba7.slice/crio-7da7a7cb264765e0af79794809537be00ffa2ac8311b301c6d94f1acfdaefa28 WatchSource:0}: Error finding container 7da7a7cb264765e0af79794809537be00ffa2ac8311b301c6d94f1acfdaefa28: Status 404 returned error can't find the container with id 7da7a7cb264765e0af79794809537be00ffa2ac8311b301c6d94f1acfdaefa28 Jun 11 16:43:30.930633 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.930572 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b4wk5" event={"ID":"f5e0d286-7390-4231-93fb-39ebad11eba7","Type":"ContainerStarted","Data":"7da7a7cb264765e0af79794809537be00ffa2ac8311b301c6d94f1acfdaefa28"} Jun 11 16:43:30.932468 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:30.932433 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hcq6m" event={"ID":"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9","Type":"ContainerStarted","Data":"9059e57409ba492c36bbb53a38c2355680c24b0aca89c853d26ec7aa53ce8011"} Jun 11 16:43:33.955100 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:33.954983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hcq6m" event={"ID":"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9","Type":"ContainerStarted","Data":"b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe"} Jun 11 16:43:33.956532 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:33.956506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b4wk5" event={"ID":"f5e0d286-7390-4231-93fb-39ebad11eba7","Type":"ContainerStarted","Data":"597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072"} Jun 11 16:43:33.969340 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:33.969292 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hcq6m" podStartSLOduration=1.598020484 podStartE2EDuration="4.969278008s" totalImagesPullingTime="3.371257524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:33.968637819 +0000 UTC m=+446.788204443" watchObservedRunningTime="2026-06-11 16:43:33.969278008 +0000 UTC m=+446.788844632" Jun 11 16:43:33.982886 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:33.982825 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b4wk5" podStartSLOduration=0.79983098 podStartE2EDuration="3.982809049s" totalImagesPullingTime="3.182978069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:33.982054312 +0000 UTC m=+446.801620934" watchObservedRunningTime="2026-06-11 16:43:33.982809049 +0000 UTC m=+446.802375671" Jun 11 16:43:34.005246 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:34.005208 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hcq6m"] Jun 11 16:43:35.967223 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:35.967178 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hcq6m" podUID="436f4e53-f1e8-4d48-b8dc-c2fca8e079e9" containerName="authorino" containerID="cri-o://b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe" gracePeriod=30 Jun 11 16:43:36.223630 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.223554 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hcq6m" Jun 11 16:43:36.275744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.275707 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdhcj\" (UniqueName: \"kubernetes.io/projected/436f4e53-f1e8-4d48-b8dc-c2fca8e079e9-kube-api-access-bdhcj\") pod \"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9\" (UID: \"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9\") " Jun 11 16:43:36.277862 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.277824 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/436f4e53-f1e8-4d48-b8dc-c2fca8e079e9-kube-api-access-bdhcj" (OuterVolumeSpecName: "kube-api-access-bdhcj") pod "436f4e53-f1e8-4d48-b8dc-c2fca8e079e9" (UID: "436f4e53-f1e8-4d48-b8dc-c2fca8e079e9"). InnerVolumeSpecName "kube-api-access-bdhcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:43:36.377390 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.377355 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdhcj\" (UniqueName: \"kubernetes.io/projected/436f4e53-f1e8-4d48-b8dc-c2fca8e079e9-kube-api-access-bdhcj\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:43:36.973667 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.973618 2565 generic.go:356] "Generic (PLEG): container finished" podID="436f4e53-f1e8-4d48-b8dc-c2fca8e079e9" containerID="b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe" exitCode=0 Jun 11 16:43:36.973667 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.973661 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hcq6m" Jun 11 16:43:36.974154 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.973705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hcq6m" event={"ID":"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9","Type":"ContainerDied","Data":"b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe"} Jun 11 16:43:36.974154 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.973745 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hcq6m" event={"ID":"436f4e53-f1e8-4d48-b8dc-c2fca8e079e9","Type":"ContainerDied","Data":"9059e57409ba492c36bbb53a38c2355680c24b0aca89c853d26ec7aa53ce8011"} Jun 11 16:43:36.974154 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.973761 2565 scope.go:117] "RemoveContainer" containerID="b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe" Jun 11 16:43:36.983516 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.983500 2565 scope.go:117] "RemoveContainer" containerID="b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe" Jun 11 16:43:36.983827 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:43:36.983809 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe\": container with ID starting with b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe not found: ID does not exist" containerID="b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe" Jun 11 16:43:36.983882 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.983837 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe"} err="failed to get container status \"b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe\": rpc error: code = NotFound desc = could not find container \"b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe\": container with ID starting with b57d3f699ba7856d132c5a9aec9bd8fb2ed3f3e87d77f71f082ddb7f17d933fe not found: ID does not exist" Jun 11 16:43:36.994784 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.994758 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hcq6m"] Jun 11 16:43:36.996938 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:36.996917 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hcq6m"] Jun 11 16:43:37.697608 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:37.697571 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="436f4e53-f1e8-4d48-b8dc-c2fca8e079e9" path="/var/lib/kubelet/pods/436f4e53-f1e8-4d48-b8dc-c2fca8e079e9/volumes" Jun 11 16:43:59.207744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.207705 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh"] Jun 11 16:43:59.208227 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.208170 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436f4e53-f1e8-4d48-b8dc-c2fca8e079e9" containerName="authorino" Jun 11 16:43:59.208227 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.208185 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="436f4e53-f1e8-4d48-b8dc-c2fca8e079e9" containerName="authorino" Jun 11 16:43:59.208301 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.208242 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="436f4e53-f1e8-4d48-b8dc-c2fca8e079e9" containerName="authorino" Jun 11 16:43:59.211658 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.211639 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.213707 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.213679 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:43:59.213913 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.213899 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lw6j7\"" Jun 11 16:43:59.214187 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.214170 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:43:59.218845 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.218822 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh"] Jun 11 16:43:59.386797 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.386762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.386797 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.386798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.387066 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.386839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm4lk\" (UniqueName: \"kubernetes.io/projected/2b022aed-656e-4c1c-991d-6d269576c18b-kube-api-access-lm4lk\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.487990 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.487892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.487990 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.487932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.487990 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.487970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm4lk\" (UniqueName: \"kubernetes.io/projected/2b022aed-656e-4c1c-991d-6d269576c18b-kube-api-access-lm4lk\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.488283 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.488263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.488333 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.488289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.498779 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.498752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm4lk\" (UniqueName: \"kubernetes.io/projected/2b022aed-656e-4c1c-991d-6d269576c18b-kube-api-access-lm4lk\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.522710 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.522670 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:43:59.659297 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:43:59.659267 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh"] Jun 11 16:43:59.661062 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:43:59.661037 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b022aed_656e_4c1c_991d_6d269576c18b.slice/crio-3cebedc8f5da9459250299697d4466981e2fd2236d68f4924308196a2d879399 WatchSource:0}: Error finding container 3cebedc8f5da9459250299697d4466981e2fd2236d68f4924308196a2d879399: Status 404 returned error can't find the container with id 3cebedc8f5da9459250299697d4466981e2fd2236d68f4924308196a2d879399 Jun 11 16:44:00.108774 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:00.108737 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b022aed-656e-4c1c-991d-6d269576c18b" containerID="6cc94a12ca3ef3c7a63ea5dc39339bdb35bd0c0dc7774659b4030172aae54b4f" exitCode=0 Jun 11 16:44:00.108974 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:00.108825 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" event={"ID":"2b022aed-656e-4c1c-991d-6d269576c18b","Type":"ContainerDied","Data":"6cc94a12ca3ef3c7a63ea5dc39339bdb35bd0c0dc7774659b4030172aae54b4f"} Jun 11 16:44:00.108974 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:00.108880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" event={"ID":"2b022aed-656e-4c1c-991d-6d269576c18b","Type":"ContainerStarted","Data":"3cebedc8f5da9459250299697d4466981e2fd2236d68f4924308196a2d879399"} Jun 11 16:44:01.116287 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:01.116248 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b022aed-656e-4c1c-991d-6d269576c18b" containerID="9a78d6ebb5708383dd6ce4ab536cdd06bfdea5f0ec15caab5c30b3e7f6cfb393" exitCode=0 Jun 11 16:44:01.116772 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:01.116340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" event={"ID":"2b022aed-656e-4c1c-991d-6d269576c18b","Type":"ContainerDied","Data":"9a78d6ebb5708383dd6ce4ab536cdd06bfdea5f0ec15caab5c30b3e7f6cfb393"} Jun 11 16:44:02.124699 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:02.124662 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b022aed-656e-4c1c-991d-6d269576c18b" containerID="75a4ef0bfc42919250033fb898b57acc732ed2b5d56b272315c38a994d67c07e" exitCode=0 Jun 11 16:44:02.125092 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:02.124722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" event={"ID":"2b022aed-656e-4c1c-991d-6d269576c18b","Type":"ContainerDied","Data":"75a4ef0bfc42919250033fb898b57acc732ed2b5d56b272315c38a994d67c07e"} Jun 11 16:44:03.266202 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.266178 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:44:03.423495 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.423401 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-util\") pod \"2b022aed-656e-4c1c-991d-6d269576c18b\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " Jun 11 16:44:03.423495 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.423449 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-bundle\") pod \"2b022aed-656e-4c1c-991d-6d269576c18b\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " Jun 11 16:44:03.423744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.423534 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm4lk\" (UniqueName: \"kubernetes.io/projected/2b022aed-656e-4c1c-991d-6d269576c18b-kube-api-access-lm4lk\") pod \"2b022aed-656e-4c1c-991d-6d269576c18b\" (UID: \"2b022aed-656e-4c1c-991d-6d269576c18b\") " Jun 11 16:44:03.424028 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.423996 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-bundle" (OuterVolumeSpecName: "bundle") pod "2b022aed-656e-4c1c-991d-6d269576c18b" (UID: "2b022aed-656e-4c1c-991d-6d269576c18b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:44:03.425671 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.425637 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b022aed-656e-4c1c-991d-6d269576c18b-kube-api-access-lm4lk" (OuterVolumeSpecName: "kube-api-access-lm4lk") pod "2b022aed-656e-4c1c-991d-6d269576c18b" (UID: "2b022aed-656e-4c1c-991d-6d269576c18b"). InnerVolumeSpecName "kube-api-access-lm4lk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:03.429441 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.429418 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-util" (OuterVolumeSpecName: "util") pod "2b022aed-656e-4c1c-991d-6d269576c18b" (UID: "2b022aed-656e-4c1c-991d-6d269576c18b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:44:03.524369 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.524326 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm4lk\" (UniqueName: \"kubernetes.io/projected/2b022aed-656e-4c1c-991d-6d269576c18b-kube-api-access-lm4lk\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:44:03.524369 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.524365 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:44:03.524369 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:03.524378 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b022aed-656e-4c1c-991d-6d269576c18b-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:44:04.137433 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:04.137402 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" Jun 11 16:44:04.137433 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:04.137412 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748vnwwh" event={"ID":"2b022aed-656e-4c1c-991d-6d269576c18b","Type":"ContainerDied","Data":"3cebedc8f5da9459250299697d4466981e2fd2236d68f4924308196a2d879399"} Jun 11 16:44:04.137670 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:04.137453 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cebedc8f5da9459250299697d4466981e2fd2236d68f4924308196a2d879399" Jun 11 16:44:21.276057 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276021 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:44:21.276660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276537 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b022aed-656e-4c1c-991d-6d269576c18b" containerName="pull" Jun 11 16:44:21.276660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276577 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b022aed-656e-4c1c-991d-6d269576c18b" containerName="pull" Jun 11 16:44:21.276660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276597 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b022aed-656e-4c1c-991d-6d269576c18b" containerName="extract" Jun 11 16:44:21.276660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276607 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b022aed-656e-4c1c-991d-6d269576c18b" containerName="extract" Jun 11 16:44:21.276660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276617 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b022aed-656e-4c1c-991d-6d269576c18b" containerName="util" Jun 11 16:44:21.276660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276625 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b022aed-656e-4c1c-991d-6d269576c18b" containerName="util" Jun 11 16:44:21.277017 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.276711 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b022aed-656e-4c1c-991d-6d269576c18b" containerName="extract" Jun 11 16:44:21.279808 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.279789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:21.281759 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.281738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:44:21.282271 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.282232 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jdzpc\"" Jun 11 16:44:21.282271 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.282243 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:44:21.282271 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.282248 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:44:21.287961 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.287940 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:44:21.372461 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.372417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktkkl\" (UniqueName: \"kubernetes.io/projected/00b9e364-124e-4c49-bfac-4c76c4041d2c-kube-api-access-ktkkl\") pod \"maas-keycloak-0\" (UID: \"00b9e364-124e-4c49-bfac-4c76c4041d2c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:21.473840 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.473801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktkkl\" (UniqueName: \"kubernetes.io/projected/00b9e364-124e-4c49-bfac-4c76c4041d2c-kube-api-access-ktkkl\") pod \"maas-keycloak-0\" (UID: \"00b9e364-124e-4c49-bfac-4c76c4041d2c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:21.481074 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.481050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktkkl\" (UniqueName: \"kubernetes.io/projected/00b9e364-124e-4c49-bfac-4c76c4041d2c-kube-api-access-ktkkl\") pod \"maas-keycloak-0\" (UID: \"00b9e364-124e-4c49-bfac-4c76c4041d2c\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:21.590413 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.590380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:21.725227 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:21.725202 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:44:21.726720 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:44:21.726685 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b9e364_124e_4c49_bfac_4c76c4041d2c.slice/crio-6a90415b1128ebb873f8b4d6c1004b544b627ed0eb8ad393d277ec00acd39748 WatchSource:0}: Error finding container 6a90415b1128ebb873f8b4d6c1004b544b627ed0eb8ad393d277ec00acd39748: Status 404 returned error can't find the container with id 6a90415b1128ebb873f8b4d6c1004b544b627ed0eb8ad393d277ec00acd39748 Jun 11 16:44:22.237518 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:22.237476 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"00b9e364-124e-4c49-bfac-4c76c4041d2c","Type":"ContainerStarted","Data":"6a90415b1128ebb873f8b4d6c1004b544b627ed0eb8ad393d277ec00acd39748"} Jun 11 16:44:27.273909 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:27.273868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"00b9e364-124e-4c49-bfac-4c76c4041d2c","Type":"ContainerStarted","Data":"b8361edac405f91b68f7201fafd2a1109eab4d60110be12009086493cc8dad81"} Jun 11 16:44:27.292410 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:27.292354 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.473568355 podStartE2EDuration="6.2923353s" totalImagesPullingTime="4.818766945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:27.290760027 +0000 UTC m=+500.110326650" watchObservedRunningTime="2026-06-11 16:44:27.2923353 +0000 UTC m=+500.111901923" Jun 11 16:44:27.590995 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:27.590944 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:27.592874 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:27.592834 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:28.590864 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:28.590813 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:29.591295 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:29.591243 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:30.591914 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:30.591858 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:31.590889 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:31.590847 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:31.591268 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:31.591229 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:32.591845 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:32.591793 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:33.591226 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:33.591167 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:34.591248 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:34.591190 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:35.591480 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:35.591416 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:36.591560 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:36.591488 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:37.590937 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:37.590887 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:38.591457 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:38.591401 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:39.591322 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:39.591278 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jun 11 16:44:40.683653 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:40.683615 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:40.701808 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:40.701761 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:44:50.691003 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:50.690955 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:44:51.543029 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.542990 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mqfrs"] Jun 11 16:44:51.551324 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.551297 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" Jun 11 16:44:51.553746 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.553721 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mqfrs"] Jun 11 16:44:51.570721 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.570691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85k4x\" (UniqueName: \"kubernetes.io/projected/9a228c97-add9-41c7-81b1-8b0c5aa587c1-kube-api-access-85k4x\") pod \"authorino-5d4b67c446-mqfrs\" (UID: \"9a228c97-add9-41c7-81b1-8b0c5aa587c1\") " pod="kuadrant-system/authorino-5d4b67c446-mqfrs" Jun 11 16:44:51.671964 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.671927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85k4x\" (UniqueName: \"kubernetes.io/projected/9a228c97-add9-41c7-81b1-8b0c5aa587c1-kube-api-access-85k4x\") pod \"authorino-5d4b67c446-mqfrs\" (UID: \"9a228c97-add9-41c7-81b1-8b0c5aa587c1\") " pod="kuadrant-system/authorino-5d4b67c446-mqfrs" Jun 11 16:44:51.679019 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.678990 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85k4x\" (UniqueName: \"kubernetes.io/projected/9a228c97-add9-41c7-81b1-8b0c5aa587c1-kube-api-access-85k4x\") pod \"authorino-5d4b67c446-mqfrs\" (UID: \"9a228c97-add9-41c7-81b1-8b0c5aa587c1\") " pod="kuadrant-system/authorino-5d4b67c446-mqfrs" Jun 11 16:44:51.783831 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.783801 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mqfrs"] Jun 11 16:44:51.784198 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.784055 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" Jun 11 16:44:51.805116 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.805077 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bc75f9f64-zqq48"] Jun 11 16:44:51.812025 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.811990 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" Jun 11 16:44:51.818850 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.818812 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bc75f9f64-zqq48"] Jun 11 16:44:51.872873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.872833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwwvj\" (UniqueName: \"kubernetes.io/projected/7bc96228-a455-4aff-a349-1019495c752f-kube-api-access-xwwvj\") pod \"authorino-7bc75f9f64-zqq48\" (UID: \"7bc96228-a455-4aff-a349-1019495c752f\") " pod="kuadrant-system/authorino-7bc75f9f64-zqq48" Jun 11 16:44:51.929162 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.929130 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mqfrs"] Jun 11 16:44:51.931728 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:44:51.931700 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a228c97_add9_41c7_81b1_8b0c5aa587c1.slice/crio-97d1565e12c9cb0c86a2dc86d05838d69c0d874e461ee2c8f40f8b827f9c339b WatchSource:0}: Error finding container 97d1565e12c9cb0c86a2dc86d05838d69c0d874e461ee2c8f40f8b827f9c339b: Status 404 returned error can't find the container with id 97d1565e12c9cb0c86a2dc86d05838d69c0d874e461ee2c8f40f8b827f9c339b Jun 11 16:44:51.973562 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.973513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwwvj\" (UniqueName: \"kubernetes.io/projected/7bc96228-a455-4aff-a349-1019495c752f-kube-api-access-xwwvj\") pod \"authorino-7bc75f9f64-zqq48\" (UID: \"7bc96228-a455-4aff-a349-1019495c752f\") " pod="kuadrant-system/authorino-7bc75f9f64-zqq48" Jun 11 16:44:51.981086 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:51.981057 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwwvj\" (UniqueName: \"kubernetes.io/projected/7bc96228-a455-4aff-a349-1019495c752f-kube-api-access-xwwvj\") pod \"authorino-7bc75f9f64-zqq48\" (UID: \"7bc96228-a455-4aff-a349-1019495c752f\") " pod="kuadrant-system/authorino-7bc75f9f64-zqq48" Jun 11 16:44:52.069215 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.069174 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bc75f9f64-zqq48"] Jun 11 16:44:52.069454 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.069442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" Jun 11 16:44:52.098476 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.098434 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b7fb99d76-gw64m"] Jun 11 16:44:52.102687 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.102643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.105132 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.105110 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 16:44:52.111225 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.111130 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b7fb99d76-gw64m"] Jun 11 16:44:52.175347 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.175316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7pk4\" (UniqueName: \"kubernetes.io/projected/616f560f-5aec-46e0-91c3-433c629f2419-kube-api-access-q7pk4\") pod \"authorino-7b7fb99d76-gw64m\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.175509 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.175364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/616f560f-5aec-46e0-91c3-433c629f2419-tls-cert\") pod \"authorino-7b7fb99d76-gw64m\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.208675 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.208648 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bc75f9f64-zqq48"] Jun 11 16:44:52.210533 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:44:52.210506 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bc96228_a455_4aff_a349_1019495c752f.slice/crio-b9ea326256b3d1f71cf5c670806ea0628b6dc63e5517fb9c52ed2e7f5ec8f036 WatchSource:0}: Error finding container b9ea326256b3d1f71cf5c670806ea0628b6dc63e5517fb9c52ed2e7f5ec8f036: Status 404 returned error can't find the container with id b9ea326256b3d1f71cf5c670806ea0628b6dc63e5517fb9c52ed2e7f5ec8f036 Jun 11 16:44:52.276654 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.276614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7pk4\" (UniqueName: \"kubernetes.io/projected/616f560f-5aec-46e0-91c3-433c629f2419-kube-api-access-q7pk4\") pod \"authorino-7b7fb99d76-gw64m\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.276846 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.276688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/616f560f-5aec-46e0-91c3-433c629f2419-tls-cert\") pod \"authorino-7b7fb99d76-gw64m\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.279101 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.279077 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/616f560f-5aec-46e0-91c3-433c629f2419-tls-cert\") pod \"authorino-7b7fb99d76-gw64m\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.283803 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.283780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7pk4\" (UniqueName: \"kubernetes.io/projected/616f560f-5aec-46e0-91c3-433c629f2419-kube-api-access-q7pk4\") pod \"authorino-7b7fb99d76-gw64m\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.414608 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.414539 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:44:52.457726 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.457687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" event={"ID":"7bc96228-a455-4aff-a349-1019495c752f","Type":"ContainerStarted","Data":"b9ea326256b3d1f71cf5c670806ea0628b6dc63e5517fb9c52ed2e7f5ec8f036"} Jun 11 16:44:52.459593 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.459567 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" event={"ID":"9a228c97-add9-41c7-81b1-8b0c5aa587c1","Type":"ContainerStarted","Data":"e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e"} Jun 11 16:44:52.459712 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.459601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" event={"ID":"9a228c97-add9-41c7-81b1-8b0c5aa587c1","Type":"ContainerStarted","Data":"97d1565e12c9cb0c86a2dc86d05838d69c0d874e461ee2c8f40f8b827f9c339b"} Jun 11 16:44:52.459712 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.459620 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" podUID="9a228c97-add9-41c7-81b1-8b0c5aa587c1" containerName="authorino" containerID="cri-o://e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e" gracePeriod=30 Jun 11 16:44:52.476807 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.476088 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" podStartSLOduration=1.1245183970000001 podStartE2EDuration="1.476066289s" totalImagesPullingTime="351.547892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:52.475392897 +0000 UTC m=+525.294959519" watchObservedRunningTime="2026-06-11 16:44:52.476066289 +0000 UTC m=+525.295632912" Jun 11 16:44:52.557958 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.557922 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b7fb99d76-gw64m"] Jun 11 16:44:52.559599 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:44:52.559571 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod616f560f_5aec_46e0_91c3_433c629f2419.slice/crio-e3f1587572f10d9f9201874a843662fc76e58436feb80e6501cdf001c9187df2 WatchSource:0}: Error finding container e3f1587572f10d9f9201874a843662fc76e58436feb80e6501cdf001c9187df2: Status 404 returned error can't find the container with id e3f1587572f10d9f9201874a843662fc76e58436feb80e6501cdf001c9187df2 Jun 11 16:44:52.741912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.741890 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" Jun 11 16:44:52.780613 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.780577 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85k4x\" (UniqueName: \"kubernetes.io/projected/9a228c97-add9-41c7-81b1-8b0c5aa587c1-kube-api-access-85k4x\") pod \"9a228c97-add9-41c7-81b1-8b0c5aa587c1\" (UID: \"9a228c97-add9-41c7-81b1-8b0c5aa587c1\") " Jun 11 16:44:52.782606 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.782577 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a228c97-add9-41c7-81b1-8b0c5aa587c1-kube-api-access-85k4x" (OuterVolumeSpecName: "kube-api-access-85k4x") pod "9a228c97-add9-41c7-81b1-8b0c5aa587c1" (UID: "9a228c97-add9-41c7-81b1-8b0c5aa587c1"). InnerVolumeSpecName "kube-api-access-85k4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:52.882139 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:52.882029 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85k4x\" (UniqueName: \"kubernetes.io/projected/9a228c97-add9-41c7-81b1-8b0c5aa587c1-kube-api-access-85k4x\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:44:53.466776 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.466743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" event={"ID":"616f560f-5aec-46e0-91c3-433c629f2419","Type":"ContainerStarted","Data":"014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3"} Jun 11 16:44:53.466776 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.466784 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" event={"ID":"616f560f-5aec-46e0-91c3-433c629f2419","Type":"ContainerStarted","Data":"e3f1587572f10d9f9201874a843662fc76e58436feb80e6501cdf001c9187df2"} Jun 11 16:44:53.468401 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.468369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" event={"ID":"7bc96228-a455-4aff-a349-1019495c752f","Type":"ContainerStarted","Data":"05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f"} Jun 11 16:44:53.468574 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.468377 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" podUID="7bc96228-a455-4aff-a349-1019495c752f" containerName="authorino" containerID="cri-o://05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f" gracePeriod=30 Jun 11 16:44:53.469751 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.469724 2565 generic.go:356] "Generic (PLEG): container finished" podID="9a228c97-add9-41c7-81b1-8b0c5aa587c1" containerID="e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e" exitCode=0 Jun 11 16:44:53.469854 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.469754 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" Jun 11 16:44:53.469854 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.469802 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" event={"ID":"9a228c97-add9-41c7-81b1-8b0c5aa587c1","Type":"ContainerDied","Data":"e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e"} Jun 11 16:44:53.469854 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.469841 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mqfrs" event={"ID":"9a228c97-add9-41c7-81b1-8b0c5aa587c1","Type":"ContainerDied","Data":"97d1565e12c9cb0c86a2dc86d05838d69c0d874e461ee2c8f40f8b827f9c339b"} Jun 11 16:44:53.470016 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.469860 2565 scope.go:117] "RemoveContainer" containerID="e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e" Jun 11 16:44:53.480674 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.480539 2565 scope.go:117] "RemoveContainer" containerID="e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e" Jun 11 16:44:53.480931 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:44:53.480911 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e\": container with ID starting with e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e not found: ID does not exist" containerID="e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e" Jun 11 16:44:53.480990 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.480941 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e"} err="failed to get container status \"e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e\": rpc error: code = NotFound desc = could not find container \"e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e\": container with ID starting with e53a8a4041c6a4e48c9ef944e4e1db44b213c9679ee023ec0ac9596acb17d53e not found: ID does not exist" Jun 11 16:44:53.482169 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.482126 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" podStartSLOduration=1.03526436 podStartE2EDuration="1.4821121s" totalImagesPullingTime="446.84774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:53.47991766 +0000 UTC m=+526.299484282" watchObservedRunningTime="2026-06-11 16:44:53.4821121 +0000 UTC m=+526.301678764" Jun 11 16:44:53.494938 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.494879 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" podStartSLOduration=2.173445658 podStartE2EDuration="2.494861834s" totalImagesPullingTime="321.416176ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:53.492601677 +0000 UTC m=+526.312168300" watchObservedRunningTime="2026-06-11 16:44:53.494861834 +0000 UTC m=+526.314428459" Jun 11 16:44:53.510218 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.510189 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b4wk5"] Jun 11 16:44:53.510413 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.510390 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b4wk5" podUID="f5e0d286-7390-4231-93fb-39ebad11eba7" containerName="authorino" containerID="cri-o://597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072" gracePeriod=30 Jun 11 16:44:53.539783 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.539747 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mqfrs"] Jun 11 16:44:53.543401 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.543374 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mqfrs"] Jun 11 16:44:53.698740 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.698703 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a228c97-add9-41c7-81b1-8b0c5aa587c1" path="/var/lib/kubelet/pods/9a228c97-add9-41c7-81b1-8b0c5aa587c1/volumes" Jun 11 16:44:53.785708 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.785682 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" Jun 11 16:44:53.788816 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.788794 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b4wk5" Jun 11 16:44:53.891207 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.891170 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r42tp\" (UniqueName: \"kubernetes.io/projected/f5e0d286-7390-4231-93fb-39ebad11eba7-kube-api-access-r42tp\") pod \"f5e0d286-7390-4231-93fb-39ebad11eba7\" (UID: \"f5e0d286-7390-4231-93fb-39ebad11eba7\") " Jun 11 16:44:53.891666 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.891234 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwwvj\" (UniqueName: \"kubernetes.io/projected/7bc96228-a455-4aff-a349-1019495c752f-kube-api-access-xwwvj\") pod \"7bc96228-a455-4aff-a349-1019495c752f\" (UID: \"7bc96228-a455-4aff-a349-1019495c752f\") " Jun 11 16:44:53.893333 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.893299 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e0d286-7390-4231-93fb-39ebad11eba7-kube-api-access-r42tp" (OuterVolumeSpecName: "kube-api-access-r42tp") pod "f5e0d286-7390-4231-93fb-39ebad11eba7" (UID: "f5e0d286-7390-4231-93fb-39ebad11eba7"). InnerVolumeSpecName "kube-api-access-r42tp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:53.893333 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.893307 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc96228-a455-4aff-a349-1019495c752f-kube-api-access-xwwvj" (OuterVolumeSpecName: "kube-api-access-xwwvj") pod "7bc96228-a455-4aff-a349-1019495c752f" (UID: "7bc96228-a455-4aff-a349-1019495c752f"). InnerVolumeSpecName "kube-api-access-xwwvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:53.993049 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.993007 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwwvj\" (UniqueName: \"kubernetes.io/projected/7bc96228-a455-4aff-a349-1019495c752f-kube-api-access-xwwvj\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:44:53.993049 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:53.993049 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r42tp\" (UniqueName: \"kubernetes.io/projected/f5e0d286-7390-4231-93fb-39ebad11eba7-kube-api-access-r42tp\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:44:54.477739 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.477704 2565 generic.go:356] "Generic (PLEG): container finished" podID="f5e0d286-7390-4231-93fb-39ebad11eba7" containerID="597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072" exitCode=0 Jun 11 16:44:54.477918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.477752 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b4wk5" Jun 11 16:44:54.477918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.477799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b4wk5" event={"ID":"f5e0d286-7390-4231-93fb-39ebad11eba7","Type":"ContainerDied","Data":"597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072"} Jun 11 16:44:54.477918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.477845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b4wk5" event={"ID":"f5e0d286-7390-4231-93fb-39ebad11eba7","Type":"ContainerDied","Data":"7da7a7cb264765e0af79794809537be00ffa2ac8311b301c6d94f1acfdaefa28"} Jun 11 16:44:54.477918 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.477870 2565 scope.go:117] "RemoveContainer" containerID="597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072" Jun 11 16:44:54.479185 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.479096 2565 generic.go:356] "Generic (PLEG): container finished" podID="7bc96228-a455-4aff-a349-1019495c752f" containerID="05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f" exitCode=0 Jun 11 16:44:54.479185 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.479159 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" Jun 11 16:44:54.479320 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.479183 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" event={"ID":"7bc96228-a455-4aff-a349-1019495c752f","Type":"ContainerDied","Data":"05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f"} Jun 11 16:44:54.479320 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.479220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bc75f9f64-zqq48" event={"ID":"7bc96228-a455-4aff-a349-1019495c752f","Type":"ContainerDied","Data":"b9ea326256b3d1f71cf5c670806ea0628b6dc63e5517fb9c52ed2e7f5ec8f036"} Jun 11 16:44:54.495305 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.495283 2565 scope.go:117] "RemoveContainer" containerID="597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072" Jun 11 16:44:54.495641 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:44:54.495618 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072\": container with ID starting with 597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072 not found: ID does not exist" containerID="597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072" Jun 11 16:44:54.495723 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.495647 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072"} err="failed to get container status \"597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072\": rpc error: code = NotFound desc = could not find container \"597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072\": container with ID starting with 597812f1f731aea291c8c1f4062c81f24527d067aa38722675ab9c9c0aa42072 not found: ID does not exist" Jun 11 16:44:54.495723 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.495664 2565 scope.go:117] "RemoveContainer" containerID="05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f" Jun 11 16:44:54.504424 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.504402 2565 scope.go:117] "RemoveContainer" containerID="05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f" Jun 11 16:44:54.504771 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:44:54.504750 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f\": container with ID starting with 05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f not found: ID does not exist" containerID="05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f" Jun 11 16:44:54.504829 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.504779 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f"} err="failed to get container status \"05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f\": rpc error: code = NotFound desc = could not find container \"05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f\": container with ID starting with 05000c717b593e27772f435f53f4e854e1dca30e068118f11cf1c5c41e40d92f not found: ID does not exist" Jun 11 16:44:54.518814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.518784 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b4wk5"] Jun 11 16:44:54.526517 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.526493 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b4wk5"] Jun 11 16:44:54.542781 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.542745 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bc75f9f64-zqq48"] Jun 11 16:44:54.546215 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:54.546185 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bc75f9f64-zqq48"] Jun 11 16:44:55.698452 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:55.698409 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc96228-a455-4aff-a349-1019495c752f" path="/var/lib/kubelet/pods/7bc96228-a455-4aff-a349-1019495c752f/volumes" Jun 11 16:44:55.698848 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:55.698783 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e0d286-7390-4231-93fb-39ebad11eba7" path="/var/lib/kubelet/pods/f5e0d286-7390-4231-93fb-39ebad11eba7/volumes" Jun 11 16:44:57.029424 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029389 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-584789bccc-jqxjc"] Jun 11 16:44:57.029814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029737 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc96228-a455-4aff-a349-1019495c752f" containerName="authorino" Jun 11 16:44:57.029814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029748 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc96228-a455-4aff-a349-1019495c752f" containerName="authorino" Jun 11 16:44:57.029814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029772 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e0d286-7390-4231-93fb-39ebad11eba7" containerName="authorino" Jun 11 16:44:57.029814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029777 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e0d286-7390-4231-93fb-39ebad11eba7" containerName="authorino" Jun 11 16:44:57.029814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029786 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a228c97-add9-41c7-81b1-8b0c5aa587c1" containerName="authorino" Jun 11 16:44:57.029814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029791 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a228c97-add9-41c7-81b1-8b0c5aa587c1" containerName="authorino" Jun 11 16:44:57.030078 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029852 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a228c97-add9-41c7-81b1-8b0c5aa587c1" containerName="authorino" Jun 11 16:44:57.030078 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029863 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5e0d286-7390-4231-93fb-39ebad11eba7" containerName="authorino" Jun 11 16:44:57.030078 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.029868 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc96228-a455-4aff-a349-1019495c752f" containerName="authorino" Jun 11 16:44:57.074609 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.074574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-584789bccc-jqxjc"] Jun 11 16:44:57.074775 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.074633 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.077134 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.077109 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:44:57.077269 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.077138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:44:57.077269 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.077166 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ttjp6\"" Jun 11 16:44:57.119766 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.119728 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf629397-c978-4de7-97c9-5f6f0fa120d0-webhook-cert\") pod \"maas-controller-584789bccc-jqxjc\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.119766 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.119771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgplw\" (UniqueName: \"kubernetes.io/projected/bf629397-c978-4de7-97c9-5f6f0fa120d0-kube-api-access-mgplw\") pod \"maas-controller-584789bccc-jqxjc\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.201435 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.201403 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-2rqnz"] Jun 11 16:44:57.207197 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.207172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.213112 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.213080 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-2rqnz"] Jun 11 16:44:57.221038 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.220864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmg47\" (UniqueName: \"kubernetes.io/projected/7fef2730-eb47-4b87-a8cc-26579ff5bb28-kube-api-access-lmg47\") pod \"maas-controller-65f9fb47fc-2rqnz\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.221038 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.220937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf629397-c978-4de7-97c9-5f6f0fa120d0-webhook-cert\") pod \"maas-controller-584789bccc-jqxjc\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.221038 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.220988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgplw\" (UniqueName: \"kubernetes.io/projected/bf629397-c978-4de7-97c9-5f6f0fa120d0-kube-api-access-mgplw\") pod \"maas-controller-584789bccc-jqxjc\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.221303 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.221042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fef2730-eb47-4b87-a8cc-26579ff5bb28-webhook-cert\") pod \"maas-controller-65f9fb47fc-2rqnz\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.223490 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.223460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf629397-c978-4de7-97c9-5f6f0fa120d0-webhook-cert\") pod \"maas-controller-584789bccc-jqxjc\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.230593 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.230565 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgplw\" (UniqueName: \"kubernetes.io/projected/bf629397-c978-4de7-97c9-5f6f0fa120d0-kube-api-access-mgplw\") pod \"maas-controller-584789bccc-jqxjc\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.322435 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.322407 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmg47\" (UniqueName: \"kubernetes.io/projected/7fef2730-eb47-4b87-a8cc-26579ff5bb28-kube-api-access-lmg47\") pod \"maas-controller-65f9fb47fc-2rqnz\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.322633 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.322472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fef2730-eb47-4b87-a8cc-26579ff5bb28-webhook-cert\") pod \"maas-controller-65f9fb47fc-2rqnz\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.325033 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.325005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fef2730-eb47-4b87-a8cc-26579ff5bb28-webhook-cert\") pod \"maas-controller-65f9fb47fc-2rqnz\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.330424 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.330401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmg47\" (UniqueName: \"kubernetes.io/projected/7fef2730-eb47-4b87-a8cc-26579ff5bb28-kube-api-access-lmg47\") pod \"maas-controller-65f9fb47fc-2rqnz\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.385085 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.385042 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:44:57.518163 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.518133 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:44:57.539365 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.539341 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-584789bccc-jqxjc"] Jun 11 16:44:57.540726 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:44:57.540698 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf629397_c978_4de7_97c9_5f6f0fa120d0.slice/crio-18311c502b427c0b244ff9c08ef8034e95424d2de8b46df081aa1155b1e9f7fd WatchSource:0}: Error finding container 18311c502b427c0b244ff9c08ef8034e95424d2de8b46df081aa1155b1e9f7fd: Status 404 returned error can't find the container with id 18311c502b427c0b244ff9c08ef8034e95424d2de8b46df081aa1155b1e9f7fd Jun 11 16:44:57.659278 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:57.659252 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-2rqnz"] Jun 11 16:44:57.660897 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:44:57.660864 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fef2730_eb47_4b87_a8cc_26579ff5bb28.slice/crio-4249e6ba5c815edc6fa26fbeff216360a7b2fa34bf207db9a0abf53e595774c0 WatchSource:0}: Error finding container 4249e6ba5c815edc6fa26fbeff216360a7b2fa34bf207db9a0abf53e595774c0: Status 404 returned error can't find the container with id 4249e6ba5c815edc6fa26fbeff216360a7b2fa34bf207db9a0abf53e595774c0 Jun 11 16:44:58.537569 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:58.535964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" event={"ID":"7fef2730-eb47-4b87-a8cc-26579ff5bb28","Type":"ContainerStarted","Data":"4249e6ba5c815edc6fa26fbeff216360a7b2fa34bf207db9a0abf53e595774c0"} Jun 11 16:44:58.543923 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:44:58.543881 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584789bccc-jqxjc" event={"ID":"bf629397-c978-4de7-97c9-5f6f0fa120d0","Type":"ContainerStarted","Data":"18311c502b427c0b244ff9c08ef8034e95424d2de8b46df081aa1155b1e9f7fd"} Jun 11 16:45:00.558163 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:00.558126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584789bccc-jqxjc" event={"ID":"bf629397-c978-4de7-97c9-5f6f0fa120d0","Type":"ContainerStarted","Data":"94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2"} Jun 11 16:45:00.558668 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:00.558196 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:45:00.560012 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:00.559979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" event={"ID":"7fef2730-eb47-4b87-a8cc-26579ff5bb28","Type":"ContainerStarted","Data":"ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d"} Jun 11 16:45:00.560151 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:00.560032 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:45:00.577480 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:00.577419 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-584789bccc-jqxjc" podStartSLOduration=0.921743495 podStartE2EDuration="3.577401103s" totalImagesPullingTime="2.655657608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:00.576658087 +0000 UTC m=+533.396224709" watchObservedRunningTime="2026-06-11 16:45:00.577401103 +0000 UTC m=+533.396967726" Jun 11 16:45:00.597234 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:00.597174 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" podStartSLOduration=1.067716801 podStartE2EDuration="3.597155701s" totalImagesPullingTime="2.5294389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:00.5943078 +0000 UTC m=+533.413874423" watchObservedRunningTime="2026-06-11 16:45:00.597155701 +0000 UTC m=+533.416722324" Jun 11 16:45:11.572007 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.571975 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:45:11.572474 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.572055 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:45:11.632078 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.632044 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-584789bccc-jqxjc"] Jun 11 16:45:11.632585 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.632516 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-584789bccc-jqxjc" podUID="bf629397-c978-4de7-97c9-5f6f0fa120d0" containerName="manager" containerID="cri-o://94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2" gracePeriod=30 Jun 11 16:45:11.887254 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.887229 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:45:11.959988 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.959947 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf629397-c978-4de7-97c9-5f6f0fa120d0-webhook-cert\") pod \"bf629397-c978-4de7-97c9-5f6f0fa120d0\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " Jun 11 16:45:11.960183 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.960059 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgplw\" (UniqueName: \"kubernetes.io/projected/bf629397-c978-4de7-97c9-5f6f0fa120d0-kube-api-access-mgplw\") pod \"bf629397-c978-4de7-97c9-5f6f0fa120d0\" (UID: \"bf629397-c978-4de7-97c9-5f6f0fa120d0\") " Jun 11 16:45:11.962125 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.962097 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf629397-c978-4de7-97c9-5f6f0fa120d0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bf629397-c978-4de7-97c9-5f6f0fa120d0" (UID: "bf629397-c978-4de7-97c9-5f6f0fa120d0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:45:11.962229 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:11.962133 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf629397-c978-4de7-97c9-5f6f0fa120d0-kube-api-access-mgplw" (OuterVolumeSpecName: "kube-api-access-mgplw") pod "bf629397-c978-4de7-97c9-5f6f0fa120d0" (UID: "bf629397-c978-4de7-97c9-5f6f0fa120d0"). InnerVolumeSpecName "kube-api-access-mgplw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:45:12.061471 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.061432 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgplw\" (UniqueName: \"kubernetes.io/projected/bf629397-c978-4de7-97c9-5f6f0fa120d0-kube-api-access-mgplw\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:45:12.061471 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.061465 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf629397-c978-4de7-97c9-5f6f0fa120d0-webhook-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:45:12.631192 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.631147 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf629397-c978-4de7-97c9-5f6f0fa120d0" containerID="94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2" exitCode=0 Jun 11 16:45:12.631691 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.631210 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-584789bccc-jqxjc" Jun 11 16:45:12.631691 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.631237 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584789bccc-jqxjc" event={"ID":"bf629397-c978-4de7-97c9-5f6f0fa120d0","Type":"ContainerDied","Data":"94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2"} Jun 11 16:45:12.631691 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.631322 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-584789bccc-jqxjc" event={"ID":"bf629397-c978-4de7-97c9-5f6f0fa120d0","Type":"ContainerDied","Data":"18311c502b427c0b244ff9c08ef8034e95424d2de8b46df081aa1155b1e9f7fd"} Jun 11 16:45:12.631691 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.631346 2565 scope.go:117] "RemoveContainer" containerID="94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2" Jun 11 16:45:12.641927 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.641766 2565 scope.go:117] "RemoveContainer" containerID="94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2" Jun 11 16:45:12.642058 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:45:12.642036 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2\": container with ID starting with 94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2 not found: ID does not exist" containerID="94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2" Jun 11 16:45:12.642106 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.642067 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2"} err="failed to get container status \"94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2\": rpc error: code = NotFound desc = could not find container \"94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2\": container with ID starting with 94843669115adf3c2441c10c0bc656ae950214403729c6d26a94fa8fdb3768e2 not found: ID does not exist" Jun 11 16:45:12.654391 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.654352 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-584789bccc-jqxjc"] Jun 11 16:45:12.656855 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:12.656823 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-584789bccc-jqxjc"] Jun 11 16:45:13.697011 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:13.696969 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf629397-c978-4de7-97c9-5f6f0fa120d0" path="/var/lib/kubelet/pods/bf629397-c978-4de7-97c9-5f6f0fa120d0/volumes" Jun 11 16:45:32.110678 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.110641 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-574c5779df-4sscg"] Jun 11 16:45:32.111078 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.111064 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf629397-c978-4de7-97c9-5f6f0fa120d0" containerName="manager" Jun 11 16:45:32.111127 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.111083 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf629397-c978-4de7-97c9-5f6f0fa120d0" containerName="manager" Jun 11 16:45:32.111201 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.111185 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf629397-c978-4de7-97c9-5f6f0fa120d0" containerName="manager" Jun 11 16:45:32.115487 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.115471 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.118099 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.118071 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 16:45:32.118347 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.118333 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2cgsm\"" Jun 11 16:45:32.125964 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.125939 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-574c5779df-4sscg"] Jun 11 16:45:32.244338 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.244296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkjp\" (UniqueName: \"kubernetes.io/projected/7707d200-16fe-49b9-96fe-acc560b2b966-kube-api-access-2dkjp\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.244338 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.244339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7707d200-16fe-49b9-96fe-acc560b2b966-openshift-service-ca\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.244594 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.244439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7707d200-16fe-49b9-96fe-acc560b2b966-maas-api-tls\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.345032 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.344995 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7707d200-16fe-49b9-96fe-acc560b2b966-maas-api-tls\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.345275 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.345147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkjp\" (UniqueName: \"kubernetes.io/projected/7707d200-16fe-49b9-96fe-acc560b2b966-kube-api-access-2dkjp\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.345275 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.345184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7707d200-16fe-49b9-96fe-acc560b2b966-openshift-service-ca\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.345275 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:45:32.345201 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 16:45:32.345503 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:45:32.345282 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7707d200-16fe-49b9-96fe-acc560b2b966-maas-api-tls podName:7707d200-16fe-49b9-96fe-acc560b2b966 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:32.845259569 +0000 UTC m=+565.664826181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7707d200-16fe-49b9-96fe-acc560b2b966-maas-api-tls") pod "maas-api-574c5779df-4sscg" (UID: "7707d200-16fe-49b9-96fe-acc560b2b966") : secret "maas-api-serving-cert" not found Jun 11 16:45:32.345975 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.345955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7707d200-16fe-49b9-96fe-acc560b2b966-openshift-service-ca\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.357423 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.357398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkjp\" (UniqueName: \"kubernetes.io/projected/7707d200-16fe-49b9-96fe-acc560b2b966-kube-api-access-2dkjp\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.609304 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.609268 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-dq4g2"] Jun 11 16:45:32.611670 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.611650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" Jun 11 16:45:32.613729 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.613704 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-z44bf\"" Jun 11 16:45:32.613867 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.613848 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 16:45:32.622771 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.622745 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-dq4g2"] Jun 11 16:45:32.749187 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.749157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvt4w\" (UniqueName: \"kubernetes.io/projected/2f626926-192c-4ac7-a6da-ee6808a6832d-kube-api-access-kvt4w\") pod \"payload-processing-699b6cd6c-dq4g2\" (UID: \"2f626926-192c-4ac7-a6da-ee6808a6832d\") " pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" Jun 11 16:45:32.850624 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.850577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvt4w\" (UniqueName: \"kubernetes.io/projected/2f626926-192c-4ac7-a6da-ee6808a6832d-kube-api-access-kvt4w\") pod \"payload-processing-699b6cd6c-dq4g2\" (UID: \"2f626926-192c-4ac7-a6da-ee6808a6832d\") " pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" Jun 11 16:45:32.850854 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.850724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7707d200-16fe-49b9-96fe-acc560b2b966-maas-api-tls\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.853376 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.853352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7707d200-16fe-49b9-96fe-acc560b2b966-maas-api-tls\") pod \"maas-api-574c5779df-4sscg\" (UID: \"7707d200-16fe-49b9-96fe-acc560b2b966\") " pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:32.857477 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.857453 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvt4w\" (UniqueName: \"kubernetes.io/projected/2f626926-192c-4ac7-a6da-ee6808a6832d-kube-api-access-kvt4w\") pod \"payload-processing-699b6cd6c-dq4g2\" (UID: \"2f626926-192c-4ac7-a6da-ee6808a6832d\") " pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" Jun 11 16:45:32.924785 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:32.924692 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" Jun 11 16:45:33.028018 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:33.027980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:33.064511 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:33.064481 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-dq4g2"] Jun 11 16:45:33.067582 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:45:33.067518 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f626926_192c_4ac7_a6da_ee6808a6832d.slice/crio-7fcefb410d2b119173c000aef3541c8e81f46b3622ae51659d42450824a05ea5 WatchSource:0}: Error finding container 7fcefb410d2b119173c000aef3541c8e81f46b3622ae51659d42450824a05ea5: Status 404 returned error can't find the container with id 7fcefb410d2b119173c000aef3541c8e81f46b3622ae51659d42450824a05ea5 Jun 11 16:45:33.182534 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:33.182046 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-574c5779df-4sscg"] Jun 11 16:45:33.780630 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:33.780584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" event={"ID":"2f626926-192c-4ac7-a6da-ee6808a6832d","Type":"ContainerStarted","Data":"7fcefb410d2b119173c000aef3541c8e81f46b3622ae51659d42450824a05ea5"} Jun 11 16:45:33.783399 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:33.783371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-574c5779df-4sscg" event={"ID":"7707d200-16fe-49b9-96fe-acc560b2b966","Type":"ContainerStarted","Data":"22f9bb57af67b0f64610eef2e01e462c5e9d5356e5d0ae066107e5b78440ade9"} Jun 11 16:45:36.802648 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:36.802597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" event={"ID":"2f626926-192c-4ac7-a6da-ee6808a6832d","Type":"ContainerStarted","Data":"56f9c799e8b1ff318f584329258a541c3ba4c885365d6791e303ffa24c84e5eb"} Jun 11 16:45:36.803137 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:36.802674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" Jun 11 16:45:36.804376 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:36.804346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-574c5779df-4sscg" event={"ID":"7707d200-16fe-49b9-96fe-acc560b2b966","Type":"ContainerStarted","Data":"2bb134acf5e9049699398130dc84d6807f131050bc08a01bbe09983e2b2804f9"} Jun 11 16:45:36.804501 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:36.804424 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:36.817291 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:36.817240 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" podStartSLOduration=1.662832182 podStartE2EDuration="4.817225596s" totalImagesPullingTime="3.154393414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:36.816187289 +0000 UTC m=+569.635753935" watchObservedRunningTime="2026-06-11 16:45:36.817225596 +0000 UTC m=+569.636792255" Jun 11 16:45:36.832380 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:36.832330 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-574c5779df-4sscg" podStartSLOduration=1.790721673 podStartE2EDuration="4.832314756s" totalImagesPullingTime="3.041593083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:36.830285842 +0000 UTC m=+569.649852465" watchObservedRunningTime="2026-06-11 16:45:36.832314756 +0000 UTC m=+569.651881377" Jun 11 16:45:40.830105 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:40.830073 2565 generic.go:356] "Generic (PLEG): container finished" podID="f974f8ec-5287-4ae6-841f-4c8505ef6d2b" containerID="e1b028e6cc130310116d27a18539c8763c6e1a9eca5a1a8c47eeb73f22d77a69" exitCode=0 Jun 11 16:45:40.830515 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:40.830147 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" event={"ID":"f974f8ec-5287-4ae6-841f-4c8505ef6d2b","Type":"ContainerDied","Data":"e1b028e6cc130310116d27a18539c8763c6e1a9eca5a1a8c47eeb73f22d77a69"} Jun 11 16:45:40.830588 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:40.830569 2565 scope.go:117] "RemoveContainer" containerID="e1b028e6cc130310116d27a18539c8763c6e1a9eca5a1a8c47eeb73f22d77a69" Jun 11 16:45:40.831588 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:40.831564 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:45:40.831660 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:40.831632 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:45:40.831706 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:40.831665 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 16:45:41.837774 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:41.837740 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" event={"ID":"f974f8ec-5287-4ae6-841f-4c8505ef6d2b","Type":"ContainerStarted","Data":"ba0162df12b5e61bf368db86781694a6a961c8502f8810186bea46d95d30db8f"} Jun 11 16:45:42.448723 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:42.448683 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:45:42.449893 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:42.449858 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fd7hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:45:42.450034 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:42.449924 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" podUID="f974f8ec-5287-4ae6-841f-4c8505ef6d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jun 11 16:45:42.815329 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:42.815296 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-574c5779df-4sscg" Jun 11 16:45:43.448812 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:43.448775 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fd7hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:45:43.449185 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:43.448834 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" podUID="f974f8ec-5287-4ae6-841f-4c8505ef6d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jun 11 16:45:44.448964 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:44.448898 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fd7hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:45:44.449371 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:44.448994 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" podUID="f974f8ec-5287-4ae6-841f-4c8505ef6d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jun 11 16:45:45.448683 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:45.448646 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-fd7hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jun 11 16:45:45.448872 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:45.448705 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" podUID="f974f8ec-5287-4ae6-841f-4c8505ef6d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jun 11 16:45:46.452716 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:46.452679 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:45:46.453187 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:46.453150 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:45:46.453969 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:46.453950 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-fd7hp" Jun 11 16:45:47.812234 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:45:47.812203 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-dq4g2" Jun 11 16:46:07.690360 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:46:07.690330 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:46:07.695136 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:46:07.695107 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:47:46.967677 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:46.967634 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:47:46.968268 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:46.967859 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" containerID="cri-o://b8361edac405f91b68f7201fafd2a1109eab4d60110be12009086493cc8dad81" gracePeriod=30 Jun 11 16:47:48.547153 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:48.547115 2565 generic.go:356] "Generic (PLEG): container finished" podID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerID="b8361edac405f91b68f7201fafd2a1109eab4d60110be12009086493cc8dad81" exitCode=143 Jun 11 16:47:48.547525 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:48.547169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"00b9e364-124e-4c49-bfac-4c76c4041d2c","Type":"ContainerDied","Data":"b8361edac405f91b68f7201fafd2a1109eab4d60110be12009086493cc8dad81"} Jun 11 16:47:49.019175 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.019149 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.201502 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.201399 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktkkl\" (UniqueName: \"kubernetes.io/projected/00b9e364-124e-4c49-bfac-4c76c4041d2c-kube-api-access-ktkkl\") pod \"00b9e364-124e-4c49-bfac-4c76c4041d2c\" (UID: \"00b9e364-124e-4c49-bfac-4c76c4041d2c\") " Jun 11 16:47:49.203798 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.203773 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b9e364-124e-4c49-bfac-4c76c4041d2c-kube-api-access-ktkkl" (OuterVolumeSpecName: "kube-api-access-ktkkl") pod "00b9e364-124e-4c49-bfac-4c76c4041d2c" (UID: "00b9e364-124e-4c49-bfac-4c76c4041d2c"). InnerVolumeSpecName "kube-api-access-ktkkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:47:49.302266 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.302225 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktkkl\" (UniqueName: \"kubernetes.io/projected/00b9e364-124e-4c49-bfac-4c76c4041d2c-kube-api-access-ktkkl\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:47:49.554067 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.554036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"00b9e364-124e-4c49-bfac-4c76c4041d2c","Type":"ContainerDied","Data":"6a90415b1128ebb873f8b4d6c1004b544b627ed0eb8ad393d277ec00acd39748"} Jun 11 16:47:49.554537 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.554095 2565 scope.go:117] "RemoveContainer" containerID="b8361edac405f91b68f7201fafd2a1109eab4d60110be12009086493cc8dad81" Jun 11 16:47:49.554537 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.554047 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.575506 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.575477 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:47:49.580105 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.580077 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:47:49.603241 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.603202 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:47:49.603733 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.603714 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" Jun 11 16:47:49.603785 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.603736 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" Jun 11 16:47:49.603826 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.603808 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" containerName="keycloak" Jun 11 16:47:49.608007 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.607986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.610030 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.609997 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:47:49.610141 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.610038 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:47:49.610141 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.610049 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 16:47:49.610141 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.610079 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:47:49.610141 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.610108 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jdzpc\"" Jun 11 16:47:49.616795 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.616772 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:47:49.697230 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.697193 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b9e364-124e-4c49-bfac-4c76c4041d2c" path="/var/lib/kubelet/pods/00b9e364-124e-4c49-bfac-4c76c4041d2c/volumes" Jun 11 16:47:49.807040 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.806945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fvx\" (UniqueName: \"kubernetes.io/projected/9b3401f7-bc9c-4de7-9785-ce1e1e14720e-kube-api-access-n8fvx\") pod \"maas-keycloak-0\" (UID: \"9b3401f7-bc9c-4de7-9785-ce1e1e14720e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.807040 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.806999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9b3401f7-bc9c-4de7-9785-ce1e1e14720e-test-realms\") pod \"maas-keycloak-0\" (UID: \"9b3401f7-bc9c-4de7-9785-ce1e1e14720e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.907906 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.907867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fvx\" (UniqueName: \"kubernetes.io/projected/9b3401f7-bc9c-4de7-9785-ce1e1e14720e-kube-api-access-n8fvx\") pod \"maas-keycloak-0\" (UID: \"9b3401f7-bc9c-4de7-9785-ce1e1e14720e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.907906 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.907915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9b3401f7-bc9c-4de7-9785-ce1e1e14720e-test-realms\") pod \"maas-keycloak-0\" (UID: \"9b3401f7-bc9c-4de7-9785-ce1e1e14720e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.908620 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.908603 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9b3401f7-bc9c-4de7-9785-ce1e1e14720e-test-realms\") pod \"maas-keycloak-0\" (UID: \"9b3401f7-bc9c-4de7-9785-ce1e1e14720e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.915877 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.915856 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fvx\" (UniqueName: \"kubernetes.io/projected/9b3401f7-bc9c-4de7-9785-ce1e1e14720e-kube-api-access-n8fvx\") pod \"maas-keycloak-0\" (UID: \"9b3401f7-bc9c-4de7-9785-ce1e1e14720e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:49.919676 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:49.919649 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:50.059830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:50.059802 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:47:50.062064 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:47:50.062037 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3401f7_bc9c_4de7_9785_ce1e1e14720e.slice/crio-f49d3fb6de28240011c9576f49ca2ffbdc9500ee2dcb1423500a2aaaeae1b222 WatchSource:0}: Error finding container f49d3fb6de28240011c9576f49ca2ffbdc9500ee2dcb1423500a2aaaeae1b222: Status 404 returned error can't find the container with id f49d3fb6de28240011c9576f49ca2ffbdc9500ee2dcb1423500a2aaaeae1b222 Jun 11 16:47:50.063776 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:50.063758 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:47:50.564601 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:50.564539 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b3401f7-bc9c-4de7-9785-ce1e1e14720e","Type":"ContainerStarted","Data":"2006f841e7140c131d1cbc44c16044d626736132f56b70484379ab1e8d1b1b91"} Jun 11 16:47:50.565038 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:50.564624 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b3401f7-bc9c-4de7-9785-ce1e1e14720e","Type":"ContainerStarted","Data":"f49d3fb6de28240011c9576f49ca2ffbdc9500ee2dcb1423500a2aaaeae1b222"} Jun 11 16:47:50.581127 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:50.581059 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.275302615 podStartE2EDuration="1.581036294s" totalImagesPullingTime="305.733679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:47:50.580348683 +0000 UTC m=+703.399915306" watchObservedRunningTime="2026-06-11 16:47:50.581036294 +0000 UTC m=+703.400602920" Jun 11 16:47:50.920713 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:50.920669 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:50.922637 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:50.922596 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:51.920533 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:51.920483 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:52.920987 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:52.920866 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:53.920271 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:53.920222 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:54.920682 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:54.920204 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:55.920837 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:55.920774 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:56.921084 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:56.921019 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:57.921065 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:57.920995 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:58.920099 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:58.920040 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:47:59.920447 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:59.920396 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:47:59.920873 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:47:59.920698 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:48:00.920327 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:00.920273 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:48:01.920263 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:01.920220 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:48:02.920516 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:02.920466 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.57:9000/health/started\": dial tcp 10.133.0.57:9000: connect: connection refused" Jun 11 16:48:04.010495 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:04.010442 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:48:04.029424 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:04.029364 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9b3401f7-bc9c-4de7-9785-ce1e1e14720e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:48:14.016389 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:14.016348 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:48:24.695328 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.695284 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76ccdb5cc4-rlq97"] Jun 11 16:48:24.700357 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.700332 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.702761 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.702730 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 16:48:24.705416 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.705393 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76ccdb5cc4-rlq97"] Jun 11 16:48:24.840174 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.840141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbx7x\" (UniqueName: \"kubernetes.io/projected/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-kube-api-access-sbx7x\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.840356 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.840206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-tls-cert\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.840356 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.840235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-oidc-ca\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.941103 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.941064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-tls-cert\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.941301 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.941108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-oidc-ca\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.941301 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.941182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbx7x\" (UniqueName: \"kubernetes.io/projected/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-kube-api-access-sbx7x\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.941853 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.941830 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-oidc-ca\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.943584 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.943559 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-tls-cert\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:24.948357 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:24.948302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbx7x\" (UniqueName: \"kubernetes.io/projected/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-kube-api-access-sbx7x\") pod \"authorino-76ccdb5cc4-rlq97\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:25.011353 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:25.011318 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:48:25.149183 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:25.149151 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76ccdb5cc4-rlq97"] Jun 11 16:48:25.151113 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:48:25.151085 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5cff9a5_17a9_4f5e_8d1e_a7db106e8b2a.slice/crio-8016178b8d64d9580359f8d81fe88943bcdfba4fa1c12ad6a5c410d79647aed5 WatchSource:0}: Error finding container 8016178b8d64d9580359f8d81fe88943bcdfba4fa1c12ad6a5c410d79647aed5: Status 404 returned error can't find the container with id 8016178b8d64d9580359f8d81fe88943bcdfba4fa1c12ad6a5c410d79647aed5 Jun 11 16:48:25.817812 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:25.817771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" event={"ID":"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a","Type":"ContainerStarted","Data":"0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354"} Jun 11 16:48:25.818216 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:25.817826 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" event={"ID":"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a","Type":"ContainerStarted","Data":"8016178b8d64d9580359f8d81fe88943bcdfba4fa1c12ad6a5c410d79647aed5"} Jun 11 16:48:25.835963 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:25.835908 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" podStartSLOduration=1.477788715 podStartE2EDuration="1.835893218s" totalImagesPullingTime="358.104503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:25.833312464 +0000 UTC m=+738.652879087" watchObservedRunningTime="2026-06-11 16:48:25.835893218 +0000 UTC m=+738.655459839" Jun 11 16:48:25.861972 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:25.861940 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b7fb99d76-gw64m"] Jun 11 16:48:25.862149 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:25.862120 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" podUID="616f560f-5aec-46e0-91c3-433c629f2419" containerName="authorino" containerID="cri-o://014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3" gracePeriod=30 Jun 11 16:48:26.113910 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.113886 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:48:26.252461 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.252428 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7pk4\" (UniqueName: \"kubernetes.io/projected/616f560f-5aec-46e0-91c3-433c629f2419-kube-api-access-q7pk4\") pod \"616f560f-5aec-46e0-91c3-433c629f2419\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " Jun 11 16:48:26.252693 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.252573 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/616f560f-5aec-46e0-91c3-433c629f2419-tls-cert\") pod \"616f560f-5aec-46e0-91c3-433c629f2419\" (UID: \"616f560f-5aec-46e0-91c3-433c629f2419\") " Jun 11 16:48:26.254799 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.254768 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616f560f-5aec-46e0-91c3-433c629f2419-kube-api-access-q7pk4" (OuterVolumeSpecName: "kube-api-access-q7pk4") pod "616f560f-5aec-46e0-91c3-433c629f2419" (UID: "616f560f-5aec-46e0-91c3-433c629f2419"). InnerVolumeSpecName "kube-api-access-q7pk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:48:26.265239 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.265203 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/616f560f-5aec-46e0-91c3-433c629f2419-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "616f560f-5aec-46e0-91c3-433c629f2419" (UID: "616f560f-5aec-46e0-91c3-433c629f2419"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:48:26.354064 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.353958 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/616f560f-5aec-46e0-91c3-433c629f2419-tls-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:48:26.354064 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.354006 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7pk4\" (UniqueName: \"kubernetes.io/projected/616f560f-5aec-46e0-91c3-433c629f2419-kube-api-access-q7pk4\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:48:26.824457 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.824421 2565 generic.go:356] "Generic (PLEG): container finished" podID="616f560f-5aec-46e0-91c3-433c629f2419" containerID="014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3" exitCode=0 Jun 11 16:48:26.824944 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.824466 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" Jun 11 16:48:26.824944 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.824495 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" event={"ID":"616f560f-5aec-46e0-91c3-433c629f2419","Type":"ContainerDied","Data":"014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3"} Jun 11 16:48:26.824944 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.824527 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b7fb99d76-gw64m" event={"ID":"616f560f-5aec-46e0-91c3-433c629f2419","Type":"ContainerDied","Data":"e3f1587572f10d9f9201874a843662fc76e58436feb80e6501cdf001c9187df2"} Jun 11 16:48:26.824944 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.824562 2565 scope.go:117] "RemoveContainer" containerID="014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3" Jun 11 16:48:26.834336 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.834314 2565 scope.go:117] "RemoveContainer" containerID="014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3" Jun 11 16:48:26.834659 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:48:26.834633 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3\": container with ID starting with 014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3 not found: ID does not exist" containerID="014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3" Jun 11 16:48:26.834711 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.834672 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3"} err="failed to get container status \"014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3\": rpc error: code = NotFound desc = could not find container \"014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3\": container with ID starting with 014a9d3cfc41869332f24616785f75728b25deb39b9b6f010e229cfd7828a6d3 not found: ID does not exist" Jun 11 16:48:26.856620 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.856574 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b7fb99d76-gw64m"] Jun 11 16:48:26.858960 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:26.858928 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b7fb99d76-gw64m"] Jun 11 16:48:27.699057 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:48:27.699023 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="616f560f-5aec-46e0-91c3-433c629f2419" path="/var/lib/kubelet/pods/616f560f-5aec-46e0-91c3-433c629f2419/volumes" Jun 11 16:49:00.494153 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.494100 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f"] Jun 11 16:49:00.494866 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.494840 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616f560f-5aec-46e0-91c3-433c629f2419" containerName="authorino" Jun 11 16:49:00.494985 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.494868 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="616f560f-5aec-46e0-91c3-433c629f2419" containerName="authorino" Jun 11 16:49:00.494985 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.494966 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="616f560f-5aec-46e0-91c3-433c629f2419" containerName="authorino" Jun 11 16:49:00.497809 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.497787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.500255 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.500229 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 16:49:00.500255 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.500246 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8z5lv\"" Jun 11 16:49:00.500409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.500229 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 16:49:00.500409 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.500228 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 16:49:00.506925 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.506900 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f"] Jun 11 16:49:00.552155 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.552117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.552346 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.552205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.552346 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.552243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.552346 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.552279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbgfs\" (UniqueName: \"kubernetes.io/projected/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-kube-api-access-mbgfs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.552346 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.552341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.552509 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.552367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653372 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653680 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653680 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653680 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653680 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbgfs\" (UniqueName: \"kubernetes.io/projected/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-kube-api-access-mbgfs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653879 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653833 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653937 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653879 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.653937 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.653912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.655685 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.655663 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.656070 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.656050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.660600 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.660576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbgfs\" (UniqueName: \"kubernetes.io/projected/dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2-kube-api-access-mbgfs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-g8s7f\" (UID: \"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.810159 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.810117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:00.954120 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:00.954090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f"] Jun 11 16:49:00.955939 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:49:00.955909 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd411789_fa86_4a0d_a9a3_7fdb7f7d50a2.slice/crio-2251910ea29a7f42cf2c118f1bc4bfaf21351d5d35a3b98037a88b7d981fe127 WatchSource:0}: Error finding container 2251910ea29a7f42cf2c118f1bc4bfaf21351d5d35a3b98037a88b7d981fe127: Status 404 returned error can't find the container with id 2251910ea29a7f42cf2c118f1bc4bfaf21351d5d35a3b98037a88b7d981fe127 Jun 11 16:49:01.036506 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:01.036471 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" event={"ID":"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2","Type":"ContainerStarted","Data":"2251910ea29a7f42cf2c118f1bc4bfaf21351d5d35a3b98037a88b7d981fe127"} Jun 11 16:49:05.066539 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:05.066504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" event={"ID":"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2","Type":"ContainerStarted","Data":"7c156293b517ce00f41538b391985109f276f0e27e49920769f3e93c2f3c12ee"} Jun 11 16:49:07.080111 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:07.080070 2565 generic.go:356] "Generic (PLEG): container finished" podID="dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2" containerID="7c156293b517ce00f41538b391985109f276f0e27e49920769f3e93c2f3c12ee" exitCode=0 Jun 11 16:49:07.080511 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:07.080140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" event={"ID":"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2","Type":"ContainerDied","Data":"7c156293b517ce00f41538b391985109f276f0e27e49920769f3e93c2f3c12ee"} Jun 11 16:49:09.094617 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:09.094567 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" event={"ID":"dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2","Type":"ContainerStarted","Data":"263d36392fa2235eedfcbe31c261726bee72997a2a7d0fe6108ba43f0cd16c32"} Jun 11 16:49:09.115085 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:09.115028 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" podStartSLOduration=2.395997142 podStartE2EDuration="9.115011017s" totalImagesPullingTime="4.3966953s" totalInitContainerRuntime="2.322318575s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:09.112087578 +0000 UTC m=+781.931654208" watchObservedRunningTime="2026-06-11 16:49:09.115011017 +0000 UTC m=+781.934577639" Jun 11 16:49:10.810603 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:10.810539 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:10.811040 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:10.810660 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:10.823362 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:10.823328 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:11.119837 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:11.119754 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-g8s7f" Jun 11 16:49:19.186927 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.186887 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp"] Jun 11 16:49:19.204427 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.204390 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp"] Jun 11 16:49:19.204852 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.204490 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.206382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.206361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 16:49:19.327519 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.327467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.327722 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.327530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.327722 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.327581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.327722 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.327597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.327722 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.327618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.327722 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.327703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcxkp\" (UniqueName: \"kubernetes.io/projected/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-kube-api-access-qcxkp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.428744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.428703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcxkp\" (UniqueName: \"kubernetes.io/projected/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-kube-api-access-qcxkp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.428744 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.428748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.428996 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.428778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.428996 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.428812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.428996 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.428828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.428996 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.428848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.429353 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.429326 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.429437 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.429355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.429437 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.429378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.431142 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.431107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.431497 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.431478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.436218 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.436190 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcxkp\" (UniqueName: \"kubernetes.io/projected/570b87ae-2da0-4648-afcb-6d7cc54ee3d5-kube-api-access-qcxkp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp\" (UID: \"570b87ae-2da0-4648-afcb-6d7cc54ee3d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.515369 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.515267 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:19.655501 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:19.655473 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp"] Jun 11 16:49:19.658224 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:49:19.658187 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570b87ae_2da0_4648_afcb_6d7cc54ee3d5.slice/crio-06fafa3f55c2ec8acc40c25f5d922d90b88cc4b2354529e54a0cd8d7b3ac1535 WatchSource:0}: Error finding container 06fafa3f55c2ec8acc40c25f5d922d90b88cc4b2354529e54a0cd8d7b3ac1535: Status 404 returned error can't find the container with id 06fafa3f55c2ec8acc40c25f5d922d90b88cc4b2354529e54a0cd8d7b3ac1535 Jun 11 16:49:20.167254 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:20.167207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" event={"ID":"570b87ae-2da0-4648-afcb-6d7cc54ee3d5","Type":"ContainerStarted","Data":"2545081c8dae4e7ebd77be031a1f40b0efd3808ac70bd6086332f52f7b90782d"} Jun 11 16:49:20.167457 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:20.167279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" event={"ID":"570b87ae-2da0-4648-afcb-6d7cc54ee3d5","Type":"ContainerStarted","Data":"06fafa3f55c2ec8acc40c25f5d922d90b88cc4b2354529e54a0cd8d7b3ac1535"} Jun 11 16:49:21.174509 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:21.174467 2565 generic.go:356] "Generic (PLEG): container finished" podID="570b87ae-2da0-4648-afcb-6d7cc54ee3d5" containerID="2545081c8dae4e7ebd77be031a1f40b0efd3808ac70bd6086332f52f7b90782d" exitCode=0 Jun 11 16:49:21.175021 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:21.174563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" event={"ID":"570b87ae-2da0-4648-afcb-6d7cc54ee3d5","Type":"ContainerDied","Data":"2545081c8dae4e7ebd77be031a1f40b0efd3808ac70bd6086332f52f7b90782d"} Jun 11 16:49:22.185335 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:22.185295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" event={"ID":"570b87ae-2da0-4648-afcb-6d7cc54ee3d5","Type":"ContainerStarted","Data":"9690589d58502c8264a9a1b836c151afc4a5531e9826f6a44c2c277265c76fcc"} Jun 11 16:49:22.205090 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:22.205025 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" podStartSLOduration=1.619451043 podStartE2EDuration="3.205007357s" totalImagesPullingTime="210.257707ms" totalInitContainerRuntime="1.375298607s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:22.201987715 +0000 UTC m=+795.021554338" watchObservedRunningTime="2026-06-11 16:49:22.205007357 +0000 UTC m=+795.024573979" Jun 11 16:49:29.515985 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:29.515885 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:29.515985 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:29.515972 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:29.528811 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:29.528774 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:49:30.243541 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:49:30.243512 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp" Jun 11 16:50:47.887830 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:47.887782 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c4bb85fd7-l5mlh"] Jun 11 16:50:47.891076 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:47.891059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:47.900353 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:47.900322 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c4bb85fd7-l5mlh"] Jun 11 16:50:48.043179 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.043132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-tls-cert\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.043179 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.043183 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcvd2\" (UniqueName: \"kubernetes.io/projected/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-kube-api-access-zcvd2\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.043408 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.043235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-oidc-ca\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.144501 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.144408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-tls-cert\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.144501 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.144460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcvd2\" (UniqueName: \"kubernetes.io/projected/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-kube-api-access-zcvd2\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.144501 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.144498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-oidc-ca\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.145172 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.145154 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-oidc-ca\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.147010 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.146987 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-tls-cert\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.152202 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.152180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcvd2\" (UniqueName: \"kubernetes.io/projected/4aa14b4b-f999-42ef-b1b9-3092c57a3aa9-kube-api-access-zcvd2\") pod \"authorino-c4bb85fd7-l5mlh\" (UID: \"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9\") " pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.224261 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.224225 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" Jun 11 16:50:48.362135 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.362104 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c4bb85fd7-l5mlh"] Jun 11 16:50:48.363690 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:50:48.363657 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aa14b4b_f999_42ef_b1b9_3092c57a3aa9.slice/crio-7d922aba87ac2fb500c34a328780c9551b76b29a19bc08ce807009afca228307 WatchSource:0}: Error finding container 7d922aba87ac2fb500c34a328780c9551b76b29a19bc08ce807009afca228307: Status 404 returned error can't find the container with id 7d922aba87ac2fb500c34a328780c9551b76b29a19bc08ce807009afca228307 Jun 11 16:50:48.680555 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:48.680519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" event={"ID":"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9","Type":"ContainerStarted","Data":"7d922aba87ac2fb500c34a328780c9551b76b29a19bc08ce807009afca228307"} Jun 11 16:50:49.689570 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:49.689508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" event={"ID":"4aa14b4b-f999-42ef-b1b9-3092c57a3aa9","Type":"ContainerStarted","Data":"0a77c6e07f05088c8c72b716d7e2cee84cc9d31219ffba311367cd2ac1245fa5"} Jun 11 16:50:49.704685 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:49.704627 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c4bb85fd7-l5mlh" podStartSLOduration=2.330738962 podStartE2EDuration="2.704608222s" totalImagesPullingTime="373.86926ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:50:49.703285508 +0000 UTC m=+882.522852130" watchObservedRunningTime="2026-06-11 16:50:49.704608222 +0000 UTC m=+882.524174843" Jun 11 16:50:49.730302 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:49.730257 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76ccdb5cc4-rlq97"] Jun 11 16:50:49.730781 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:49.730744 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" podUID="c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" containerName="authorino" containerID="cri-o://0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354" gracePeriod=30 Jun 11 16:50:50.020835 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.020805 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:50:50.164017 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.163969 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-oidc-ca\") pod \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " Jun 11 16:50:50.164226 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.164054 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-tls-cert\") pod \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " Jun 11 16:50:50.164226 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.164118 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbx7x\" (UniqueName: \"kubernetes.io/projected/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-kube-api-access-sbx7x\") pod \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\" (UID: \"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a\") " Jun 11 16:50:50.166769 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.166727 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-kube-api-access-sbx7x" (OuterVolumeSpecName: "kube-api-access-sbx7x") pod "c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" (UID: "c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a"). InnerVolumeSpecName "kube-api-access-sbx7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:50:50.170419 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.170384 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" (UID: "c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:50:50.175996 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.175965 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" (UID: "c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:50:50.265762 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.265671 2565 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-oidc-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:50:50.265762 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.265703 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-tls-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:50:50.265762 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.265713 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbx7x\" (UniqueName: \"kubernetes.io/projected/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a-kube-api-access-sbx7x\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:50:50.696416 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.696379 2565 generic.go:356] "Generic (PLEG): container finished" podID="c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" containerID="0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354" exitCode=0 Jun 11 16:50:50.696871 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.696429 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" Jun 11 16:50:50.696871 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.696458 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" event={"ID":"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a","Type":"ContainerDied","Data":"0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354"} Jun 11 16:50:50.696871 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.696503 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ccdb5cc4-rlq97" event={"ID":"c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a","Type":"ContainerDied","Data":"8016178b8d64d9580359f8d81fe88943bcdfba4fa1c12ad6a5c410d79647aed5"} Jun 11 16:50:50.696871 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.696528 2565 scope.go:117] "RemoveContainer" containerID="0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354" Jun 11 16:50:50.707236 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.707217 2565 scope.go:117] "RemoveContainer" containerID="0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354" Jun 11 16:50:50.707515 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:50:50.707496 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354\": container with ID starting with 0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354 not found: ID does not exist" containerID="0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354" Jun 11 16:50:50.707585 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.707524 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354"} err="failed to get container status \"0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354\": rpc error: code = NotFound desc = could not find container \"0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354\": container with ID starting with 0777de4f5c72d11afd3c50971cfb8937e67ad3e5e385564ac81a0b0f00856354 not found: ID does not exist" Jun 11 16:50:50.718176 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.718149 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76ccdb5cc4-rlq97"] Jun 11 16:50:50.722469 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:50.722440 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76ccdb5cc4-rlq97"] Jun 11 16:50:51.698322 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:50:51.698285 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" path="/var/lib/kubelet/pods/c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a/volumes" Jun 11 16:51:07.734734 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:51:07.734705 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:51:07.741243 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:51:07.741222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:52:21.920076 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:21.920034 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-2rqnz"] Jun 11 16:52:21.920712 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:21.920334 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" podUID="7fef2730-eb47-4b87-a8cc-26579ff5bb28" containerName="manager" containerID="cri-o://ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d" gracePeriod=30 Jun 11 16:52:22.172647 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.172580 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:52:22.251500 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.251469 2565 generic.go:356] "Generic (PLEG): container finished" podID="7fef2730-eb47-4b87-a8cc-26579ff5bb28" containerID="ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d" exitCode=0 Jun 11 16:52:22.251705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.251517 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" Jun 11 16:52:22.251705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.251565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" event={"ID":"7fef2730-eb47-4b87-a8cc-26579ff5bb28","Type":"ContainerDied","Data":"ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d"} Jun 11 16:52:22.251705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.251619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f9fb47fc-2rqnz" event={"ID":"7fef2730-eb47-4b87-a8cc-26579ff5bb28","Type":"ContainerDied","Data":"4249e6ba5c815edc6fa26fbeff216360a7b2fa34bf207db9a0abf53e595774c0"} Jun 11 16:52:22.251705 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.251651 2565 scope.go:117] "RemoveContainer" containerID="ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d" Jun 11 16:52:22.260665 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.260644 2565 scope.go:117] "RemoveContainer" containerID="ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d" Jun 11 16:52:22.260953 ip-10-0-129-139 kubenswrapper[2565]: E0611 16:52:22.260934 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d\": container with ID starting with ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d not found: ID does not exist" containerID="ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d" Jun 11 16:52:22.261016 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.260964 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d"} err="failed to get container status \"ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d\": rpc error: code = NotFound desc = could not find container \"ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d\": container with ID starting with ec48b285cd476b1671ec34176d8183bb58c72a5baddf58c3d3845b202f47db9d not found: ID does not exist" Jun 11 16:52:22.311416 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.311384 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fef2730-eb47-4b87-a8cc-26579ff5bb28-webhook-cert\") pod \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " Jun 11 16:52:22.311629 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.311474 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmg47\" (UniqueName: \"kubernetes.io/projected/7fef2730-eb47-4b87-a8cc-26579ff5bb28-kube-api-access-lmg47\") pod \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\" (UID: \"7fef2730-eb47-4b87-a8cc-26579ff5bb28\") " Jun 11 16:52:22.313508 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.313479 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fef2730-eb47-4b87-a8cc-26579ff5bb28-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7fef2730-eb47-4b87-a8cc-26579ff5bb28" (UID: "7fef2730-eb47-4b87-a8cc-26579ff5bb28"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:52:22.313680 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.313562 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fef2730-eb47-4b87-a8cc-26579ff5bb28-kube-api-access-lmg47" (OuterVolumeSpecName: "kube-api-access-lmg47") pod "7fef2730-eb47-4b87-a8cc-26579ff5bb28" (UID: "7fef2730-eb47-4b87-a8cc-26579ff5bb28"). InnerVolumeSpecName "kube-api-access-lmg47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:22.412314 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.412274 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmg47\" (UniqueName: \"kubernetes.io/projected/7fef2730-eb47-4b87-a8cc-26579ff5bb28-kube-api-access-lmg47\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:52:22.412314 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.412307 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fef2730-eb47-4b87-a8cc-26579ff5bb28-webhook-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:52:22.572603 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.572568 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-2rqnz"] Jun 11 16:52:22.575872 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:22.575843 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-2rqnz"] Jun 11 16:52:23.372621 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.372578 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-bgnsg"] Jun 11 16:52:23.373164 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.373108 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" containerName="authorino" Jun 11 16:52:23.373164 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.373124 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" containerName="authorino" Jun 11 16:52:23.373164 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.373142 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fef2730-eb47-4b87-a8cc-26579ff5bb28" containerName="manager" Jun 11 16:52:23.373164 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.373150 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fef2730-eb47-4b87-a8cc-26579ff5bb28" containerName="manager" Jun 11 16:52:23.373322 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.373225 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fef2730-eb47-4b87-a8cc-26579ff5bb28" containerName="manager" Jun 11 16:52:23.373322 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.373236 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5cff9a5-17a9-4f5e-8d1e-a7db106e8b2a" containerName="authorino" Jun 11 16:52:23.377483 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.377466 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.380250 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.380231 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:52:23.380342 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.380233 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:52:23.380342 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.380233 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ttjp6\"" Jun 11 16:52:23.386120 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.386086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-bgnsg"] Jun 11 16:52:23.524171 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.524130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d09d349-d000-4f36-9913-3ca52ff05853-webhook-cert\") pod \"maas-controller-65f9fb47fc-bgnsg\" (UID: \"4d09d349-d000-4f36-9913-3ca52ff05853\") " pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.524362 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.524185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxbmx\" (UniqueName: \"kubernetes.io/projected/4d09d349-d000-4f36-9913-3ca52ff05853-kube-api-access-vxbmx\") pod \"maas-controller-65f9fb47fc-bgnsg\" (UID: \"4d09d349-d000-4f36-9913-3ca52ff05853\") " pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.624820 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.624723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d09d349-d000-4f36-9913-3ca52ff05853-webhook-cert\") pod \"maas-controller-65f9fb47fc-bgnsg\" (UID: \"4d09d349-d000-4f36-9913-3ca52ff05853\") " pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.624820 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.624772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxbmx\" (UniqueName: \"kubernetes.io/projected/4d09d349-d000-4f36-9913-3ca52ff05853-kube-api-access-vxbmx\") pod \"maas-controller-65f9fb47fc-bgnsg\" (UID: \"4d09d349-d000-4f36-9913-3ca52ff05853\") " pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.627347 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.627311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d09d349-d000-4f36-9913-3ca52ff05853-webhook-cert\") pod \"maas-controller-65f9fb47fc-bgnsg\" (UID: \"4d09d349-d000-4f36-9913-3ca52ff05853\") " pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.633090 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.633048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxbmx\" (UniqueName: \"kubernetes.io/projected/4d09d349-d000-4f36-9913-3ca52ff05853-kube-api-access-vxbmx\") pod \"maas-controller-65f9fb47fc-bgnsg\" (UID: \"4d09d349-d000-4f36-9913-3ca52ff05853\") " pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.689962 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.689925 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:23.697246 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.697215 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fef2730-eb47-4b87-a8cc-26579ff5bb28" path="/var/lib/kubelet/pods/7fef2730-eb47-4b87-a8cc-26579ff5bb28/volumes" Jun 11 16:52:23.825814 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:23.825783 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65f9fb47fc-bgnsg"] Jun 11 16:52:23.828503 ip-10-0-129-139 kubenswrapper[2565]: W0611 16:52:23.828472 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d09d349_d000_4f36_9913_3ca52ff05853.slice/crio-97523c76ab634d468fc4e64f3f02067ad410a2e02378bad99100e728d5c9e617 WatchSource:0}: Error finding container 97523c76ab634d468fc4e64f3f02067ad410a2e02378bad99100e728d5c9e617: Status 404 returned error can't find the container with id 97523c76ab634d468fc4e64f3f02067ad410a2e02378bad99100e728d5c9e617 Jun 11 16:52:24.265325 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:24.265290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" event={"ID":"4d09d349-d000-4f36-9913-3ca52ff05853","Type":"ContainerStarted","Data":"97523c76ab634d468fc4e64f3f02067ad410a2e02378bad99100e728d5c9e617"} Jun 11 16:52:25.273250 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:25.273215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" event={"ID":"4d09d349-d000-4f36-9913-3ca52ff05853","Type":"ContainerStarted","Data":"d55a64fd0126de79781ab89f9ee4b42c5fd4a866022d4f9a40977eae49fdfaf1"} Jun 11 16:52:25.273690 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:25.273281 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:25.304063 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:25.304007 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" podStartSLOduration=1.8560729710000001 podStartE2EDuration="2.303991571s" totalImagesPullingTime="447.9186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:25.301282085 +0000 UTC m=+978.120848708" watchObservedRunningTime="2026-06-11 16:52:25.303991571 +0000 UTC m=+978.123558192" Jun 11 16:52:36.290633 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:36.290594 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65f9fb47fc-bgnsg" Jun 11 16:52:42.338113 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:52:42.338057 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9bccf64d-ds2l2"] Jun 11 16:53:07.358321 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.358258 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b9bccf64d-ds2l2" podUID="4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" containerName="console" containerID="cri-o://2cb2f724347e87fe204181f4ae4a3dc22e08445a5cb0e939cf654ede6a495e89" gracePeriod=15 Jun 11 16:53:07.532268 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.532235 2565 generic.go:356] "Generic (PLEG): container finished" podID="4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" containerID="2cb2f724347e87fe204181f4ae4a3dc22e08445a5cb0e939cf654ede6a495e89" exitCode=0 Jun 11 16:53:07.532430 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.532277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9bccf64d-ds2l2" event={"ID":"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466","Type":"ContainerDied","Data":"2cb2f724347e87fe204181f4ae4a3dc22e08445a5cb0e939cf654ede6a495e89"} Jun 11 16:53:07.616849 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.616778 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:53:07.733357 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733320 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-service-ca\") pod \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " Jun 11 16:53:07.733357 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733357 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-config\") pod \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " Jun 11 16:53:07.733634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733393 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-oauth-serving-cert\") pod \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " Jun 11 16:53:07.733634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733426 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl5qh\" (UniqueName: \"kubernetes.io/projected/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-kube-api-access-cl5qh\") pod \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " Jun 11 16:53:07.733634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733471 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-trusted-ca-bundle\") pod \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " Jun 11 16:53:07.733634 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733593 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-serving-cert\") pod \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " Jun 11 16:53:07.733852 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733638 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-oauth-config\") pod \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\" (UID: \"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466\") " Jun 11 16:53:07.733852 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733760 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-config" (OuterVolumeSpecName: "console-config") pod "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" (UID: "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:07.733961 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733905 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" (UID: "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:07.734010 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733970 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-service-ca" (OuterVolumeSpecName: "service-ca") pod "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" (UID: "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:07.734010 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.733991 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" (UID: "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:07.735779 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.735752 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" (UID: "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:53:07.735863 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.735845 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" (UID: "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:53:07.735912 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.735883 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-kube-api-access-cl5qh" (OuterVolumeSpecName: "kube-api-access-cl5qh") pod "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" (UID: "4390dc5e-8a72-4cde-ad66-0ea6d8d4c466"). InnerVolumeSpecName "kube-api-access-cl5qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:53:07.818096 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.818064 2565 scope.go:117] "RemoveContainer" containerID="2cb2f724347e87fe204181f4ae4a3dc22e08445a5cb0e939cf654ede6a495e89" Jun 11 16:53:07.835304 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.835281 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl5qh\" (UniqueName: \"kubernetes.io/projected/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-kube-api-access-cl5qh\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:53:07.835382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.835307 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-trusted-ca-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:53:07.835382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.835322 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:53:07.835382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.835332 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-oauth-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:53:07.835382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.835341 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-service-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:53:07.835382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.835352 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-console-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:53:07.835382 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:07.835362 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466-oauth-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 16:53:08.538226 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:08.538191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9bccf64d-ds2l2" Jun 11 16:53:08.538226 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:08.538197 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9bccf64d-ds2l2" event={"ID":"4390dc5e-8a72-4cde-ad66-0ea6d8d4c466","Type":"ContainerDied","Data":"62f027c60bc5f2bcbc59585446f67ba1d948469cd896388e4d0d935104bf672c"} Jun 11 16:53:08.567140 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:08.567104 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9bccf64d-ds2l2"] Jun 11 16:53:08.569354 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:08.569333 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b9bccf64d-ds2l2"] Jun 11 16:53:09.697145 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:53:09.697108 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" path="/var/lib/kubelet/pods/4390dc5e-8a72-4cde-ad66-0ea6d8d4c466/volumes" Jun 11 16:56:07.784699 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:56:07.784668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 16:56:07.791186 ip-10-0-129-139 kubenswrapper[2565]: I0611 16:56:07.791165 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 17:01:07.825232 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:01:07.825201 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 17:01:07.831582 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:01:07.831537 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 17:02:29.014163 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.014126 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4"] Jun 11 17:02:29.014739 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.014327 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" podUID="91fa76cc-7f69-4126-8b5a-f310dc1da9ac" containerName="manager" containerID="cri-o://8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9" gracePeriod=10 Jun 11 17:02:29.272435 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.272362 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 17:02:29.312523 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.312480 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-extensions-socket-volume\") pod \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " Jun 11 17:02:29.312736 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.312604 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqwcw\" (UniqueName: \"kubernetes.io/projected/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-kube-api-access-qqwcw\") pod \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\" (UID: \"91fa76cc-7f69-4126-8b5a-f310dc1da9ac\") " Jun 11 17:02:29.312938 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.312911 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "91fa76cc-7f69-4126-8b5a-f310dc1da9ac" (UID: "91fa76cc-7f69-4126-8b5a-f310dc1da9ac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:02:29.315039 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.314997 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-kube-api-access-qqwcw" (OuterVolumeSpecName: "kube-api-access-qqwcw") pod "91fa76cc-7f69-4126-8b5a-f310dc1da9ac" (UID: "91fa76cc-7f69-4126-8b5a-f310dc1da9ac"). InnerVolumeSpecName "kube-api-access-qqwcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:02:29.413745 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.413708 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqwcw\" (UniqueName: \"kubernetes.io/projected/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-kube-api-access-qqwcw\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:02:29.413745 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.413737 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91fa76cc-7f69-4126-8b5a-f310dc1da9ac-extensions-socket-volume\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:02:29.852266 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.852227 2565 generic.go:356] "Generic (PLEG): container finished" podID="91fa76cc-7f69-4126-8b5a-f310dc1da9ac" containerID="8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9" exitCode=0 Jun 11 17:02:29.852466 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.852297 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" Jun 11 17:02:29.852466 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.852310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" event={"ID":"91fa76cc-7f69-4126-8b5a-f310dc1da9ac","Type":"ContainerDied","Data":"8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9"} Jun 11 17:02:29.852466 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.852402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4" event={"ID":"91fa76cc-7f69-4126-8b5a-f310dc1da9ac","Type":"ContainerDied","Data":"7491c626e98efd2f5a6f5749d5d4db33117b5a61c99a683a6088e0c26e0336ad"} Jun 11 17:02:29.852466 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.852427 2565 scope.go:117] "RemoveContainer" containerID="8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9" Jun 11 17:02:29.862161 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.862141 2565 scope.go:117] "RemoveContainer" containerID="8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9" Jun 11 17:02:29.862444 ip-10-0-129-139 kubenswrapper[2565]: E0611 17:02:29.862424 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9\": container with ID starting with 8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9 not found: ID does not exist" containerID="8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9" Jun 11 17:02:29.862490 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.862452 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9"} err="failed to get container status \"8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9\": rpc error: code = NotFound desc = could not find container \"8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9\": container with ID starting with 8eb76160c26d0ee13657a53774779fbee9ce6eec4cad7e6cc7748db14b2449b9 not found: ID does not exist" Jun 11 17:02:29.868198 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.868171 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4"] Jun 11 17:02:29.871622 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:29.871595 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h8hk4"] Jun 11 17:02:31.697011 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:02:31.696977 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91fa76cc-7f69-4126-8b5a-f310dc1da9ac" path="/var/lib/kubelet/pods/91fa76cc-7f69-4126-8b5a-f310dc1da9ac/volumes" Jun 11 17:03:35.168244 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.168203 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl"] Jun 11 17:03:35.168839 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.168792 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fa76cc-7f69-4126-8b5a-f310dc1da9ac" containerName="manager" Jun 11 17:03:35.168839 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.168814 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fa76cc-7f69-4126-8b5a-f310dc1da9ac" containerName="manager" Jun 11 17:03:35.168839 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.168837 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" containerName="console" Jun 11 17:03:35.169011 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.168846 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" containerName="console" Jun 11 17:03:35.169011 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.168957 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4390dc5e-8a72-4cde-ad66-0ea6d8d4c466" containerName="console" Jun 11 17:03:35.169011 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.168974 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="91fa76cc-7f69-4126-8b5a-f310dc1da9ac" containerName="manager" Jun 11 17:03:35.172069 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.172045 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.174270 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.174248 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-22rsl\"" Jun 11 17:03:35.189701 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.189676 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl"] Jun 11 17:03:35.202288 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.202260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/110e9d9a-9815-49b2-a345-db7df9c29013-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jjshl\" (UID: \"110e9d9a-9815-49b2-a345-db7df9c29013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.202425 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.202294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2pzk\" (UniqueName: \"kubernetes.io/projected/110e9d9a-9815-49b2-a345-db7df9c29013-kube-api-access-w2pzk\") pod \"kuadrant-operator-controller-manager-86878c769f-jjshl\" (UID: \"110e9d9a-9815-49b2-a345-db7df9c29013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.303130 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.303087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/110e9d9a-9815-49b2-a345-db7df9c29013-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jjshl\" (UID: \"110e9d9a-9815-49b2-a345-db7df9c29013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.303331 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.303141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2pzk\" (UniqueName: \"kubernetes.io/projected/110e9d9a-9815-49b2-a345-db7df9c29013-kube-api-access-w2pzk\") pod \"kuadrant-operator-controller-manager-86878c769f-jjshl\" (UID: \"110e9d9a-9815-49b2-a345-db7df9c29013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.303527 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.303502 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/110e9d9a-9815-49b2-a345-db7df9c29013-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jjshl\" (UID: \"110e9d9a-9815-49b2-a345-db7df9c29013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.311884 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.311851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2pzk\" (UniqueName: \"kubernetes.io/projected/110e9d9a-9815-49b2-a345-db7df9c29013-kube-api-access-w2pzk\") pod \"kuadrant-operator-controller-manager-86878c769f-jjshl\" (UID: \"110e9d9a-9815-49b2-a345-db7df9c29013\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.483019 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.482916 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:35.628034 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:35.628006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl"] Jun 11 17:03:35.629979 ip-10-0-129-139 kubenswrapper[2565]: W0611 17:03:35.629952 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod110e9d9a_9815_49b2_a345_db7df9c29013.slice/crio-867250f2c80833eb512dd0dd18dc2485bdf7387c5dc6c57911d4401303380fcc WatchSource:0}: Error finding container 867250f2c80833eb512dd0dd18dc2485bdf7387c5dc6c57911d4401303380fcc: Status 404 returned error can't find the container with id 867250f2c80833eb512dd0dd18dc2485bdf7387c5dc6c57911d4401303380fcc Jun 11 17:03:36.234442 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:36.234403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" event={"ID":"110e9d9a-9815-49b2-a345-db7df9c29013","Type":"ContainerStarted","Data":"eabe8b29838208e2c30f12afaa777728f77a8d23ee5fcd5c13cffd9f3636b753"} Jun 11 17:03:36.234847 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:36.234464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" event={"ID":"110e9d9a-9815-49b2-a345-db7df9c29013","Type":"ContainerStarted","Data":"867250f2c80833eb512dd0dd18dc2485bdf7387c5dc6c57911d4401303380fcc"} Jun 11 17:03:36.234847 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:36.234577 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:03:36.253001 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:36.252940 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" podStartSLOduration=1.252919322 podStartE2EDuration="1.252919322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:03:36.251625632 +0000 UTC m=+1649.071192253" watchObservedRunningTime="2026-06-11 17:03:36.252919322 +0000 UTC m=+1649.072485944" Jun 11 17:03:47.242711 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:03:47.242678 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jjshl" Jun 11 17:06:07.864690 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:06:07.864586 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 17:06:07.871733 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:06:07.871713 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 17:11:07.908381 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:11:07.908272 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 17:11:07.916852 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:11:07.916829 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xbs4x_d6988a27-687d-4721-a899-14b4bf72b6f4/ovn-acl-logging/0.log" Jun 11 17:13:02.894350 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:02.894305 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6"] Jun 11 17:13:02.898216 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:02.898192 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:02.900201 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:02.900173 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4a8a68e7-openshift-default-dockercfg-tjbwn\"" Jun 11 17:13:02.918856 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:02.918821 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6"] Jun 11 17:13:03.032191 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-podinfo\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032402 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-data\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032402 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-envoy\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032567 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtjj4\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-kube-api-access-vtjj4\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032634 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-socket\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032634 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-credential-socket\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032743 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-token\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032804 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-certs\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.032867 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.032805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istiod-ca-cert\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.133731 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-socket\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.133731 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-credential-socket\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.133996 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-token\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.133996 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-certs\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.133996 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istiod-ca-cert\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.133996 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-podinfo\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.133996 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-data\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.134283 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.133967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-envoy\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.134283 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.134150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtjj4\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-kube-api-access-vtjj4\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.134283 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.134227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-credential-socket\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.134575 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.134527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-socket\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.134788 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.134762 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istiod-ca-cert\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.134953 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.134923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-certs\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.135027 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.134944 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-data\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.136499 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.136479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-envoy\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.137050 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.137025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-podinfo\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.141680 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.141657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-token\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.141854 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.141835 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtjj4\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-kube-api-access-vtjj4\") pod \"e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.209781 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.209680 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:03.362824 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.362790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6"] Jun 11 17:13:03.364995 ip-10-0-129-139 kubenswrapper[2565]: W0611 17:13:03.364961 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab590cc_f0ef_4033_bee9_2d0499f0add0.slice/crio-47f1909b88e235057ba9f17a749479725e7070fd6904728d5aba6a689a19ffe6 WatchSource:0}: Error finding container 47f1909b88e235057ba9f17a749479725e7070fd6904728d5aba6a689a19ffe6: Status 404 returned error can't find the container with id 47f1909b88e235057ba9f17a749479725e7070fd6904728d5aba6a689a19ffe6 Jun 11 17:13:03.367398 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.367366 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 17:13:03.367486 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.367430 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 17:13:03.367486 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.367482 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 17:13:03.585717 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.585667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" event={"ID":"4ab590cc-f0ef-4033-bee9-2d0499f0add0","Type":"ContainerStarted","Data":"d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8"} Jun 11 17:13:03.585916 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.585751 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" event={"ID":"4ab590cc-f0ef-4033-bee9-2d0499f0add0","Type":"ContainerStarted","Data":"47f1909b88e235057ba9f17a749479725e7070fd6904728d5aba6a689a19ffe6"} Jun 11 17:13:03.608379 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:03.608315 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" podStartSLOduration=1.60829163 podStartE2EDuration="1.60829163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:13:03.60424996 +0000 UTC m=+2216.423816583" watchObservedRunningTime="2026-06-11 17:13:03.60829163 +0000 UTC m=+2216.427858253" Jun 11 17:13:04.210642 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:04.210587 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:04.216692 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:04.216660 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:04.592173 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:04.592136 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:04.592992 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:04.592973 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:09.369278 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:09.369237 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6"] Jun 11 17:13:09.369797 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:09.369432 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" podUID="4ab590cc-f0ef-4033-bee9-2d0499f0add0" containerName="istio-proxy" containerID="cri-o://d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8" gracePeriod=30 Jun 11 17:13:14.633239 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.633134 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:14.654732 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.654691 2565 generic.go:356] "Generic (PLEG): container finished" podID="4ab590cc-f0ef-4033-bee9-2d0499f0add0" containerID="d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8" exitCode=0 Jun 11 17:13:14.654905 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.654739 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" Jun 11 17:13:14.654905 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.654772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" event={"ID":"4ab590cc-f0ef-4033-bee9-2d0499f0add0","Type":"ContainerDied","Data":"d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8"} Jun 11 17:13:14.654905 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.654831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6" event={"ID":"4ab590cc-f0ef-4033-bee9-2d0499f0add0","Type":"ContainerDied","Data":"47f1909b88e235057ba9f17a749479725e7070fd6904728d5aba6a689a19ffe6"} Jun 11 17:13:14.654905 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.654855 2565 scope.go:117] "RemoveContainer" containerID="d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8" Jun 11 17:13:14.664496 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.664474 2565 scope.go:117] "RemoveContainer" containerID="d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8" Jun 11 17:13:14.664861 ip-10-0-129-139 kubenswrapper[2565]: E0611 17:13:14.664832 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8\": container with ID starting with d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8 not found: ID does not exist" containerID="d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8" Jun 11 17:13:14.664965 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.664868 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8"} err="failed to get container status \"d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8\": rpc error: code = NotFound desc = could not find container \"d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8\": container with ID starting with d41f225a9c9d9718c07430fcb5f77d6c60b1c353db8c2249ed1539c5e789f3f8 not found: ID does not exist" Jun 11 17:13:14.750140 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750108 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-podinfo\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750140 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750147 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtjj4\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-kube-api-access-vtjj4\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750398 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750172 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-credential-socket\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750398 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750201 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-socket\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750398 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750227 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istiod-ca-cert\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750398 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750287 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-token\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750398 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750321 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-data\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750398 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750395 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-envoy\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750725 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750443 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-certs\") pod \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\" (UID: \"4ab590cc-f0ef-4033-bee9-2d0499f0add0\") " Jun 11 17:13:14.750725 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750514 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:14.750725 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750557 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:14.750886 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750854 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-credential-socket\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.750886 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750875 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-socket\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.751013 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750888 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:14.751013 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.750924 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:13:14.751259 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.751232 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:14.752511 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.752486 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-kube-api-access-vtjj4" (OuterVolumeSpecName: "kube-api-access-vtjj4") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "kube-api-access-vtjj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:13:14.752802 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.752781 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 17:13:14.753068 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.753017 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:14.753225 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.753204 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ab590cc-f0ef-4033-bee9-2d0499f0add0" (UID: "4ab590cc-f0ef-4033-bee9-2d0499f0add0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:13:14.851534 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.851503 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-envoy\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.851534 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.851527 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-workload-certs\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.851534 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.851537 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-podinfo\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.851534 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.851562 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtjj4\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-kube-api-access-vtjj4\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.851922 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.851572 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istiod-ca-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.851922 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.851580 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-token\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.851922 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.851588 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab590cc-f0ef-4033-bee9-2d0499f0add0-istio-data\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:14.978874 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.978834 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6"] Jun 11 17:13:14.983568 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:14.983512 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4a8a68e7-openshift-default-689b9496f8-l6qb6"] Jun 11 17:13:15.620741 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.620700 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2"] Jun 11 17:13:15.621707 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.621674 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab590cc-f0ef-4033-bee9-2d0499f0add0" containerName="istio-proxy" Jun 11 17:13:15.621707 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.621708 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab590cc-f0ef-4033-bee9-2d0499f0add0" containerName="istio-proxy" Jun 11 17:13:15.621891 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.621838 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab590cc-f0ef-4033-bee9-2d0499f0add0" containerName="istio-proxy" Jun 11 17:13:15.625732 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.625701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.627793 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.627770 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-35375937-openshift-default-dockercfg-5m9rw\"" Jun 11 17:13:15.653047 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.653016 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2"] Jun 11 17:13:15.697614 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.697577 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab590cc-f0ef-4033-bee9-2d0499f0add0" path="/var/lib/kubelet/pods/4ab590cc-f0ef-4033-bee9-2d0499f0add0/volumes" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.758841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-token\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.758909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istiod-ca-cert\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.759022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-envoy\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.759053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq6jb\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-kube-api-access-fq6jb\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.759135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-podinfo\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.759216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-socket\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.759261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-credential-socket\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.759295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-certs\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.759721 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.759362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-data\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863121 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-token\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863324 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istiod-ca-cert\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863324 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-envoy\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863324 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq6jb\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-kube-api-access-fq6jb\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863324 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-podinfo\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863324 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-socket\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863643 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-credential-socket\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863643 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-certs\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863643 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-data\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.863975 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.863953 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-data\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.864063 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.864041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-socket\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.864338 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.864307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-certs\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.864453 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.864356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-credential-socket\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.864453 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.864445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istiod-ca-cert\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.866654 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.866633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-envoy\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.866871 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.866853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-podinfo\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.873156 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.873084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq6jb\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-kube-api-access-fq6jb\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.873156 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.873135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-token\") pod \"e2e-ait-35375937-openshift-default-7db5548874-bjkw2\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:15.953277 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:15.953237 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:16.110582 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.110535 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2"] Jun 11 17:13:16.112371 ip-10-0-129-139 kubenswrapper[2565]: W0611 17:13:16.112343 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4252d5_705c_4648_be9e_e9375cb4b4c8.slice/crio-4cc2a05fc9ead1dae232de9c748ee6abf14b559f88a1aa7f50cde197b12ca9a4 WatchSource:0}: Error finding container 4cc2a05fc9ead1dae232de9c748ee6abf14b559f88a1aa7f50cde197b12ca9a4: Status 404 returned error can't find the container with id 4cc2a05fc9ead1dae232de9c748ee6abf14b559f88a1aa7f50cde197b12ca9a4 Jun 11 17:13:16.115087 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.115054 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 17:13:16.115159 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.115138 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 17:13:16.115204 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.115175 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 17:13:16.671869 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.671826 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" event={"ID":"ed4252d5-705c-4648-be9e-e9375cb4b4c8","Type":"ContainerStarted","Data":"1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac"} Jun 11 17:13:16.672368 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.671893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" event={"ID":"ed4252d5-705c-4648-be9e-e9375cb4b4c8","Type":"ContainerStarted","Data":"4cc2a05fc9ead1dae232de9c748ee6abf14b559f88a1aa7f50cde197b12ca9a4"} Jun 11 17:13:16.691691 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.691625 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" podStartSLOduration=1.6916090590000001 podStartE2EDuration="1.691609059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:13:16.689003732 +0000 UTC m=+2229.508570355" watchObservedRunningTime="2026-06-11 17:13:16.691609059 +0000 UTC m=+2229.511175680" Jun 11 17:13:16.953927 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:16.953839 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:17.958603 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:17.958573 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:18.683442 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:18.683411 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:18.684340 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:18.684320 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:23.047497 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:23.047395 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2"] Jun 11 17:13:23.048058 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:23.047640 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" podUID="ed4252d5-705c-4648-be9e-e9375cb4b4c8" containerName="istio-proxy" containerID="cri-o://1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac" gracePeriod=30 Jun 11 17:13:28.300112 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.300081 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:28.482970 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.482868 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-credential-socket\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.482970 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.482924 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq6jb\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-kube-api-access-fq6jb\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483211 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.482971 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-data\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483211 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.482998 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-podinfo\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483211 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483035 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-token\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483211 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483057 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-envoy\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483211 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483089 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-socket\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483211 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483159 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istiod-ca-cert\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483211 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483184 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-certs\") pod \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\" (UID: \"ed4252d5-705c-4648-be9e-e9375cb4b4c8\") " Jun 11 17:13:28.483595 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483207 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:28.483595 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483360 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:28.483595 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483399 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:28.483595 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483518 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-data\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.483595 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483581 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-socket\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.483595 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483598 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-credential-socket\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.483849 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483617 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:28.483849 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.483801 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:13:28.485426 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.485387 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:13:28.485540 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.485456 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 17:13:28.485743 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.485713 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:13:28.485823 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.485772 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-kube-api-access-fq6jb" (OuterVolumeSpecName: "kube-api-access-fq6jb") pod "ed4252d5-705c-4648-be9e-e9375cb4b4c8" (UID: "ed4252d5-705c-4648-be9e-e9375cb4b4c8"). InnerVolumeSpecName "kube-api-access-fq6jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:13:28.584083 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.584043 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istiod-ca-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.584083 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.584074 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-workload-certs\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.584083 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.584085 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq6jb\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-kube-api-access-fq6jb\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.584083 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.584094 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-podinfo\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.584366 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.584103 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-token\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.584366 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.584113 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed4252d5-705c-4648-be9e-e9375cb4b4c8-istio-envoy\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 11 17:13:28.742091 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.741990 2565 generic.go:356] "Generic (PLEG): container finished" podID="ed4252d5-705c-4648-be9e-e9375cb4b4c8" containerID="1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac" exitCode=0 Jun 11 17:13:28.742091 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.742038 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" Jun 11 17:13:28.742091 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.742069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" event={"ID":"ed4252d5-705c-4648-be9e-e9375cb4b4c8","Type":"ContainerDied","Data":"1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac"} Jun 11 17:13:28.742401 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.742126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2" event={"ID":"ed4252d5-705c-4648-be9e-e9375cb4b4c8","Type":"ContainerDied","Data":"4cc2a05fc9ead1dae232de9c748ee6abf14b559f88a1aa7f50cde197b12ca9a4"} Jun 11 17:13:28.742401 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.742149 2565 scope.go:117] "RemoveContainer" containerID="1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac" Jun 11 17:13:28.754706 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.754615 2565 scope.go:117] "RemoveContainer" containerID="1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac" Jun 11 17:13:28.755178 ip-10-0-129-139 kubenswrapper[2565]: E0611 17:13:28.755157 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac\": container with ID starting with 1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac not found: ID does not exist" containerID="1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac" Jun 11 17:13:28.755254 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.755188 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac"} err="failed to get container status \"1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac\": rpc error: code = NotFound desc = could not find container \"1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac\": container with ID starting with 1b26c1d37c5adc81f04e396bce79b8e17d4ddacf435cee47979965ded933baac not found: ID does not exist" Jun 11 17:13:28.764749 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.764721 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2"] Jun 11 17:13:28.771956 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:28.771935 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-35375937-openshift-default-7db5548874-bjkw2"] Jun 11 17:13:29.697783 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:29.697747 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed4252d5-705c-4648-be9e-e9375cb4b4c8" path="/var/lib/kubelet/pods/ed4252d5-705c-4648-be9e-e9375cb4b4c8/volumes" Jun 11 17:13:35.441182 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:35.441142 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c4bb85fd7-l5mlh_4aa14b4b-f999-42ef-b1b9-3092c57a3aa9/authorino/0.log" Jun 11 17:13:39.976607 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:39.976570 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b5dc76f67-lgpcb_8bdcba2c-4af6-440e-925f-b7e2303f03e1/nginx/0.log" Jun 11 17:13:40.319109 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:40.319069 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-574c5779df-4sscg_7707d200-16fe-49b9-96fe-acc560b2b966/maas-api/0.log" Jun 11 17:13:40.553681 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:40.553650 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65f9fb47fc-bgnsg_4d09d349-d000-4f36-9913-3ca52ff05853/manager/0.log" Jun 11 17:13:41.012484 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:41.012452 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54b9969b5c-jpbqs_621b1853-b2ff-4523-b1f5-9661c7df7e45/copy-manifests/0.log" Jun 11 17:13:41.019189 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:41.019162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54b9969b5c-jpbqs_621b1853-b2ff-4523-b1f5-9661c7df7e45/manager/0.log" Jun 11 17:13:42.027172 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.027144 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7_d599946a-1eb8-4bbe-8cb9-d666a0667ab0/util/0.log" Jun 11 17:13:42.033142 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.033112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7_d599946a-1eb8-4bbe-8cb9-d666a0667ab0/pull/0.log" Jun 11 17:13:42.038678 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.038658 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7_d599946a-1eb8-4bbe-8cb9-d666a0667ab0/extract/0.log" Jun 11 17:13:42.153603 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.153571 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss_1557467c-080a-479f-abcb-2ff5b9bd7a44/util/0.log" Jun 11 17:13:42.159368 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.159332 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss_1557467c-080a-479f-abcb-2ff5b9bd7a44/pull/0.log" Jun 11 17:13:42.164580 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.164561 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss_1557467c-080a-479f-abcb-2ff5b9bd7a44/extract/0.log" Jun 11 17:13:42.275350 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.275316 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t_c3c2f43e-8a50-481e-83bd-3c20c09ce0a9/extract/0.log" Jun 11 17:13:42.280954 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.280883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t_c3c2f43e-8a50-481e-83bd-3c20c09ce0a9/util/0.log" Jun 11 17:13:42.286655 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.286624 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t_c3c2f43e-8a50-481e-83bd-3c20c09ce0a9/pull/0.log" Jun 11 17:13:42.397459 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.397429 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl_2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad/util/0.log" Jun 11 17:13:42.404173 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.404147 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl_2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad/pull/0.log" Jun 11 17:13:42.410405 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.410382 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl_2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad/extract/0.log" Jun 11 17:13:42.535920 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.535820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c4bb85fd7-l5mlh_4aa14b4b-f999-42ef-b1b9-3092c57a3aa9/authorino/0.log" Jun 11 17:13:42.662901 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:42.662861 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hmf9s_ec121bea-250b-4cc9-ac80-39e70b25a1e2/manager/0.log" Jun 11 17:13:43.005966 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:43.005932 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n7hgw_d91f3b60-260d-4b44-8c33-5e522f368efd/registry-server/0.log" Jun 11 17:13:43.140190 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:43.140149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jjshl_110e9d9a-9815-49b2-a345-db7df9c29013/manager/0.log" Jun 11 17:13:43.712256 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:43.712228 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mll6n_f7c18360-eca1-4ef2-a276-1165d5808d13/istio-proxy/0.log" Jun 11 17:13:44.174562 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:44.174512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fd7hp_f974f8ec-5287-4ae6-841f-4c8505ef6d2b/istio-proxy/1.log" Jun 11 17:13:44.411486 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:44.411454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dq4g2_2f626926-192c-4ac7-a6da-ee6808a6832d/payload-processing/0.log" Jun 11 17:13:44.978813 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:44.978784 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-g8s7f_dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2/storage-initializer/0.log" Jun 11 17:13:44.987355 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:44.987331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-g8s7f_dd411789-fa86-4a0d-a9a3-7fdb7f7d50a2/main/0.log" Jun 11 17:13:45.335413 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:45.335374 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp_570b87ae-2da0-4648-afcb-6d7cc54ee3d5/storage-initializer/0.log" Jun 11 17:13:45.342494 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:45.342458 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4l6rp_570b87ae-2da0-4648-afcb-6d7cc54ee3d5/main/0.log" Jun 11 17:13:52.342232 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:52.342198 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bp9d4_30f045c6-2e71-4b56-87d6-fa2a8146e250/global-pull-secret-syncer/0.log" Jun 11 17:13:52.458876 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:52.458829 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-czlvh_247ee0c0-0da2-4ea8-bb98-0d5c7dffbdf0/konnectivity-agent/0.log" Jun 11 17:13:52.511596 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:52.511565 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-139.ec2.internal_33e4799e2cf9d90f29ee83bae71e9e5d/haproxy/0.log" Jun 11 17:13:56.912488 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:56.912450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-qfs94_6c8c5fc9-991b-4d43-9f7e-662e03ddaf9f/sail-operator/0.log" Jun 11 17:13:57.708870 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.708823 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7_d599946a-1eb8-4bbe-8cb9-d666a0667ab0/extract/0.log" Jun 11 17:13:57.732076 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.732045 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7_d599946a-1eb8-4bbe-8cb9-d666a0667ab0/util/0.log" Jun 11 17:13:57.752238 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.752206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqxx7_d599946a-1eb8-4bbe-8cb9-d666a0667ab0/pull/0.log" Jun 11 17:13:57.777140 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.777101 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss_1557467c-080a-479f-abcb-2ff5b9bd7a44/extract/0.log" Jun 11 17:13:57.797655 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.797618 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss_1557467c-080a-479f-abcb-2ff5b9bd7a44/util/0.log" Jun 11 17:13:57.817306 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.817276 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05kmss_1557467c-080a-479f-abcb-2ff5b9bd7a44/pull/0.log" Jun 11 17:13:57.841717 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.841684 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t_c3c2f43e-8a50-481e-83bd-3c20c09ce0a9/extract/0.log" Jun 11 17:13:57.863002 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.862973 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t_c3c2f43e-8a50-481e-83bd-3c20c09ce0a9/util/0.log" Jun 11 17:13:57.883276 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.883246 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9n7t_c3c2f43e-8a50-481e-83bd-3c20c09ce0a9/pull/0.log" Jun 11 17:13:57.908757 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.908725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl_2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad/extract/0.log" Jun 11 17:13:57.932799 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.932768 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl_2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad/util/0.log" Jun 11 17:13:57.952932 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:57.952903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qpjzl_2e0fbffd-e71c-4bc4-b6a5-7daa117ccdad/pull/0.log" Jun 11 17:13:58.393459 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:58.393424 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c4bb85fd7-l5mlh_4aa14b4b-f999-42ef-b1b9-3092c57a3aa9/authorino/0.log" Jun 11 17:13:58.425207 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:58.425162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hmf9s_ec121bea-250b-4cc9-ac80-39e70b25a1e2/manager/0.log" Jun 11 17:13:58.523563 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:58.523519 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n7hgw_d91f3b60-260d-4b44-8c33-5e522f368efd/registry-server/0.log" Jun 11 17:13:58.634508 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:13:58.634473 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jjshl_110e9d9a-9815-49b2-a345-db7df9c29013/manager/0.log" Jun 11 17:14:00.409947 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.409915 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-wfzqb_ba109950-8f19-48c7-9a72-62a18a155f96/kube-state-metrics/0.log" Jun 11 17:14:00.427961 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.427931 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-wfzqb_ba109950-8f19-48c7-9a72-62a18a155f96/kube-rbac-proxy-main/0.log" Jun 11 17:14:00.447570 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.447522 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-wfzqb_ba109950-8f19-48c7-9a72-62a18a155f96/kube-rbac-proxy-self/0.log" Jun 11 17:14:00.634387 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.634320 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kck2f_ef07157f-8307-4a3c-a231-cd1bb32bc193/node-exporter/0.log" Jun 11 17:14:00.653517 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.653489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kck2f_ef07157f-8307-4a3c-a231-cd1bb32bc193/kube-rbac-proxy/0.log" Jun 11 17:14:00.673300 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.673232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kck2f_ef07157f-8307-4a3c-a231-cd1bb32bc193/init-textfile/0.log" Jun 11 17:14:00.785880 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.785844 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n68cz_2268c4fb-6076-4fcb-ac33-53fe6358119f/kube-rbac-proxy-main/0.log" Jun 11 17:14:00.808612 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.808576 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n68cz_2268c4fb-6076-4fcb-ac33-53fe6358119f/kube-rbac-proxy-self/0.log" Jun 11 17:14:00.834613 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:00.834583 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n68cz_2268c4fb-6076-4fcb-ac33-53fe6358119f/openshift-state-metrics/0.log" Jun 11 17:14:01.144693 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:01.144658 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-57vdf_47596fdb-946d-41d3-a1a9-c627dcbeb70e/prometheus-operator-admission-webhook/0.log" Jun 11 17:14:01.181861 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:01.181820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d75f9c959-b8vz5_401abedd-05d9-440c-9a91-5cb3ba1d1709/telemeter-client/0.log" Jun 11 17:14:01.202867 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:01.202831 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d75f9c959-b8vz5_401abedd-05d9-440c-9a91-5cb3ba1d1709/reload/0.log" Jun 11 17:14:01.229564 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:01.229503 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d75f9c959-b8vz5_401abedd-05d9-440c-9a91-5cb3ba1d1709/kube-rbac-proxy/0.log" Jun 11 17:14:04.293563 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.293511 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n"] Jun 11 17:14:04.293944 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.293930 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4252d5-705c-4648-be9e-e9375cb4b4c8" containerName="istio-proxy" Jun 11 17:14:04.293944 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.293943 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4252d5-705c-4648-be9e-e9375cb4b4c8" containerName="istio-proxy" Jun 11 17:14:04.294018 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.294013 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed4252d5-705c-4648-be9e-e9375cb4b4c8" containerName="istio-proxy" Jun 11 17:14:04.297653 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.297635 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.299769 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.299746 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hf7ch\"/\"openshift-service-ca.crt\"" Jun 11 17:14:04.300432 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.300403 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hf7ch\"/\"default-dockercfg-zwkbk\"" Jun 11 17:14:04.300592 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.300504 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hf7ch\"/\"kube-root-ca.crt\"" Jun 11 17:14:04.304585 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.304558 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n"] Jun 11 17:14:04.397579 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.397512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d9f2\" (UniqueName: \"kubernetes.io/projected/2b9130aa-58a9-4337-a880-e1aef85076fe-kube-api-access-2d9f2\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.397579 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.397574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-podres\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.397814 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.397626 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-sys\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.397814 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.397719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-proc\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.397814 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.397747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-lib-modules\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498579 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-proc\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498579 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-lib-modules\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498827 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-proc\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498827 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d9f2\" (UniqueName: \"kubernetes.io/projected/2b9130aa-58a9-4337-a880-e1aef85076fe-kube-api-access-2d9f2\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498827 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-podres\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498827 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-lib-modules\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498827 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-sys\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.498827 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498826 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-sys\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.499117 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.498841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b9130aa-58a9-4337-a880-e1aef85076fe-podres\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.506626 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.506592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d9f2\" (UniqueName: \"kubernetes.io/projected/2b9130aa-58a9-4337-a880-e1aef85076fe-kube-api-access-2d9f2\") pod \"perf-node-gather-daemonset-2jb9n\" (UID: \"2b9130aa-58a9-4337-a880-e1aef85076fe\") " pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.610456 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.610418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.749867 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.749833 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n"] Jun 11 17:14:04.751820 ip-10-0-129-139 kubenswrapper[2565]: W0611 17:14:04.751789 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b9130aa_58a9_4337_a880_e1aef85076fe.slice/crio-52d0a5d201408c96373444910fc25101ea1cf90ac00db62df5dde8cc3e840c73 WatchSource:0}: Error finding container 52d0a5d201408c96373444910fc25101ea1cf90ac00db62df5dde8cc3e840c73: Status 404 returned error can't find the container with id 52d0a5d201408c96373444910fc25101ea1cf90ac00db62df5dde8cc3e840c73 Jun 11 17:14:04.957016 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.956980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" event={"ID":"2b9130aa-58a9-4337-a880-e1aef85076fe","Type":"ContainerStarted","Data":"e3fec265e954e31aba803056267716c7b1bf57ae3cf0779a9012e64b86f2f2d8"} Jun 11 17:14:04.957212 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.957031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" event={"ID":"2b9130aa-58a9-4337-a880-e1aef85076fe","Type":"ContainerStarted","Data":"52d0a5d201408c96373444910fc25101ea1cf90ac00db62df5dde8cc3e840c73"} Jun 11 17:14:04.957212 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.957114 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:04.975738 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:04.975679 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" podStartSLOduration=0.975659283 podStartE2EDuration="975.659283ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:14:04.972342782 +0000 UTC m=+2277.791909403" watchObservedRunningTime="2026-06-11 17:14:04.975659283 +0000 UTC m=+2277.795225906" Jun 11 17:14:05.821165 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:05.821132 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9k5pp_15fc930d-a7d5-4bef-9285-ce202924c91f/dns/0.log" Jun 11 17:14:05.839648 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:05.839617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9k5pp_15fc930d-a7d5-4bef-9285-ce202924c91f/kube-rbac-proxy/0.log" Jun 11 17:14:05.953938 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:05.953909 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p79f5_035eab56-2e83-4307-b49c-517b6622e9fa/dns-node-resolver/0.log" Jun 11 17:14:06.491802 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:06.491756 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74b8f78666-vz9ww_faedc788-7532-4777-93ac-dd369a39e12c/registry/0.log" Jun 11 17:14:06.536968 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:06.536930 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-48xp7_cfd99b7b-a943-4ad7-a8bb-aba85c971226/node-ca/0.log" Jun 11 17:14:07.503754 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:07.503719 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mll6n_f7c18360-eca1-4ef2-a276-1165d5808d13/istio-proxy/0.log" Jun 11 17:14:07.644643 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:07.644602 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fd7hp_f974f8ec-5287-4ae6-841f-4c8505ef6d2b/istio-proxy/0.log" Jun 11 17:14:07.708650 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:07.708617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fd7hp_f974f8ec-5287-4ae6-841f-4c8505ef6d2b/istio-proxy/1.log" Jun 11 17:14:07.839562 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:07.839508 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dq4g2_2f626926-192c-4ac7-a6da-ee6808a6832d/payload-processing/0.log" Jun 11 17:14:08.529960 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:08.529929 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsfwx_db64fbfb-5cdc-4090-ae8f-77f17fdfbe92/serve-healthcheck-canary/0.log" Jun 11 17:14:09.101814 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:09.101782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vp7n_1e437f1e-aa4d-495b-bea8-6c5af1a59bd0/kube-rbac-proxy/0.log" Jun 11 17:14:09.121803 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:09.121775 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vp7n_1e437f1e-aa4d-495b-bea8-6c5af1a59bd0/exporter/0.log" Jun 11 17:14:09.142539 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:09.142510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vp7n_1e437f1e-aa4d-495b-bea8-6c5af1a59bd0/extractor/0.log" Jun 11 17:14:10.973775 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:10.973746 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hf7ch/perf-node-gather-daemonset-2jb9n" Jun 11 17:14:11.488417 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:11.488385 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b5dc76f67-lgpcb_8bdcba2c-4af6-440e-925f-b7e2303f03e1/nginx/0.log" Jun 11 17:14:11.632578 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:11.632527 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-574c5779df-4sscg_7707d200-16fe-49b9-96fe-acc560b2b966/maas-api/0.log" Jun 11 17:14:11.769387 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:11.769279 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65f9fb47fc-bgnsg_4d09d349-d000-4f36-9913-3ca52ff05853/manager/0.log" Jun 11 17:14:11.900843 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:11.900812 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54b9969b5c-jpbqs_621b1853-b2ff-4523-b1f5-9661c7df7e45/manager/0.log" Jun 11 17:14:11.922808 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:11.922780 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54b9969b5c-jpbqs_621b1853-b2ff-4523-b1f5-9661c7df7e45/copy-manifests/0.log" Jun 11 17:14:13.807121 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:13.807092 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-555c946c64-t7wbd_8cbf1598-7489-44d7-9fb5-78bda2123b20/manager/0.log" Jun 11 17:14:13.837416 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:13.837386 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4zr8h_59b90108-142a-45d2-9bbc-2d04cce0892a/openshift-lws-operator/0.log" Jun 11 17:14:18.668939 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:18.668905 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mll6n_f7c18360-eca1-4ef2-a276-1165d5808d13/istio-proxy/0.log" Jun 11 17:14:18.771522 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:18.771492 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fd7hp_f974f8ec-5287-4ae6-841f-4c8505ef6d2b/istio-proxy/0.log" Jun 11 17:14:18.833709 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:18.833666 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fd7hp_f974f8ec-5287-4ae6-841f-4c8505ef6d2b/istio-proxy/1.log" Jun 11 17:14:18.941416 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:18.941321 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dq4g2_2f626926-192c-4ac7-a6da-ee6808a6832d/payload-processing/0.log" Jun 11 17:14:20.089937 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:20.089904 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mll6n_f7c18360-eca1-4ef2-a276-1165d5808d13/istio-proxy/0.log" Jun 11 17:14:20.203857 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:20.203818 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fd7hp_f974f8ec-5287-4ae6-841f-4c8505ef6d2b/istio-proxy/0.log" Jun 11 17:14:20.269728 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:20.269466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-fd7hp_f974f8ec-5287-4ae6-841f-4c8505ef6d2b/istio-proxy/1.log" Jun 11 17:14:20.380759 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:20.380650 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dq4g2_2f626926-192c-4ac7-a6da-ee6808a6832d/payload-processing/0.log" Jun 11 17:14:21.202231 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.202200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q844p_c08f7c43-1ca5-4a1e-b463-53f71efe452b/kube-multus-additional-cni-plugins/0.log" Jun 11 17:14:21.221491 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.221459 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q844p_c08f7c43-1ca5-4a1e-b463-53f71efe452b/egress-router-binary-copy/0.log" Jun 11 17:14:21.240779 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.240748 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q844p_c08f7c43-1ca5-4a1e-b463-53f71efe452b/cni-plugins/0.log" Jun 11 17:14:21.259386 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.259361 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q844p_c08f7c43-1ca5-4a1e-b463-53f71efe452b/bond-cni-plugin/0.log" Jun 11 17:14:21.278096 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.278069 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q844p_c08f7c43-1ca5-4a1e-b463-53f71efe452b/routeoverride-cni/0.log" Jun 11 17:14:21.297468 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.297441 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q844p_c08f7c43-1ca5-4a1e-b463-53f71efe452b/whereabouts-cni-bincopy/0.log" Jun 11 17:14:21.316949 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.316914 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q844p_c08f7c43-1ca5-4a1e-b463-53f71efe452b/whereabouts-cni/0.log" Jun 11 17:14:21.387244 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.387207 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jmhkm_2267e07d-322f-4b09-b27c-04bc24ec4d62/kube-multus/0.log" Jun 11 17:14:21.438500 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.438468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ddsx7_ba2c30aa-b038-41d0-baae-a0916f5b459e/network-metrics-daemon/0.log" Jun 11 17:14:21.453580 ip-10-0-129-139 kubenswrapper[2565]: I0611 17:14:21.453480 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ddsx7_ba2c30aa-b038-41d0-baae-a0916f5b459e/kube-rbac-proxy/0.log"