Jun 10 19:47:06.062362 ip-10-0-129-154 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 19:47:06.062371 ip-10-0-129-154 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 19:47:06.062378 ip-10-0-129-154 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 19:47:06.062519 ip-10-0-129-154 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 19:47:16.095028 ip-10-0-129-154 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 19:47:16.095044 ip-10-0-129-154 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot af749c2853454bc09012701f723fa78f -- Jun 10 19:49:45.773636 ip-10-0-129-154 systemd[1]: Starting Kubernetes Kubelet... Jun 10 19:49:46.141925 ip-10-0-129-154 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 19:49:46.141925 ip-10-0-129-154 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 19:49:46.141925 ip-10-0-129-154 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 19:49:46.141925 ip-10-0-129-154 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 19:49:46.141925 ip-10-0-129-154 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 19:49:46.142955 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.142817 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 19:49:46.150302 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150287 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:49:46.150302 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150302 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150306 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150309 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150312 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150315 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150318 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150321 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150324 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150327 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150333 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150336 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150338 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150341 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150344 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150346 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150349 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150352 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150355 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150358 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150360 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:49:46.150376 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150363 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150366 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150368 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150371 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150374 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150376 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150379 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150382 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150385 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150388 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150390 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150393 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150396 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150399 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150401 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150405 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150407 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150409 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150412 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:49:46.150862 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150414 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150417 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150420 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150422 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150425 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150428 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150430 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150432 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150435 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150437 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150440 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150443 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150445 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150448 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150451 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150454 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150457 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150461 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150465 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:49:46.151386 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150468 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150472 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150474 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150477 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150480 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150482 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150485 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150487 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150490 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150492 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150495 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150497 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150500 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150503 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150506 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150509 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150512 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150514 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150516 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150519 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:49:46.151854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150522 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150524 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150527 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150529 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150532 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150534 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150537 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150540 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150543 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150546 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150548 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150551 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150554 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150558 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150562 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150566 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150569 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150572 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150575 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:49:46.152352 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.150577 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151278 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151285 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151288 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151291 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151294 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151297 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151300 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151303 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151306 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151308 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151311 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151314 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151316 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151319 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151322 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151325 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151327 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151330 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151333 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151336 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:49:46.152825 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151339 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151342 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151345 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151347 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151350 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151352 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151355 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151358 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151361 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151363 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151365 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151368 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151372 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151377 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151380 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151383 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151386 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151389 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151392 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:49:46.153350 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151395 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151398 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151400 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151403 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151406 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151409 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151412 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151414 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151418 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151420 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151423 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151425 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151429 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151432 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151434 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151437 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151440 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151443 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151445 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:49:46.153822 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151448 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151450 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151454 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151456 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151459 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151461 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151466 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151469 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151472 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151474 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151476 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151479 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151481 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151484 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151486 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151489 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151492 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151494 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151497 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:49:46.154306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151499 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151503 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151505 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151508 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151510 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151513 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151516 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151519 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151521 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151524 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151527 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151529 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151532 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151535 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151537 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151540 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151543 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151546 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151550 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151553 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:49:46.154811 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151555 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151558 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151914 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151919 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151922 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151925 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151928 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151931 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151933 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151936 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151939 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151941 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151945 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151947 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151950 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151952 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151955 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151958 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151960 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151963 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:49:46.155319 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151966 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151969 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151971 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151974 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151977 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151979 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151982 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151984 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151987 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151992 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151995 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.151998 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152001 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152004 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152006 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152009 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152012 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152015 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152017 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:49:46.155802 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152020 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152022 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152025 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152028 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152030 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152033 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152036 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152039 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152042 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152045 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152047 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152050 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152052 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152055 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152058 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152060 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152063 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152065 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152068 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152070 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:49:46.156306 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152073 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152075 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152078 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152081 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152085 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152088 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152091 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152093 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152096 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152100 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152104 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152107 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152110 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152113 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152116 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152118 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152126 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152129 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152132 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:49:46.156806 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152135 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152137 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152140 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152142 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152145 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152147 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152150 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152153 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152155 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152157 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152160 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152162 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152165 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152167 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152170 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152172 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152175 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152178 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152181 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152183 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:49:46.157507 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152186 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152188 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152191 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152300 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152313 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152319 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152323 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152330 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152335 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152344 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152349 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152352 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152355 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152359 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152363 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152366 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152369 2567 flags.go:64] FLAG: --cgroup-root="" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152373 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152376 2567 flags.go:64] FLAG: --client-ca-file="" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152379 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152382 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152387 2567 flags.go:64] FLAG: --cluster-domain="" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152390 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152393 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 19:49:46.158132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152397 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152400 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152404 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152407 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152410 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152414 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152417 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152420 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152423 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152426 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152430 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152434 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152437 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152440 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152443 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152446 2567 flags.go:64] FLAG: --enable-server="true" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152449 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152454 2567 flags.go:64] FLAG: --event-burst="100" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152457 2567 flags.go:64] FLAG: --event-qps="50" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152460 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152463 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152466 2567 flags.go:64] FLAG: --eviction-hard="" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152470 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152473 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152476 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 19:49:46.158794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152479 2567 flags.go:64] FLAG: --eviction-soft="" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152481 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152484 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152487 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152490 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152492 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152495 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152498 2567 flags.go:64] FLAG: --feature-gates="" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152501 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152504 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152507 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152510 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152513 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152517 2567 flags.go:64] FLAG: --help="false" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152520 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152523 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152525 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152531 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152534 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152538 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152540 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152543 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152546 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 19:49:46.159436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152549 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152552 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152555 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152558 2567 flags.go:64] FLAG: --kube-reserved="" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152561 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152564 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152567 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152570 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152573 2567 flags.go:64] FLAG: --lock-file="" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152583 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152586 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152589 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152594 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152597 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152600 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152603 2567 flags.go:64] FLAG: --logging-format="text" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152606 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152610 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152612 2567 flags.go:64] FLAG: --manifest-url="" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152615 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152619 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152622 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152626 2567 flags.go:64] FLAG: --max-pods="110" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152630 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152633 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 19:49:46.160043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152636 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152640 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152643 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152646 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152649 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152656 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152659 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152662 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152665 2567 flags.go:64] FLAG: --pod-cidr="" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152668 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152673 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152676 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152679 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152682 2567 flags.go:64] FLAG: --port="10250" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152685 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152688 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dfdfedd7c876ee92" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152691 2567 flags.go:64] FLAG: --qos-reserved="" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152694 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152697 2567 flags.go:64] FLAG: --register-node="true" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152700 2567 flags.go:64] FLAG: --register-with-taints="" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152703 2567 flags.go:64] FLAG: --registry-burst="10" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152706 2567 flags.go:64] FLAG: --registry-qps="5" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152709 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152712 2567 flags.go:64] FLAG: --reserved-memory="" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152715 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 19:49:46.160678 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152718 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152721 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152724 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152727 2567 flags.go:64] FLAG: --runonce="false" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152730 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152732 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152736 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152738 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152743 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152746 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152749 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152752 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152755 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152758 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152761 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152763 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152766 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152769 2567 flags.go:64] FLAG: --system-cgroups="" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152772 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152777 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152780 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152783 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152787 2567 flags.go:64] FLAG: --tls-min-version="" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152790 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152792 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 19:49:46.161388 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152795 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152798 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152801 2567 flags.go:64] FLAG: --v="2" Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152805 2567 flags.go:64] FLAG: --version="false" Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152809 2567 flags.go:64] FLAG: --vmodule="" Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152813 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.152816 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152938 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152942 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152944 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152947 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152950 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152953 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152955 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152959 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152963 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152966 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152968 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152973 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152975 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152978 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:49:46.162000 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152980 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152983 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152986 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152989 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152992 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152994 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152997 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.152999 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153002 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153004 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153007 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153010 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153013 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153015 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153018 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153021 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153023 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153026 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153028 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153031 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:49:46.162571 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153034 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153036 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153039 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153041 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153044 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153047 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153051 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153054 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153056 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153060 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153063 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153065 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153068 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153071 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153073 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153076 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153078 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153081 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153083 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:49:46.163064 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153086 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153090 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153094 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153097 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153099 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153102 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153104 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153107 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153109 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153112 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153114 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153118 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153120 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153123 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153125 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153128 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153132 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153135 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153138 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153142 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:49:46.163550 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153145 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153148 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153152 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153155 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153158 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153160 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153163 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153165 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153168 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153171 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153173 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153176 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153178 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153181 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153183 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153186 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153190 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153193 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153196 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153199 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:49:46.164060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153201 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153204 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153207 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153210 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153212 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.153215 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.153758 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.160700 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.160716 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.161481 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.161489 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161546 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161551 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161555 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161558 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:49:46.164587 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161561 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161564 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161567 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161569 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161572 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161574 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161577 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161580 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161583 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161585 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161588 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161590 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161593 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161596 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161607 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161610 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161613 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161616 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161620 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:49:46.164964 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161622 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161625 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161628 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161630 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161633 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161635 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161638 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161641 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161644 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161646 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161649 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161653 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161656 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161660 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161662 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161665 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161668 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161671 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161673 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161676 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:49:46.165567 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161679 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161682 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161686 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161690 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161693 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161695 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161698 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161701 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161703 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161706 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161710 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161713 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161715 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161717 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161720 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161723 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161725 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161728 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161730 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:49:46.166062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161733 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161736 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161738 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161741 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161744 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161747 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161749 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161752 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161754 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161757 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161759 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161762 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161765 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161768 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161770 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161773 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161775 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161779 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161782 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161784 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:49:46.166548 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161787 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161789 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161792 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161795 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161798 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161800 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161803 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161805 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161808 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161812 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161815 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161818 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161821 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161824 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161828 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161831 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:49:46.167025 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161834 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.161839 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161946 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161951 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161955 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161957 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161960 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161963 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161965 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161968 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161971 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161974 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161976 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161979 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161982 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:49:46.167431 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161985 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161988 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161990 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161993 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161995 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.161998 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162001 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162004 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162007 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162010 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162012 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162015 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162018 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162020 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162023 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162026 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162028 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162031 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162033 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162036 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:49:46.167800 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162038 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162041 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162043 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162046 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162049 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162051 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162055 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162059 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162061 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162064 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162066 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162069 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162072 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162075 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162077 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162079 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162082 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162085 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162088 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162090 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:49:46.168349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162093 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162095 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162098 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162100 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162103 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162105 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162108 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162110 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162114 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162117 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162121 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162124 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162127 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162130 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162133 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162136 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162139 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162141 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:49:46.168853 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162144 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162147 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162149 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162152 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162154 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162156 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162159 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162162 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162165 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162168 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162171 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162174 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162176 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162179 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162182 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162184 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162187 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162189 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162192 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162195 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:49:46.169310 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162197 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162200 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162203 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162205 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162208 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162211 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162213 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:46.162215 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.162237 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.162343 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.164441 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.165822 2567 server.go:1019] "Starting client certificate rotation" Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.165923 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 19:49:46.169792 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.165955 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 19:49:46.170247 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.168625 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 19:49:46.170247 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.170004 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 19:49:46.181068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.181038 2567 log.go:25] "Validated CRI v1 runtime API" Jun 10 19:49:46.184086 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.184072 2567 log.go:25] "Validated CRI v1 image API" Jun 10 19:49:46.184983 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.184966 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 19:49:46.190889 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.190836 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 acc716b6-5a17-429d-b7f0-a46a866881a8:/dev/nvme0n1p3 ff6ed93a-823b-4b2d-8d7e-1987fa4e5f36:/dev/nvme0n1p4] Jun 10 19:49:46.190889 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.190854 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 19:49:46.197137 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.197020 2567 manager.go:216] Machine: {Timestamp:2026-06-10 19:49:46.195646944 +0000 UTC m=+0.295040674 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105456 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e266e2a86e4903b6dca3367d993cd SystemUUID:ec2e266e-2a86-e490-3b6d-ca3367d993cd BootID:af749c28-5345-4bc0-9012-701f723fa78f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7c:19:27:d7:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7c:19:27:d7:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:0c:e8:c0:33:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 19:49:46.197137 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.197123 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 19:49:46.197305 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.197208 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 19:49:46.199029 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.199010 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 19:49:46.200595 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.200565 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 19:49:46.200734 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.200598 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-154.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 19:49:46.201774 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.201764 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 19:49:46.201811 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.201776 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 19:49:46.201811 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.201783 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 19:49:46.202268 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.202258 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 19:49:46.203092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.203083 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 19:49:46.205729 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.205717 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 10 19:49:46.205838 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.205829 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 19:49:46.205874 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.205858 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 10 19:49:46.205874 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.205867 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 19:49:46.205932 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.205885 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 19:49:46.205932 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.205895 2567 kubelet.go:398] "Adding apiserver pod source" Jun 10 19:49:46.205932 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.205905 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 19:49:46.206302 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.206288 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 19:49:46.206341 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.206312 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 19:49:46.208674 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.208659 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 19:49:46.210477 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.210464 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 19:49:46.210521 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.210494 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 19:49:46.211042 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211030 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 19:49:46.211085 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211055 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 19:49:46.211085 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211070 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 19:49:46.211142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211086 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 19:49:46.211142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211101 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 19:49:46.211142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211113 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 19:49:46.211361 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211351 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 19:49:46.211391 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211362 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 19:49:46.211391 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211369 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 19:49:46.211391 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211374 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 19:49:46.211391 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211387 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 19:49:46.211502 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.211395 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 19:49:46.212685 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.212673 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 19:49:46.212722 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.212687 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 19:49:46.215769 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.215756 2567 server.go:1268] "Started kubelet" Jun 10 19:49:46.215893 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.215863 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 19:49:46.215970 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.215910 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 19:49:46.216028 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.215988 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 19:49:46.217568 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.217548 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 19:49:46.217792 ip-10-0-129-154 systemd[1]: Started Kubernetes Kubelet. Jun 10 19:49:46.218614 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.218379 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 19:49:46.218614 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.218462 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-154.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 19:49:46.218614 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.218578 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 19:49:46.219191 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.219179 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 10 19:49:46.221210 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.220314 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-154.ec2.internal.18b7d019a561ca16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-154.ec2.internal,UID:ip-10-0-129-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-154.ec2.internal,},FirstTimestamp:2026-06-10 19:49:46.215729686 +0000 UTC m=+0.315123419,LastTimestamp:2026-06-10 19:49:46.215729686 +0000 UTC m=+0.315123419,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-154.ec2.internal,}" Jun 10 19:49:46.222634 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.222616 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 19:49:46.224512 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.224492 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 19:49:46.224620 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.224493 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 19:49:46.224620 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.224610 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.225209 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.225182 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 19:49:46.225209 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.225188 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 19:49:46.225209 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.225212 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 19:49:46.225452 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.225436 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 10 19:49:46.225452 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.225453 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 10 19:49:46.225889 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.225868 2567 factory.go:55] Registering systemd factory Jun 10 19:49:46.225889 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.225891 2567 factory.go:223] Registration of the systemd container factory successfully Jun 10 19:49:46.226303 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.226287 2567 factory.go:153] Registering CRI-O factory Jun 10 19:49:46.226380 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.226308 2567 factory.go:223] Registration of the crio container factory successfully Jun 10 19:49:46.226380 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.226358 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 19:49:46.226524 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.226381 2567 factory.go:103] Registering Raw factory Jun 10 19:49:46.226524 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.226396 2567 manager.go:1196] Started watching for new ooms in manager Jun 10 19:49:46.227022 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.227005 2567 manager.go:349] Starting recovery of all containers Jun 10 19:49:46.227472 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.227448 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 19:49:46.227624 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.227585 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 19:49:46.238300 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.238273 2567 manager.go:354] Recovery completed Jun 10 19:49:46.242852 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.242839 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:49:46.244907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.244880 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:49:46.244985 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.244934 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:49:46.244985 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.244951 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:49:46.245517 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.245504 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 19:49:46.245517 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.245513 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:49:46.245593 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.245518 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 19:49:46.245593 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.245536 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 10 19:49:46.246287 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.246251 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:49:46.246365 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.246299 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:49:46.246365 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.246313 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:49:46.246776 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.246764 2567 policy_none.go:49] "None policy: Start" Jun 10 19:49:46.246813 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.246780 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 19:49:46.246813 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.246790 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 19:49:46.247042 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.246965 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-154.ec2.internal.18b7d019a71efc74 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-154.ec2.internal,UID:ip-10-0-129-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-154.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-154.ec2.internal,},FirstTimestamp:2026-06-10 19:49:46.2449061 +0000 UTC m=+0.344300035,LastTimestamp:2026-06-10 19:49:46.2449061 +0000 UTC m=+0.344300035,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-154.ec2.internal,}" Jun 10 19:49:46.247872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.247861 2567 policy_none.go:47] "Start" Jun 10 19:49:46.249056 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.249041 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c99vj" Jun 10 19:49:46.253975 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.253960 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c99vj" Jun 10 19:49:46.255625 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.255544 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-154.ec2.internal.18b7d019a71f8a10 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-154.ec2.internal,UID:ip-10-0-129-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-154.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-154.ec2.internal,},FirstTimestamp:2026-06-10 19:49:46.244942352 +0000 UTC m=+0.344336087,LastTimestamp:2026-06-10 19:49:46.244942352 +0000 UTC m=+0.344336087,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-154.ec2.internal,}" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.288948 2567 manager.go:337] "Starting Device Plugin manager" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.288974 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.288983 2567 server.go:87] "Starting device plugin registration server" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.289240 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.289250 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.289356 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.289432 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.289440 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.289996 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.290036 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.297737 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.298908 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.298944 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.298962 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 19:49:46.300384 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.299001 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 19:49:46.301363 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.301348 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:49:46.390238 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.390192 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:49:46.391091 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.391070 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:49:46.391166 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.391104 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:49:46.391166 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.391115 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:49:46.391166 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.391148 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.399565 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.399548 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal"] Jun 10 19:49:46.399616 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.399602 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:49:46.401281 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.401264 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.401371 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.401290 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-154.ec2.internal\": node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.402185 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.402171 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:49:46.402255 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.402199 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:49:46.402255 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.402209 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:49:46.404442 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.404427 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:49:46.404534 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.404514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.404586 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.404563 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:49:46.405188 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.405173 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:49:46.405283 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.405189 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:49:46.405283 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.405197 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:49:46.405283 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.405212 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:49:46.405396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.405212 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:49:46.405396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.405314 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:49:46.407371 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.407357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.407434 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.407382 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:49:46.407989 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.407974 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:49:46.408064 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.408004 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:49:46.408064 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.408018 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:49:46.426793 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.426769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51f04f25ec4b2f3c9a26eaebfa71977e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-154.ec2.internal\" (UID: \"51f04f25ec4b2f3c9a26eaebfa71977e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.426875 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.426794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b51a16302c918e83bdf1997289d6850a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal\" (UID: \"b51a16302c918e83bdf1997289d6850a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.426875 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.426811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51a16302c918e83bdf1997289d6850a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal\" (UID: \"b51a16302c918e83bdf1997289d6850a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.428049 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.428033 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.436929 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.436906 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-154.ec2.internal\" not found" node="ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.441446 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.441399 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-154.ec2.internal\" not found" node="ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.527646 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.527617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b51a16302c918e83bdf1997289d6850a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal\" (UID: \"b51a16302c918e83bdf1997289d6850a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.527793 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.527650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51a16302c918e83bdf1997289d6850a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal\" (UID: \"b51a16302c918e83bdf1997289d6850a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.527793 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.527671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51f04f25ec4b2f3c9a26eaebfa71977e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-154.ec2.internal\" (UID: \"51f04f25ec4b2f3c9a26eaebfa71977e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.527793 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.527718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b51a16302c918e83bdf1997289d6850a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal\" (UID: \"b51a16302c918e83bdf1997289d6850a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.527793 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.527718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51a16302c918e83bdf1997289d6850a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal\" (UID: \"b51a16302c918e83bdf1997289d6850a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.527793 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.527750 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51f04f25ec4b2f3c9a26eaebfa71977e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-154.ec2.internal\" (UID: \"51f04f25ec4b2f3c9a26eaebfa71977e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.528666 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.528649 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.629200 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.629163 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.729884 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.729811 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.742994 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.742972 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.747891 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:46.747732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:46.830662 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.830624 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:46.931084 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:46.931043 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:47.031539 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:47.031457 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:47.131912 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:47.131860 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:47.165044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.165019 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 19:49:47.165827 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.165161 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 19:49:47.232079 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:47.232050 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-154.ec2.internal\" not found" Jun 10 19:49:47.256526 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.256488 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 19:44:46 +0000 UTC" deadline="2027-12-30 13:42:03.014967913 +0000 UTC" Jun 10 19:49:47.256624 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.256540 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13625h52m15.758447066s" Jun 10 19:49:47.259976 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.259960 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:49:47.317589 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:47.317545 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f04f25ec4b2f3c9a26eaebfa71977e.slice/crio-85b4290ea64ff60ae7393416ade5883c9d13c1f0bd423073a1d851b7482e9f45 WatchSource:0}: Error finding container 85b4290ea64ff60ae7393416ade5883c9d13c1f0bd423073a1d851b7482e9f45: Status 404 returned error can't find the container with id 85b4290ea64ff60ae7393416ade5883c9d13c1f0bd423073a1d851b7482e9f45 Jun 10 19:49:47.318336 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:47.318301 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51a16302c918e83bdf1997289d6850a.slice/crio-4456d19f31b0ac646b22c10462f98b024b579936dc797e26167b14b100bbca5c WatchSource:0}: Error finding container 4456d19f31b0ac646b22c10462f98b024b579936dc797e26167b14b100bbca5c: Status 404 returned error can't find the container with id 4456d19f31b0ac646b22c10462f98b024b579936dc797e26167b14b100bbca5c Jun 10 19:49:47.322387 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.322373 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:49:47.325004 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.324989 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" Jun 10 19:49:47.336953 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.336936 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 19:49:47.339094 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.339081 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" Jun 10 19:49:47.350311 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.350293 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 19:49:47.782328 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.782250 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:49:47.796734 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:47.796708 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:49:48.020104 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.020051 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:49:48.207621 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.207542 2567 apiserver.go:52] "Watching apiserver" Jun 10 19:49:48.213992 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.213963 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 19:49:48.214404 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.214374 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-65hm9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s","openshift-dns/node-resolver-bg6bp","openshift-image-registry/node-ca-tvn5v","openshift-multus/multus-additional-cni-plugins-rkcst","openshift-multus/network-metrics-daemon-9ctj9","openshift-ovn-kubernetes/ovnkube-node-9ncjw","kube-system/konnectivity-agent-xzhbm","kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5msf2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal","openshift-multus/multus-tlxbl","openshift-network-diagnostics/network-check-target-vs7cp","openshift-network-operator/iptables-alerter-7cgvb"] Jun 10 19:49:48.217419 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.217392 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.219828 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.219770 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:48.219927 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.219841 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:49:48.220087 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.220064 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 19:49:48.220162 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.220105 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 19:49:48.220439 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.220328 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 19:49:48.220439 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.220341 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 19:49:48.220439 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.220344 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dqz5z\"" Jun 10 19:49:48.220657 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.220639 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 19:49:48.220716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.220659 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 19:49:48.225317 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.224512 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.226163 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.225933 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 19:49:48.226885 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.226863 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 19:49:48.226885 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.226870 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 19:49:48.227105 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.227086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.227420 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.227094 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jfltk\"" Jun 10 19:49:48.229090 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.229068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.229196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.229178 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 19:49:48.229561 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.229534 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 19:49:48.230115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.229687 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m2l5n\"" Jun 10 19:49:48.230115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.229725 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 19:49:48.231458 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.231213 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 19:49:48.231458 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.231278 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 19:49:48.231601 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.231504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:48.231601 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.231560 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:49:48.232065 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.231886 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 19:49:48.232065 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.231931 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 19:49:48.232209 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.232097 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 19:49:48.234015 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.233994 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dswcv\"" Jun 10 19:49:48.234399 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.234377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.235861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9416fb12-c296-4de0-9790-c049a1be95cd-host\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.235861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-systemd\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.235861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-log-socket\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.235861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p84wh\" (UniqueName: \"kubernetes.io/projected/6d209f8d-33a4-4544-9363-3dd0e523d7c7-kube-api-access-p84wh\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.235861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235743 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-run-ovn-kubernetes\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.235861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.235861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-ovn\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-env-overrides\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9416fb12-c296-4de0-9790-c049a1be95cd-serviceca\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-systemd-units\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-node-log\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.235982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-etc-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236024 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-cni-bin\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssjfx\" (UniqueName: \"kubernetes.io/projected/0c569a42-f44d-4507-ac18-9f43b0ece800-kube-api-access-ssjfx\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d209f8d-33a4-4544-9363-3dd0e523d7c7-hosts-file\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b827d\" (UniqueName: \"kubernetes.io/projected/9416fb12-c296-4de0-9790-c049a1be95cd-kube-api-access-b827d\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-var-lib-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d209f8d-33a4-4544-9363-3dd0e523d7c7-tmp-dir\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.236278 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-kubelet\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-cni-netd\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c569a42-f44d-4507-ac18-9f43b0ece800-ovn-node-metrics-cert\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-ovnkube-script-lib\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-slash\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-run-netns\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-ovnkube-config\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236798 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.236881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236859 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tkw8j\"" Jun 10 19:49:48.237370 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.236896 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:49:48.237370 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.236941 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 19:49:48.237370 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.237092 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:49:48.237370 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.237199 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 19:49:48.238039 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.238020 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 19:49:48.239014 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.238992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.241273 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.241218 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 19:49:48.241363 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.241302 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 19:49:48.241363 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.241327 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.241583 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.241558 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qmjlh\"" Jun 10 19:49:48.241742 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.241721 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 19:49:48.243739 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.243720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.244099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.244079 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 19:49:48.244379 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.244360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2qkpj\"" Jun 10 19:49:48.244652 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.244616 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:49:48.246209 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.245796 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 19:49:48.246209 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.245863 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9w4ht\"" Jun 10 19:49:48.246209 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.245878 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.246830 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.246635 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 19:49:48.247830 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.247812 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 19:49:48.247930 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.247816 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mn6kp\"" Jun 10 19:49:48.267802 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.267783 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lnbv" Jun 10 19:49:48.274922 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.274903 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lnbv" Jun 10 19:49:48.303890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.303850 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" event={"ID":"b51a16302c918e83bdf1997289d6850a","Type":"ContainerStarted","Data":"4456d19f31b0ac646b22c10462f98b024b579936dc797e26167b14b100bbca5c"} Jun 10 19:49:48.305171 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.305141 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" event={"ID":"51f04f25ec4b2f3c9a26eaebfa71977e","Type":"ContainerStarted","Data":"85b4290ea64ff60ae7393416ade5883c9d13c1f0bd423073a1d851b7482e9f45"} Jun 10 19:49:48.326405 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.326383 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 19:49:48.337088 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjfx\" (UniqueName: \"kubernetes.io/projected/0c569a42-f44d-4507-ac18-9f43b0ece800-kube-api-access-ssjfx\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337216 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-var-lib-kubelet\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.337216 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-cnibin\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.337216 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:48.337216 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b827d\" (UniqueName: \"kubernetes.io/projected/9416fb12-c296-4de0-9790-c049a1be95cd-kube-api-access-b827d\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.337216 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-var-lib-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz9gk\" (UniqueName: \"kubernetes.io/projected/af469872-8625-4ecd-9c52-ec7e30eb0735-kube-api-access-lz9gk\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.337449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-cnibin\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.337449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.337449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-run\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.337449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337360 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-var-lib-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-kubelet\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c569a42-f44d-4507-ac18-9f43b0ece800-ovn-node-metrics-cert\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6cn\" (UniqueName: \"kubernetes.io/projected/59279314-7623-4ab6-aa9c-3ff343ba4655-kube-api-access-jq6cn\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-slash\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-run-netns\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-ovnkube-config\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337559 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-slash\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-run-netns\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337597 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-kubelet\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-device-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-system-cni-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.337746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-cni-binary-copy\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-os-release\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p84wh\" (UniqueName: \"kubernetes.io/projected/6d209f8d-33a4-4544-9363-3dd0e523d7c7-kube-api-access-p84wh\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysctl-d\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03efae79-a5d4-4daa-b809-9cecd52ab1a2-tmp\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk95m\" (UniqueName: \"kubernetes.io/projected/03efae79-a5d4-4daa-b809-9cecd52ab1a2-kube-api-access-rk95m\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337910 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-multus-certs\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337932 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-tuned\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-k8s-cni-cncf-io\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337971 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-cni-multus\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.337980 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338013 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9416fb12-c296-4de0-9790-c049a1be95cd-serviceca\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-systemd-units\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-node-log\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d7vf\" (UniqueName: \"kubernetes.io/projected/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-kube-api-access-8d7vf\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:48.338168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338100 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-systemd-units\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-cni-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338117 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-ovnkube-config\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-kubelet\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-system-cni-dir\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338162 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-node-log\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-etc-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-cni-bin\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338277 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-etc-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338287 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-lib-modules\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-etc-kubernetes\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-cni-bin\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338439 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9416fb12-c296-4de0-9790-c049a1be95cd-serviceca\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d209f8d-33a4-4544-9363-3dd0e523d7c7-hosts-file\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-systemd\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d209f8d-33a4-4544-9363-3dd0e523d7c7-hosts-file\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.339151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-conf-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af469872-8625-4ecd-9c52-ec7e30eb0735-iptables-alerter-script\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysctl-conf\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d209f8d-33a4-4544-9363-3dd0e523d7c7-tmp-dir\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-cni-netd\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-cni-netd\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-ovnkube-script-lib\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-modprobe-d\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-os-release\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-socket-dir-parent\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338925 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-netns\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-cni-bin\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.338971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-kubelet-config\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-dbus\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d209f8d-33a4-4544-9363-3dd0e523d7c7-tmp-dir\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.339905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339080 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-openvswitch\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9416fb12-c296-4de0-9790-c049a1be95cd-host\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-systemd\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339143 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9416fb12-c296-4de0-9790-c049a1be95cd-host\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-log-socket\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339178 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-socket-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339194 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-systemd\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-ovnkube-script-lib\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339254 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-log-socket\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339263 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysconfig\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-kubernetes\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-run-ovn-kubernetes\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-host-run-ovn-kubernetes\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-sys\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-ovn\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.340675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339480 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-env-overrides\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339510 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c569a42-f44d-4507-ac18-9f43b0ece800-run-ovn\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-registration-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339574 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-etc-selinux\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-host\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc045c30-15e3-416d-9f78-3430ac3a91e4-konnectivity-ca\") pod \"konnectivity-agent-xzhbm\" (UID: \"dc045c30-15e3-416d-9f78-3430ac3a91e4\") " pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-hostroot\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgrmk\" (UniqueName: \"kubernetes.io/projected/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-kube-api-access-bgrmk\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-sys-fs\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc045c30-15e3-416d-9f78-3430ac3a91e4-agent-certs\") pod \"konnectivity-agent-xzhbm\" (UID: \"dc045c30-15e3-416d-9f78-3430ac3a91e4\") " pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-daemon-config\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af469872-8625-4ecd-9c52-ec7e30eb0735-host-slash\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-cni-binary-copy\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339917 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2b9n\" (UniqueName: \"kubernetes.io/projected/6880c3bf-299e-488a-8c72-b48b14ba4640-kube-api-access-f2b9n\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.341373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.339909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c569a42-f44d-4507-ac18-9f43b0ece800-env-overrides\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.342131 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.342111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c569a42-f44d-4507-ac18-9f43b0ece800-ovn-node-metrics-cert\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.345601 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.345578 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:49:48.345701 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.345606 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:49:48.345701 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.345620 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pxt9d for pod openshift-network-diagnostics/network-check-target-vs7cp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:48.345701 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.345672 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d podName:a18f28f6-70b9-4f38-b7e1-deef4df4e9df nodeName:}" failed. No retries permitted until 2026-06-10 19:49:48.84565723 +0000 UTC m=+2.945050948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pxt9d" (UniqueName: "kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d") pod "network-check-target-vs7cp" (UID: "a18f28f6-70b9-4f38-b7e1-deef4df4e9df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:48.347802 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.347765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b827d\" (UniqueName: \"kubernetes.io/projected/9416fb12-c296-4de0-9790-c049a1be95cd-kube-api-access-b827d\") pod \"node-ca-tvn5v\" (UID: \"9416fb12-c296-4de0-9790-c049a1be95cd\") " pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.348720 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.348696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p84wh\" (UniqueName: \"kubernetes.io/projected/6d209f8d-33a4-4544-9363-3dd0e523d7c7-kube-api-access-p84wh\") pod \"node-resolver-bg6bp\" (UID: \"6d209f8d-33a4-4544-9363-3dd0e523d7c7\") " pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.348720 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.348709 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjfx\" (UniqueName: \"kubernetes.io/projected/0c569a42-f44d-4507-ac18-9f43b0ece800-kube-api-access-ssjfx\") pod \"ovnkube-node-9ncjw\" (UID: \"0c569a42-f44d-4507-ac18-9f43b0ece800\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.441128 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysctl-conf\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441162 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-modprobe-d\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-os-release\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-socket-dir-parent\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-netns\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-cni-bin\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-kubelet-config\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.441316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-dbus\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441331 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysctl-conf\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-socket-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441449 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-cni-bin\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysconfig\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-kubernetes\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441498 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-kubelet-config\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441503 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-socket-dir-parent\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-sys\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-registration-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-etc-selinux\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441611 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-socket-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-modprobe-d\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441656 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-dbus\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441689 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-os-release\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.441719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-host\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441730 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-netns\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-registration-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-kubernetes\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441769 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-host\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc045c30-15e3-416d-9f78-3430ac3a91e4-konnectivity-ca\") pod \"konnectivity-agent-xzhbm\" (UID: \"dc045c30-15e3-416d-9f78-3430ac3a91e4\") " pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441773 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-etc-selinux\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-sys\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441812 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-hostroot\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441845 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysconfig\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.441858 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-hostroot\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgrmk\" (UniqueName: \"kubernetes.io/projected/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-kube-api-access-bgrmk\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.441977 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs podName:3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83 nodeName:}" failed. No retries permitted until 2026-06-10 19:49:48.941955643 +0000 UTC m=+3.041349383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs") pod "network-metrics-daemon-9ctj9" (UID: "3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.441994 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-sys-fs\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.442492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc045c30-15e3-416d-9f78-3430ac3a91e4-agent-certs\") pod \"konnectivity-agent-xzhbm\" (UID: \"dc045c30-15e3-416d-9f78-3430ac3a91e4\") " pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-sys-fs\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-daemon-config\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af469872-8625-4ecd-9c52-ec7e30eb0735-host-slash\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-cni-binary-copy\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442392 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc045c30-15e3-416d-9f78-3430ac3a91e4-konnectivity-ca\") pod \"konnectivity-agent-xzhbm\" (UID: \"dc045c30-15e3-416d-9f78-3430ac3a91e4\") " pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442415 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af469872-8625-4ecd-9c52-ec7e30eb0735-host-slash\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2b9n\" (UniqueName: \"kubernetes.io/projected/6880c3bf-299e-488a-8c72-b48b14ba4640-kube-api-access-f2b9n\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442703 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-var-lib-kubelet\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442745 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-cnibin\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-daemon-config\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-var-lib-kubelet\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-cnibin\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-cni-binary-copy\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9gk\" (UniqueName: \"kubernetes.io/projected/af469872-8625-4ecd-9c52-ec7e30eb0735-kube-api-access-lz9gk\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.443322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-cnibin\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442962 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.442988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-run\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6cn\" (UniqueName: \"kubernetes.io/projected/59279314-7623-4ab6-aa9c-3ff343ba4655-kube-api-access-jq6cn\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-cnibin\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-device-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-system-cni-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-cni-binary-copy\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-os-release\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysctl-d\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443129 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-system-cni-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443084 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-run\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03efae79-a5d4-4daa-b809-9cecd52ab1a2-tmp\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk95m\" (UniqueName: \"kubernetes.io/projected/03efae79-a5d4-4daa-b809-9cecd52ab1a2-kube-api-access-rk95m\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443204 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-multus-certs\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-tuned\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-k8s-cni-cncf-io\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444092 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-cni-multus\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d7vf\" (UniqueName: \"kubernetes.io/projected/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-kube-api-access-8d7vf\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-cni-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-kubelet\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-system-cni-dir\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443444 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-k8s-cni-cncf-io\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-lib-modules\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443467 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-os-release\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59279314-7623-4ab6-aa9c-3ff343ba4655-device-dir\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6880c3bf-299e-488a-8c72-b48b14ba4640-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443507 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-run-multus-certs\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443529 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-etc-kubernetes\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443545 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-kubelet\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-host-var-lib-cni-multus\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-lib-modules\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-etc-kubernetes\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443617 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-cni-binary-copy\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443622 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-sysctl-d\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.444878 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6880c3bf-299e-488a-8c72-b48b14ba4640-system-cni-dir\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-cni-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-systemd\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-conf-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.443798 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af469872-8625-4ecd-9c52-ec7e30eb0735-iptables-alerter-script\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443839 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-systemd\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.443855 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret podName:7cdc7488-1c8f-424b-be1d-fb08e3c7db2a nodeName:}" failed. No retries permitted until 2026-06-10 19:49:48.943834715 +0000 UTC m=+3.043228432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret") pod "global-pull-secret-syncer-65hm9" (UID: "7cdc7488-1c8f-424b-be1d-fb08e3c7db2a") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.443862 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-multus-conf-dir\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.444409 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af469872-8625-4ecd-9c52-ec7e30eb0735-iptables-alerter-script\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.445725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.445125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc045c30-15e3-416d-9f78-3430ac3a91e4-agent-certs\") pod \"konnectivity-agent-xzhbm\" (UID: \"dc045c30-15e3-416d-9f78-3430ac3a91e4\") " pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.448791 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.448637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03efae79-a5d4-4daa-b809-9cecd52ab1a2-tmp\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.448791 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.448686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03efae79-a5d4-4daa-b809-9cecd52ab1a2-etc-tuned\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.450992 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.450969 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgrmk\" (UniqueName: \"kubernetes.io/projected/26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61-kube-api-access-bgrmk\") pod \"multus-tlxbl\" (UID: \"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61\") " pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.460046 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.459988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz9gk\" (UniqueName: \"kubernetes.io/projected/af469872-8625-4ecd-9c52-ec7e30eb0735-kube-api-access-lz9gk\") pod \"iptables-alerter-7cgvb\" (UID: \"af469872-8625-4ecd-9c52-ec7e30eb0735\") " pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.464873 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.464798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk95m\" (UniqueName: \"kubernetes.io/projected/03efae79-a5d4-4daa-b809-9cecd52ab1a2-kube-api-access-rk95m\") pod \"tuned-5msf2\" (UID: \"03efae79-a5d4-4daa-b809-9cecd52ab1a2\") " pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.465161 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.465121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2b9n\" (UniqueName: \"kubernetes.io/projected/6880c3bf-299e-488a-8c72-b48b14ba4640-kube-api-access-f2b9n\") pod \"multus-additional-cni-plugins-rkcst\" (UID: \"6880c3bf-299e-488a-8c72-b48b14ba4640\") " pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.466994 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.466924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6cn\" (UniqueName: \"kubernetes.io/projected/59279314-7623-4ab6-aa9c-3ff343ba4655-kube-api-access-jq6cn\") pod \"aws-ebs-csi-driver-node-xcz7s\" (UID: \"59279314-7623-4ab6-aa9c-3ff343ba4655\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.467274 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.467251 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d7vf\" (UniqueName: \"kubernetes.io/projected/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-kube-api-access-8d7vf\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:48.534257 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.534214 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:49:48.541310 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.541281 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bg6bp" Jun 10 19:49:48.552940 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.552918 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvn5v" Jun 10 19:49:48.558506 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.558485 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rkcst" Jun 10 19:49:48.567032 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.567013 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7cgvb" Jun 10 19:49:48.574585 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.574567 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" Jun 10 19:49:48.584072 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.584056 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5msf2" Jun 10 19:49:48.591729 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.591709 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:49:48.597330 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.597312 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tlxbl" Jun 10 19:49:48.847398 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.847322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:48.847536 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.847460 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:49:48.847536 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.847475 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:49:48.847536 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.847484 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pxt9d for pod openshift-network-diagnostics/network-check-target-vs7cp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:48.847536 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.847536 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d podName:a18f28f6-70b9-4f38-b7e1-deef4df4e9df nodeName:}" failed. No retries permitted until 2026-06-10 19:49:49.847522122 +0000 UTC m=+3.946915839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxt9d" (UniqueName: "kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d") pod "network-check-target-vs7cp" (UID: "a18f28f6-70b9-4f38-b7e1-deef4df4e9df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:48.948583 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.948540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:48.948775 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:48.948605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:48.948775 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.948701 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:48.948775 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.948739 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:48.948775 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.948777 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret podName:7cdc7488-1c8f-424b-be1d-fb08e3c7db2a nodeName:}" failed. No retries permitted until 2026-06-10 19:49:49.948756351 +0000 UTC m=+4.048150073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret") pod "global-pull-secret-syncer-65hm9" (UID: "7cdc7488-1c8f-424b-be1d-fb08e3c7db2a") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:48.948941 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:48.948798 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs podName:3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83 nodeName:}" failed. No retries permitted until 2026-06-10 19:49:49.948787454 +0000 UTC m=+4.048181171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs") pod "network-metrics-daemon-9ctj9" (UID: "3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:49.192005 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.191974 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9416fb12_c296_4de0_9790_c049a1be95cd.slice/crio-a42d70245426dc455848b458c4bc671549f6f51bfd1f2f41264f37af93ae0672 WatchSource:0}: Error finding container a42d70245426dc455848b458c4bc671549f6f51bfd1f2f41264f37af93ae0672: Status 404 returned error can't find the container with id a42d70245426dc455848b458c4bc671549f6f51bfd1f2f41264f37af93ae0672 Jun 10 19:49:49.193073 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.193052 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03efae79_a5d4_4daa_b809_9cecd52ab1a2.slice/crio-00a2c7e1e970774fe685a6ebbe1f480c0d134948382ce0de550dc0a59d34e30c WatchSource:0}: Error finding container 00a2c7e1e970774fe685a6ebbe1f480c0d134948382ce0de550dc0a59d34e30c: Status 404 returned error can't find the container with id 00a2c7e1e970774fe685a6ebbe1f480c0d134948382ce0de550dc0a59d34e30c Jun 10 19:49:49.216701 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.216679 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf469872_8625_4ecd_9c52_ec7e30eb0735.slice/crio-10c5219f162780def90d8713c61dfdd4131c9359c701d5ec2ffab1a373ab950e WatchSource:0}: Error finding container 10c5219f162780def90d8713c61dfdd4131c9359c701d5ec2ffab1a373ab950e: Status 404 returned error can't find the container with id 10c5219f162780def90d8713c61dfdd4131c9359c701d5ec2ffab1a373ab950e Jun 10 19:49:49.217958 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.217929 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d209f8d_33a4_4544_9363_3dd0e523d7c7.slice/crio-1e29198e6b04adeb53d31b3e004a1e0bc9eb4b16e067e962ac215ad198e4d8d8 WatchSource:0}: Error finding container 1e29198e6b04adeb53d31b3e004a1e0bc9eb4b16e067e962ac215ad198e4d8d8: Status 404 returned error can't find the container with id 1e29198e6b04adeb53d31b3e004a1e0bc9eb4b16e067e962ac215ad198e4d8d8 Jun 10 19:49:49.218805 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.218776 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6880c3bf_299e_488a_8c72_b48b14ba4640.slice/crio-b1b2486e722da37f4bac53df5da5f6f84cf0511b734b20e66189e9a00dfbc785 WatchSource:0}: Error finding container b1b2486e722da37f4bac53df5da5f6f84cf0511b734b20e66189e9a00dfbc785: Status 404 returned error can't find the container with id b1b2486e722da37f4bac53df5da5f6f84cf0511b734b20e66189e9a00dfbc785 Jun 10 19:49:49.220158 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.220069 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc045c30_15e3_416d_9f78_3430ac3a91e4.slice/crio-50b6ef07ebb92d4e2a279ef6c45ab49c102541f1cf260c13672234885adada6b WatchSource:0}: Error finding container 50b6ef07ebb92d4e2a279ef6c45ab49c102541f1cf260c13672234885adada6b: Status 404 returned error can't find the container with id 50b6ef07ebb92d4e2a279ef6c45ab49c102541f1cf260c13672234885adada6b Jun 10 19:49:49.220785 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.220766 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59279314_7623_4ab6_aa9c_3ff343ba4655.slice/crio-e6fb19456e14978dcb161070acaf592bb6c684abdfeccc780689f4a11292cc5c WatchSource:0}: Error finding container e6fb19456e14978dcb161070acaf592bb6c684abdfeccc780689f4a11292cc5c: Status 404 returned error can't find the container with id e6fb19456e14978dcb161070acaf592bb6c684abdfeccc780689f4a11292cc5c Jun 10 19:49:49.221827 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:49:49.221804 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c569a42_f44d_4507_ac18_9f43b0ece800.slice/crio-bbb38b4a328081ba6fcbc420846aea2437d59e5f280a7d973d500985f7e187e8 WatchSource:0}: Error finding container bbb38b4a328081ba6fcbc420846aea2437d59e5f280a7d973d500985f7e187e8: Status 404 returned error can't find the container with id bbb38b4a328081ba6fcbc420846aea2437d59e5f280a7d973d500985f7e187e8 Jun 10 19:49:49.278232 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.278191 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 19:44:48 +0000 UTC" deadline="2028-02-02 18:45:33.820262322 +0000 UTC" Jun 10 19:49:49.278232 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.278233 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14446h55m44.5420471s" Jun 10 19:49:49.299917 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.299894 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:49.300021 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.300004 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:49:49.308099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.308070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bg6bp" event={"ID":"6d209f8d-33a4-4544-9363-3dd0e523d7c7","Type":"ContainerStarted","Data":"1e29198e6b04adeb53d31b3e004a1e0bc9eb4b16e067e962ac215ad198e4d8d8"} Jun 10 19:49:49.309290 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.309259 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7cgvb" event={"ID":"af469872-8625-4ecd-9c52-ec7e30eb0735","Type":"ContainerStarted","Data":"10c5219f162780def90d8713c61dfdd4131c9359c701d5ec2ffab1a373ab950e"} Jun 10 19:49:49.310471 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.310445 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"bbb38b4a328081ba6fcbc420846aea2437d59e5f280a7d973d500985f7e187e8"} Jun 10 19:49:49.311482 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.311458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" event={"ID":"59279314-7623-4ab6-aa9c-3ff343ba4655","Type":"ContainerStarted","Data":"e6fb19456e14978dcb161070acaf592bb6c684abdfeccc780689f4a11292cc5c"} Jun 10 19:49:49.312523 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.312502 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5msf2" event={"ID":"03efae79-a5d4-4daa-b809-9cecd52ab1a2","Type":"ContainerStarted","Data":"00a2c7e1e970774fe685a6ebbe1f480c0d134948382ce0de550dc0a59d34e30c"} Jun 10 19:49:49.313611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.313588 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvn5v" event={"ID":"9416fb12-c296-4de0-9790-c049a1be95cd","Type":"ContainerStarted","Data":"a42d70245426dc455848b458c4bc671549f6f51bfd1f2f41264f37af93ae0672"} Jun 10 19:49:49.315832 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.315789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tlxbl" event={"ID":"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61","Type":"ContainerStarted","Data":"cf61d5709106749cb284620319da2c3479872cd3496ee6d0b53747f754c8350f"} Jun 10 19:49:49.317644 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.317618 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzhbm" event={"ID":"dc045c30-15e3-416d-9f78-3430ac3a91e4","Type":"ContainerStarted","Data":"50b6ef07ebb92d4e2a279ef6c45ab49c102541f1cf260c13672234885adada6b"} Jun 10 19:49:49.319070 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.319045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerStarted","Data":"b1b2486e722da37f4bac53df5da5f6f84cf0511b734b20e66189e9a00dfbc785"} Jun 10 19:49:49.855716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.855412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:49.855879 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.855802 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:49:49.855879 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.855827 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:49:49.855879 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.855839 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pxt9d for pod openshift-network-diagnostics/network-check-target-vs7cp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:49.856037 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.855900 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d podName:a18f28f6-70b9-4f38-b7e1-deef4df4e9df nodeName:}" failed. No retries permitted until 2026-06-10 19:49:51.855881691 +0000 UTC m=+5.955275414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxt9d" (UniqueName: "kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d") pod "network-check-target-vs7cp" (UID: "a18f28f6-70b9-4f38-b7e1-deef4df4e9df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:49.956806 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.956770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:49.956988 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:49.956869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:49.956988 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.956980 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:49.957110 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.957040 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret podName:7cdc7488-1c8f-424b-be1d-fb08e3c7db2a nodeName:}" failed. No retries permitted until 2026-06-10 19:49:51.957022287 +0000 UTC m=+6.056416006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret") pod "global-pull-secret-syncer-65hm9" (UID: "7cdc7488-1c8f-424b-be1d-fb08e3c7db2a") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:49.957110 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.957088 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:49.957211 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:49.957130 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs podName:3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83 nodeName:}" failed. No retries permitted until 2026-06-10 19:49:51.957117352 +0000 UTC m=+6.056511085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs") pod "network-metrics-daemon-9ctj9" (UID: "3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:50.279261 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:50.279211 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 19:44:48 +0000 UTC" deadline="2028-03-11 02:52:55.18917578 +0000 UTC" Jun 10 19:49:50.279626 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:50.279264 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15343h3m4.909916924s" Jun 10 19:49:50.301457 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:50.301428 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:50.301604 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:50.301548 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:49:50.302047 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:50.302027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:50.302151 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:50.302121 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:49:50.340247 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:50.339424 2567 generic.go:356] "Generic (PLEG): container finished" podID="b51a16302c918e83bdf1997289d6850a" containerID="99d2c7b7c5a838e8f170608fe3d320befc4756db781699975ad3c83dbd627a79" exitCode=0 Jun 10 19:49:50.340247 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:50.339525 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" event={"ID":"b51a16302c918e83bdf1997289d6850a","Type":"ContainerDied","Data":"99d2c7b7c5a838e8f170608fe3d320befc4756db781699975ad3c83dbd627a79"} Jun 10 19:49:50.348359 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:50.348328 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" event={"ID":"51f04f25ec4b2f3c9a26eaebfa71977e","Type":"ContainerStarted","Data":"109d125673ad3fdc9148cbc4b5b5bf53f3121fe6b719632a660d297bce62d583"} Jun 10 19:49:51.299883 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:51.299831 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:51.300479 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.299992 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:49:51.378581 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:51.378496 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" event={"ID":"b51a16302c918e83bdf1997289d6850a","Type":"ContainerStarted","Data":"cc56e37ba9f6202f5605f91d4b4283799a34c37b5f03e56e2d4dc6803419eac8"} Jun 10 19:49:51.399112 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:51.398597 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-154.ec2.internal" podStartSLOduration=4.398575655 podStartE2EDuration="4.398575655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:49:50.377327184 +0000 UTC m=+4.476720925" watchObservedRunningTime="2026-06-10 19:49:51.398575655 +0000 UTC m=+5.497969398" Jun 10 19:49:51.870559 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:51.869943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:51.870559 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.870109 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:49:51.870559 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.870128 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:49:51.870559 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.870141 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pxt9d for pod openshift-network-diagnostics/network-check-target-vs7cp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:51.870559 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.870201 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d podName:a18f28f6-70b9-4f38-b7e1-deef4df4e9df nodeName:}" failed. No retries permitted until 2026-06-10 19:49:55.870182296 +0000 UTC m=+9.969576028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxt9d" (UniqueName: "kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d") pod "network-check-target-vs7cp" (UID: "a18f28f6-70b9-4f38-b7e1-deef4df4e9df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:51.971494 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:51.970725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:51.971494 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:51.970777 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:51.971494 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.970930 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:51.971494 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.970995 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs podName:3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83 nodeName:}" failed. No retries permitted until 2026-06-10 19:49:55.970975302 +0000 UTC m=+10.070369023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs") pod "network-metrics-daemon-9ctj9" (UID: "3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:51.971494 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.971390 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:51.971494 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:51.971441 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret podName:7cdc7488-1c8f-424b-be1d-fb08e3c7db2a nodeName:}" failed. No retries permitted until 2026-06-10 19:49:55.971426019 +0000 UTC m=+10.070819751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret") pod "global-pull-secret-syncer-65hm9" (UID: "7cdc7488-1c8f-424b-be1d-fb08e3c7db2a") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:52.299976 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:52.299903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:52.300417 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:52.299905 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:52.300417 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:52.300039 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:49:52.300417 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:52.300114 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:49:53.299746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:53.299708 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:53.299938 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:53.299861 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:49:54.300347 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:54.300314 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:54.300869 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:54.300480 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:49:54.300952 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:54.300932 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:54.301057 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:54.301036 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:49:55.299450 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:55.299390 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:55.299658 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:55.299514 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:49:55.903657 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:55.903614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:55.904092 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:55.903779 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:49:55.904092 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:55.903808 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:49:55.904092 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:55.903823 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pxt9d for pod openshift-network-diagnostics/network-check-target-vs7cp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:55.904092 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:55.903891 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d podName:a18f28f6-70b9-4f38-b7e1-deef4df4e9df nodeName:}" failed. No retries permitted until 2026-06-10 19:50:03.903871483 +0000 UTC m=+18.003265204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxt9d" (UniqueName: "kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d") pod "network-check-target-vs7cp" (UID: "a18f28f6-70b9-4f38-b7e1-deef4df4e9df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:49:56.004711 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:56.004675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:56.004711 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:56.004715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:56.004964 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:56.004813 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:56.004964 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:56.004868 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs podName:3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:04.004853582 +0000 UTC m=+18.104247301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs") pod "network-metrics-daemon-9ctj9" (UID: "3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:49:56.004964 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:56.004902 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:56.005131 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:56.004970 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret podName:7cdc7488-1c8f-424b-be1d-fb08e3c7db2a nodeName:}" failed. No retries permitted until 2026-06-10 19:50:04.004951779 +0000 UTC m=+18.104345502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret") pod "global-pull-secret-syncer-65hm9" (UID: "7cdc7488-1c8f-424b-be1d-fb08e3c7db2a") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:49:56.299921 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:56.299835 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:56.300088 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:56.299936 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:49:56.300088 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:56.299984 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:56.300213 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:56.300095 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:49:57.299904 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:57.299870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:57.300374 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:57.300008 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:49:58.299256 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:58.299213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:49:58.299424 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:58.299359 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:49:58.299797 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:58.299627 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:49:58.299797 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:58.299739 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:49:59.299520 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:49:59.299473 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:49:59.299962 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:49:59.299615 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:00.300199 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:00.300156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:00.300199 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:00.300202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:00.300716 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:00.300320 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:00.300716 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:00.300400 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:01.299467 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:01.299435 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:01.299655 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:01.299578 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:02.299743 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:02.299708 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:02.300182 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:02.299847 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:02.300182 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:02.299931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:02.300182 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:02.300047 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:03.299411 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:03.299376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:03.299645 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:03.299494 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:03.964086 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:03.964033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:03.964696 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:03.964181 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:50:03.964696 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:03.964205 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:50:03.964696 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:03.964217 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pxt9d for pod openshift-network-diagnostics/network-check-target-vs7cp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:50:03.964696 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:03.964295 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d podName:a18f28f6-70b9-4f38-b7e1-deef4df4e9df nodeName:}" failed. No retries permitted until 2026-06-10 19:50:19.964276159 +0000 UTC m=+34.063669877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxt9d" (UniqueName: "kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d") pod "network-check-target-vs7cp" (UID: "a18f28f6-70b9-4f38-b7e1-deef4df4e9df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:50:04.064858 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:04.064813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:04.065049 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:04.064867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:04.065049 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:04.064997 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:50:04.065154 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:04.065069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret podName:7cdc7488-1c8f-424b-be1d-fb08e3c7db2a nodeName:}" failed. No retries permitted until 2026-06-10 19:50:20.065047951 +0000 UTC m=+34.164441689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret") pod "global-pull-secret-syncer-65hm9" (UID: "7cdc7488-1c8f-424b-be1d-fb08e3c7db2a") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:50:04.065154 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:04.065002 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:50:04.065255 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:04.065176 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs podName:3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:20.065155553 +0000 UTC m=+34.164549278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs") pod "network-metrics-daemon-9ctj9" (UID: "3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:50:04.300298 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:04.300190 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:04.300462 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:04.300336 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:04.300462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:04.300400 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:04.300573 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:04.300515 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:05.299989 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:05.299953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:05.300467 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:05.300087 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:06.300300 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:06.300274 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:06.300769 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:06.300370 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:06.300769 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:06.300439 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:06.300769 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:06.300517 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:07.300011 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:07.299976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:07.300211 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:07.300111 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:08.300518 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.300117 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:08.300518 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.300144 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:08.300518 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:08.300432 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:08.300518 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:08.300474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:08.416167 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.416131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tlxbl" event={"ID":"26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61","Type":"ContainerStarted","Data":"3feb7cc017bd223d9f9e33e3de441b0ad9c4d21999e7368ed52d9c758d58402c"} Jun 10 19:50:08.417791 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.417757 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzhbm" event={"ID":"dc045c30-15e3-416d-9f78-3430ac3a91e4","Type":"ContainerStarted","Data":"47ac99d10f7eb419aa816f807a3962e5800032a585ff21bcd9b5b77ba8135718"} Jun 10 19:50:08.419902 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.419624 2567 generic.go:356] "Generic (PLEG): container finished" podID="6880c3bf-299e-488a-8c72-b48b14ba4640" containerID="131cf12c2eba8effeb3988c7aece4d66092ec12cfb810094cbfe37f937661c9d" exitCode=0 Jun 10 19:50:08.419902 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.419685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerDied","Data":"131cf12c2eba8effeb3988c7aece4d66092ec12cfb810094cbfe37f937661c9d"} Jun 10 19:50:08.421426 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.421395 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bg6bp" event={"ID":"6d209f8d-33a4-4544-9363-3dd0e523d7c7","Type":"ContainerStarted","Data":"535a0ed0d9a3c23fbdc553642c1665f4709686e6d1fc5bc3c417b46c0df57573"} Jun 10 19:50:08.423140 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.423114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"928cf91bc6b2ff2d042bdce86acb2b83c0c6430c1a009cbb648b7f4299b27059"} Jun 10 19:50:08.424665 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.424644 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" event={"ID":"59279314-7623-4ab6-aa9c-3ff343ba4655","Type":"ContainerStarted","Data":"fc2a2823ea2cbe1006c833c0db2b39e2bb65557dd4171f71118db253ffaf7c28"} Jun 10 19:50:08.426219 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.426158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5msf2" event={"ID":"03efae79-a5d4-4daa-b809-9cecd52ab1a2","Type":"ContainerStarted","Data":"64ab5c78f70136df6517639081f1511571db6b559b7f60213940481d2a289427"} Jun 10 19:50:08.427915 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.427892 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvn5v" event={"ID":"9416fb12-c296-4de0-9790-c049a1be95cd","Type":"ContainerStarted","Data":"41cc6b5aef94a31b5f1c92f31a8347bf6cfccf2de3074df9027dd4f9d1ae44c6"} Jun 10 19:50:08.432903 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.432868 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-154.ec2.internal" podStartSLOduration=21.432857758 podStartE2EDuration="21.432857758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:49:51.399085114 +0000 UTC m=+5.498478854" watchObservedRunningTime="2026-06-10 19:50:08.432857758 +0000 UTC m=+22.532251498" Jun 10 19:50:08.432997 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.432942 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tlxbl" podStartSLOduration=3.736540775 podStartE2EDuration="22.43293569s" totalImagesPullingTime="18.696394915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:08.432351844 +0000 UTC m=+22.531745585" watchObservedRunningTime="2026-06-10 19:50:08.43293569 +0000 UTC m=+22.532329427" Jun 10 19:50:08.450886 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.448929 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5msf2" podStartSLOduration=3.748313339 podStartE2EDuration="22.448911729s" totalImagesPullingTime="18.70059839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:08.44847556 +0000 UTC m=+22.547869300" watchObservedRunningTime="2026-06-10 19:50:08.448911729 +0000 UTC m=+22.548305466" Jun 10 19:50:08.463816 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.463762 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xzhbm" podStartSLOduration=3.849943216 podStartE2EDuration="22.463741528s" totalImagesPullingTime="18.613798312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:08.463088227 +0000 UTC m=+22.562481968" watchObservedRunningTime="2026-06-10 19:50:08.463741528 +0000 UTC m=+22.563135269" Jun 10 19:50:08.483980 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.483940 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bg6bp" podStartSLOduration=3.785538732 podStartE2EDuration="22.483927405s" totalImagesPullingTime="18.698388673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:08.483726865 +0000 UTC m=+22.583120605" watchObservedRunningTime="2026-06-10 19:50:08.483927405 +0000 UTC m=+22.583321145" Jun 10 19:50:08.509536 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:08.509488 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tvn5v" podStartSLOduration=3.807004652 podStartE2EDuration="22.509473253s" totalImagesPullingTime="18.702468601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:08.509034044 +0000 UTC m=+22.608427783" watchObservedRunningTime="2026-06-10 19:50:08.509473253 +0000 UTC m=+22.608866997" Jun 10 19:50:09.236649 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.236495 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 19:50:09.299640 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.299609 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:09.299795 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:09.299752 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:09.300701 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.300546 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T19:50:09.236642933Z","UUID":"7ae38738-5e99-4f68-bd69-e68f45f3b352","Handler":null,"Name":"","Endpoint":""} Jun 10 19:50:09.302387 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.302200 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 19:50:09.302387 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.302261 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 19:50:09.432657 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.432619 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" event={"ID":"59279314-7623-4ab6-aa9c-3ff343ba4655","Type":"ContainerStarted","Data":"68a0ba09013064b07f9357005a45cd591297ce9755f4cef2c107f5604de86717"} Jun 10 19:50:09.435808 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.435787 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 19:50:09.436159 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.436136 2567 generic.go:356] "Generic (PLEG): container finished" podID="0c569a42-f44d-4507-ac18-9f43b0ece800" containerID="63a109ae28cb4cbaee529d2b45035d57c699de168168de6436cea5507831af9c" exitCode=1 Jun 10 19:50:09.436271 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.436241 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"9b42c2b3545beb8fba1754ffca638e1a9a07c5c92f2e1c5765ecfa022abaf6b8"} Jun 10 19:50:09.436346 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.436327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"30732ff5c1cc21fa88596480fd045da6bcb396b985d0c13513ed9a5f38156aa4"} Jun 10 19:50:09.436416 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.436386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"5b5eb0eb71bfa6fac87ffc09e5d27a0403d9ebea451e8d3f3fd95747faecf814"} Jun 10 19:50:09.436511 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.436496 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"8f73723e687aa10d6806c770522a293b45b575dbdcb398cb178a66a855703fd3"} Jun 10 19:50:09.436568 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:09.436552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerDied","Data":"63a109ae28cb4cbaee529d2b45035d57c699de168168de6436cea5507831af9c"} Jun 10 19:50:10.299462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.299433 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:10.299599 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:10.299553 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:10.299599 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.299592 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:10.299719 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:10.299657 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:10.439688 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.439609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7cgvb" event={"ID":"af469872-8625-4ecd-9c52-ec7e30eb0735","Type":"ContainerStarted","Data":"d517a9641faa6faecdcf55d8afea1f893ccc5645c1606a5939077c9098f190fa"} Jun 10 19:50:10.441704 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.441669 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" event={"ID":"59279314-7623-4ab6-aa9c-3ff343ba4655","Type":"ContainerStarted","Data":"bf459d933b7931aca0668818df0f2b1a585288b1c99a31acd1e67f74db1b5776"} Jun 10 19:50:10.461374 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.461334 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7cgvb" podStartSLOduration=5.7687996219999995 podStartE2EDuration="24.46131967s" totalImagesPullingTime="18.692520048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:10.46100225 +0000 UTC m=+24.560395986" watchObservedRunningTime="2026-06-10 19:50:10.46131967 +0000 UTC m=+24.560713436" Jun 10 19:50:10.867951 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.867879 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:50:10.868406 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.868388 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:50:10.888402 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:10.888354 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xcz7s" podStartSLOduration=4.413618026 podStartE2EDuration="24.8883348s" totalImagesPullingTime="20.474716774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:10.539636098 +0000 UTC m=+24.639029838" watchObservedRunningTime="2026-06-10 19:50:10.8883348 +0000 UTC m=+24.987728541" Jun 10 19:50:11.299283 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:11.299188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:11.299441 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:11.299348 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:11.447339 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:11.447309 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 19:50:11.447905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:11.447806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"94eb52045089a290d7c04a4cdfe00341407900d1f42575732e45398ba5039e52"} Jun 10 19:50:12.299307 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:12.299275 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:12.299491 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:12.299321 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:12.299491 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:12.299409 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:12.299593 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:12.299525 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:13.103790 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.103572 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:50:13.104193 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.103922 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 19:50:13.104424 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.104398 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xzhbm" Jun 10 19:50:13.299907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.299796 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:13.300070 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:13.299907 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:13.453152 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.453115 2567 generic.go:356] "Generic (PLEG): container finished" podID="6880c3bf-299e-488a-8c72-b48b14ba4640" containerID="c8e806ce3ec1a0de58187a63b8f547ff58abce165b5b0ac20fc877e09dbcdf81" exitCode=0 Jun 10 19:50:13.453341 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.453206 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerDied","Data":"c8e806ce3ec1a0de58187a63b8f547ff58abce165b5b0ac20fc877e09dbcdf81"} Jun 10 19:50:13.456546 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.456530 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 19:50:13.456940 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.456921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"c6831680434c3561417e2cea1658bee5c56de352789ec9d222d9c2635fa6e9fe"} Jun 10 19:50:13.457414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.457398 2567 scope.go:117] "RemoveContainer" containerID="63a109ae28cb4cbaee529d2b45035d57c699de168168de6436cea5507831af9c" Jun 10 19:50:13.457512 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.457417 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:50:13.457512 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.457472 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:50:13.473372 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:13.473354 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:50:14.302343 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.302080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:14.302818 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:14.302455 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:14.302884 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.302844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:14.302956 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:14.302927 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:14.464271 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.464172 2567 generic.go:356] "Generic (PLEG): container finished" podID="6880c3bf-299e-488a-8c72-b48b14ba4640" containerID="000e7329e6769935083451f19a7c8f726a3ac2bf2e93d94c4a3df0ca3fbc1af0" exitCode=0 Jun 10 19:50:14.464271 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.464247 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerDied","Data":"000e7329e6769935083451f19a7c8f726a3ac2bf2e93d94c4a3df0ca3fbc1af0"} Jun 10 19:50:14.468093 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.468076 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 19:50:14.468438 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.468417 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" event={"ID":"0c569a42-f44d-4507-ac18-9f43b0ece800","Type":"ContainerStarted","Data":"995fd975638f27adc237759a0613f180d498a9411971cae7ad7b5759449bbc34"} Jun 10 19:50:14.468603 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.468584 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:50:14.483384 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.483363 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:50:14.527149 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:14.527104 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" podStartSLOduration=9.52311443 podStartE2EDuration="28.527089308s" totalImagesPullingTime="19.003974878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:14.525541867 +0000 UTC m=+28.624935606" watchObservedRunningTime="2026-06-10 19:50:14.527089308 +0000 UTC m=+28.626483047" Jun 10 19:50:15.112721 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.112691 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-65hm9"] Jun 10 19:50:15.112849 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.112800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:15.112897 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:15.112880 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:15.115775 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.115748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9ctj9"] Jun 10 19:50:15.115877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.115853 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:15.115953 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:15.115936 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:15.121741 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.121719 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vs7cp"] Jun 10 19:50:15.121839 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.121813 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:15.121924 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:15.121904 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:15.472749 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.472722 2567 generic.go:356] "Generic (PLEG): container finished" podID="6880c3bf-299e-488a-8c72-b48b14ba4640" containerID="d260d6e3066499e00a883063057ce1a1fd10597d7bf002e3139537de3e06cf09" exitCode=0 Jun 10 19:50:15.473208 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:15.472808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerDied","Data":"d260d6e3066499e00a883063057ce1a1fd10597d7bf002e3139537de3e06cf09"} Jun 10 19:50:16.300298 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:16.300266 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:16.300486 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:16.300381 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:16.300486 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:16.300430 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:16.300610 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:16.300540 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:17.299464 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:17.299436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:17.300087 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:17.299538 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:18.299591 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:18.299551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:18.300055 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:18.299674 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:18.300055 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:18.299731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:18.300055 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:18.299854 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:19.299779 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:19.299749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:19.300146 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:19.299857 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:19.989334 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:19.989123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:19.989473 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:19.989305 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:50:19.989473 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:19.989375 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:50:19.989473 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:19.989387 2567 projected.go:196] Error preparing data for projected volume kube-api-access-pxt9d for pod openshift-network-diagnostics/network-check-target-vs7cp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:50:19.989473 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:19.989434 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d podName:a18f28f6-70b9-4f38-b7e1-deef4df4e9df nodeName:}" failed. No retries permitted until 2026-06-10 19:50:51.989420049 +0000 UTC m=+66.088813780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxt9d" (UniqueName: "kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d") pod "network-check-target-vs7cp" (UID: "a18f28f6-70b9-4f38-b7e1-deef4df4e9df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:50:20.089985 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:20.089956 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:20.090149 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:20.089995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:20.090149 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:20.090121 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:50:20.090277 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:20.090159 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:50:20.090277 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:20.090198 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret podName:7cdc7488-1c8f-424b-be1d-fb08e3c7db2a nodeName:}" failed. No retries permitted until 2026-06-10 19:50:52.090176718 +0000 UTC m=+66.189570455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret") pod "global-pull-secret-syncer-65hm9" (UID: "7cdc7488-1c8f-424b-be1d-fb08e3c7db2a") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:50:20.090277 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:20.090237 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs podName:3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:52.090208434 +0000 UTC m=+66.189602159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs") pod "network-metrics-daemon-9ctj9" (UID: "3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:50:20.302109 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:20.302080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:20.302558 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:20.302167 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs7cp" podUID="a18f28f6-70b9-4f38-b7e1-deef4df4e9df" Jun 10 19:50:20.302558 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:20.302234 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:20.302558 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:20.302355 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9ctj9" podUID="3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83" Jun 10 19:50:20.487197 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:20.487163 2567 generic.go:356] "Generic (PLEG): container finished" podID="6880c3bf-299e-488a-8c72-b48b14ba4640" containerID="8e57a3331ca440465125cc8f8ec7943c43089494347210f2a53d44a09219df17" exitCode=0 Jun 10 19:50:20.487434 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:20.487259 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerDied","Data":"8e57a3331ca440465125cc8f8ec7943c43089494347210f2a53d44a09219df17"} Jun 10 19:50:21.299539 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.299509 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:21.299730 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:21.299617 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65hm9" podUID="7cdc7488-1c8f-424b-be1d-fb08e3c7db2a" Jun 10 19:50:21.492778 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.492747 2567 generic.go:356] "Generic (PLEG): container finished" podID="6880c3bf-299e-488a-8c72-b48b14ba4640" containerID="fb1a7211abffedc1cb501082e7c61dd30d31ad8388455b71099e8294ec4afb45" exitCode=0 Jun 10 19:50:21.493145 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.492806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerDied","Data":"fb1a7211abffedc1cb501082e7c61dd30d31ad8388455b71099e8294ec4afb45"} Jun 10 19:50:21.760981 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.760954 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-154.ec2.internal" event="NodeReady" Jun 10 19:50:21.761153 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.761068 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 19:50:21.825697 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.825630 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c857bf459-r76d9"] Jun 10 19:50:21.844062 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.844026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:21.878627 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.878597 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 19:50:21.900419 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.900386 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7"] Jun 10 19:50:21.900833 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.900815 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 19:50:21.901525 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.901510 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7nhw\"" Jun 10 19:50:21.915832 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.915815 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss"] Jun 10 19:50:21.915965 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.915949 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" Jun 10 19:50:21.922462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.922445 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 19:50:21.926365 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:21.926343 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"volume-data-source-validator-dockercfg-lnjrs\" is forbidden: User \"system:node:ip-10-0-129-154.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-129-154.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lnjrs\"" type="*v1.Secret" Jun 10 19:50:21.929682 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.929667 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf"] Jun 10 19:50:21.929790 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.929778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:21.938346 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.938329 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 19:50:21.938433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.938380 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:50:21.938433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.938384 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 19:50:21.938433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.938418 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8mchw\"" Jun 10 19:50:21.938628 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.938616 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:50:21.938857 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.938845 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 19:50:21.939334 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.939320 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 19:50:21.945802 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.945789 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:21.965824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.965808 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 19:50:21.967062 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.967042 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 19:50:21.967140 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.967064 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:50:21.970979 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.970959 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c857bf459-r76d9"] Jun 10 19:50:21.971561 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.971544 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 19:50:21.971659 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:21.971629 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8hj6g\"" Jun 10 19:50:22.002598 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtckb\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-kube-api-access-jtckb\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.002732 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002617 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-registry-certificates\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.002732 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-trusted-ca\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.002732 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-image-registry-private-configuration\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.002732 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65l2t\" (UniqueName: \"kubernetes.io/projected/449ec46e-14cc-4981-af6a-dfe3fd38f28e-kube-api-access-65l2t\") pod \"volume-data-source-validator-78dd696465-hksp7\" (UID: \"449ec46e-14cc-4981-af6a-dfe3fd38f28e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" Jun 10 19:50:22.002898 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80856b70-5375-4e88-bfac-0791c1bcb250-ca-trust-extracted\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.002898 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.002898 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-bound-sa-token\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.002898 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.002852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-installation-pull-secrets\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.023537 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.023513 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7"] Jun 10 19:50:22.024117 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.024098 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf"] Jun 10 19:50:22.025022 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.024991 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 19:50:22.048104 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.048077 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-95bbc"] Jun 10 19:50:22.069367 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.069346 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss"] Jun 10 19:50:22.069450 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.069373 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nggcf"] Jun 10 19:50:22.069450 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.069423 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.085743 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.085692 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.085743 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.085699 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm"] Jun 10 19:50:22.098123 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.098104 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 19:50:22.098338 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.098324 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-md4pq\"" Jun 10 19:50:22.099400 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.099385 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 19:50:22.103658 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.103639 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-gtzwp"] Jun 10 19:50:22.103740 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.103715 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" Jun 10 19:50:22.103819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.103801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtckb\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-kube-api-access-jtckb\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.103877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.103831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9ca5ba4-7e29-4d87-b300-65f239e9514e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.103877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.103862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48d98caa-fe9f-4009-9a3c-fe17d60ff581-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.104056 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9ca5ba4-7e29-4d87-b300-65f239e9514e-config\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.104113 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48d98caa-fe9f-4009-9a3c-fe17d60ff581-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.104161 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104132 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-registry-certificates\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.104237 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdg5\" (UniqueName: \"kubernetes.io/projected/b9ca5ba4-7e29-4d87-b300-65f239e9514e-kube-api-access-zvdg5\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.104237 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-trusted-ca\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.104352 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-image-registry-private-configuration\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.104352 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65l2t\" (UniqueName: \"kubernetes.io/projected/449ec46e-14cc-4981-af6a-dfe3fd38f28e-kube-api-access-65l2t\") pod \"volume-data-source-validator-78dd696465-hksp7\" (UID: \"449ec46e-14cc-4981-af6a-dfe3fd38f28e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80856b70-5375-4e88-bfac-0791c1bcb250-ca-trust-extracted\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-bound-sa-token\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104915 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-installation-pull-secrets\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.104946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8m2\" (UniqueName: \"kubernetes.io/projected/48d98caa-fe9f-4009-9a3c-fe17d60ff581-kube-api-access-sl8m2\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.105251 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-registry-certificates\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.105898 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80856b70-5375-4e88-bfac-0791c1bcb250-ca-trust-extracted\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.105965 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.105982 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c857bf459-r76d9: secret "image-registry-tls" not found Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.106425 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls podName:80856b70-5375-4e88-bfac-0791c1bcb250 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:22.606398467 +0000 UTC m=+36.705792205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls") pod "image-registry-7c857bf459-r76d9" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250") : secret "image-registry-tls" not found Jun 10 19:50:22.108294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.106809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-trusted-ca\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.110800 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.110777 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-image-registry-private-configuration\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.111082 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.111065 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-installation-pull-secrets\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.117653 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.117624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 19:50:22.117653 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.117647 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 19:50:22.117779 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.117736 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ltkhb\"" Jun 10 19:50:22.117779 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.117763 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 19:50:22.117940 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.117926 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 19:50:22.117981 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.117948 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 19:50:22.123797 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.123779 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n"] Jun 10 19:50:22.123923 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.123905 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.136925 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.136903 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 19:50:22.137034 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.137003 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 19:50:22.137112 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.136903 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:50:22.139317 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.139294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-bound-sa-token\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.139420 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.139303 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65l2t\" (UniqueName: \"kubernetes.io/projected/449ec46e-14cc-4981-af6a-dfe3fd38f28e-kube-api-access-65l2t\") pod \"volume-data-source-validator-78dd696465-hksp7\" (UID: \"449ec46e-14cc-4981-af6a-dfe3fd38f28e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" Jun 10 19:50:22.139420 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.139378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtckb\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-kube-api-access-jtckb\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.141308 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.141290 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 19:50:22.141580 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.141566 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-grv56\"" Jun 10 19:50:22.141759 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.141747 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nbgmx\"" Jun 10 19:50:22.148039 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.148024 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-5jv8x"] Jun 10 19:50:22.148142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.148129 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:22.152119 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.152101 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wr5sq\"" Jun 10 19:50:22.152202 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.152122 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:50:22.152268 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.152244 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 19:50:22.152562 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.152547 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 19:50:22.167200 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.167182 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 19:50:22.170592 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.170576 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s"] Jun 10 19:50:22.170699 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.170687 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.175025 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.175010 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 19:50:22.176076 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.175782 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 19:50:22.178795 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.178441 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 19:50:22.178795 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.178642 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zm66q\"" Jun 10 19:50:22.178941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.178800 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 19:50:22.181982 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.181961 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 19:50:22.192663 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.192645 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7868745755-r5db4"] Jun 10 19:50:22.192773 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.192759 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:22.195392 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.195376 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-plkzc\"" Jun 10 19:50:22.195392 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.195385 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 19:50:22.195810 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.195795 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 19:50:22.205958 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.205938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-tmp-dir\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.206050 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.205976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-config-volume\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.206050 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206005 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8m2\" (UniqueName: \"kubernetes.io/projected/48d98caa-fe9f-4009-9a3c-fe17d60ff581-kube-api-access-sl8m2\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.206120 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjfjk\" (UniqueName: \"kubernetes.io/projected/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-kube-api-access-tjfjk\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.206120 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9ca5ba4-7e29-4d87-b300-65f239e9514e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.206212 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48d98caa-fe9f-4009-9a3c-fe17d60ff581-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.206212 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9ca5ba4-7e29-4d87-b300-65f239e9514e-config\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.206212 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5542\" (UniqueName: \"kubernetes.io/projected/976081e7-eea3-4996-bfa9-8debc8d3cd64-kube-api-access-r5542\") pod \"network-check-source-dbd9cf844-clmwm\" (UID: \"976081e7-eea3-4996-bfa9-8debc8d3cd64\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" Jun 10 19:50:22.206385 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bc3c612-2c52-46de-80b9-2b5be013dd74-cert\") pod \"ingress-canary-nggcf\" (UID: \"9bc3c612-2c52-46de-80b9-2b5be013dd74\") " pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.206385 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48d98caa-fe9f-4009-9a3c-fe17d60ff581-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.206385 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.206385 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdg5\" (UniqueName: \"kubernetes.io/projected/b9ca5ba4-7e29-4d87-b300-65f239e9514e-kube-api-access-zvdg5\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.206558 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdj2z\" (UniqueName: \"kubernetes.io/projected/9bc3c612-2c52-46de-80b9-2b5be013dd74-kube-api-access-tdj2z\") pod \"ingress-canary-nggcf\" (UID: \"9bc3c612-2c52-46de-80b9-2b5be013dd74\") " pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.206680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206656 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48d98caa-fe9f-4009-9a3c-fe17d60ff581-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.206775 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.206755 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9ca5ba4-7e29-4d87-b300-65f239e9514e-config\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.208453 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.208428 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9ca5ba4-7e29-4d87-b300-65f239e9514e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.208528 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.208473 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48d98caa-fe9f-4009-9a3c-fe17d60ff581-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.212609 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.212586 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw"] Jun 10 19:50:22.212702 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.212633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.219102 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.219080 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 19:50:22.219217 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.219197 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 19:50:22.219358 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.219335 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ncc6f\"" Jun 10 19:50:22.219468 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.219448 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 19:50:22.219673 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.219644 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 19:50:22.219851 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.219827 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 19:50:22.220130 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.220112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 19:50:22.221800 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.221776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8m2\" (UniqueName: \"kubernetes.io/projected/48d98caa-fe9f-4009-9a3c-fe17d60ff581-kube-api-access-sl8m2\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8ktss\" (UID: \"48d98caa-fe9f-4009-9a3c-fe17d60ff581\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.222301 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.222274 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdg5\" (UniqueName: \"kubernetes.io/projected/b9ca5ba4-7e29-4d87-b300-65f239e9514e-kube-api-access-zvdg5\") pod \"service-ca-operator-6bc5ff68f5-cb7cf\" (UID: \"b9ca5ba4-7e29-4d87-b300-65f239e9514e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.237237 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.237208 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" Jun 10 19:50:22.238489 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238473 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n"] Jun 10 19:50:22.238566 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238502 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95bbc"] Jun 10 19:50:22.238566 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238518 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s"] Jun 10 19:50:22.238566 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238530 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm"] Jun 10 19:50:22.238706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.238706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238614 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-gtzwp"] Jun 10 19:50:22.238706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238631 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5jv8x"] Jun 10 19:50:22.238706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238644 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nggcf"] Jun 10 19:50:22.238706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238656 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7868745755-r5db4"] Jun 10 19:50:22.238706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.238667 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw"] Jun 10 19:50:22.241817 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.241801 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 19:50:22.241891 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.241842 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 19:50:22.242252 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.242238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kjdq7\"" Jun 10 19:50:22.242742 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.242728 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 19:50:22.243616 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.243601 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 19:50:22.253620 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.253603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" Jun 10 19:50:22.299732 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.299628 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:22.300501 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.300304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:22.302800 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.302658 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-km5qb\"" Jun 10 19:50:22.302929 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.302809 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 19:50:22.303568 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.303395 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l9txq\"" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88c8k\" (UniqueName: \"kubernetes.io/projected/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-kube-api-access-88c8k\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-config-volume\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edea99ce-d5a4-486f-ac8a-0deb0c726942-snapshots\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knls\" (UniqueName: \"kubernetes.io/projected/edea99ce-d5a4-486f-ac8a-0deb0c726942-kube-api-access-9knls\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78v7v\" (UniqueName: \"kubernetes.io/projected/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-kube-api-access-78v7v\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-config\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjfjk\" (UniqueName: \"kubernetes.io/projected/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-kube-api-access-tjfjk\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdn6\" (UniqueName: \"kubernetes.io/projected/8baf22c2-d22a-4660-805e-e6bb41245dfb-kube-api-access-xzdn6\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-trusted-ca\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.308973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5542\" (UniqueName: \"kubernetes.io/projected/976081e7-eea3-4996-bfa9-8debc8d3cd64-kube-api-access-r5542\") pod \"network-check-source-dbd9cf844-clmwm\" (UID: \"976081e7-eea3-4996-bfa9-8debc8d3cd64\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdj2z\" (UniqueName: \"kubernetes.io/projected/9bc3c612-2c52-46de-80b9-2b5be013dd74-kube-api-access-tdj2z\") pod \"ingress-canary-nggcf\" (UID: \"9bc3c612-2c52-46de-80b9-2b5be013dd74\") " pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-default-certificate\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-tmp-dir\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.312396 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edea99ce-d5a4-486f-ac8a-0deb0c726942-trusted-ca-bundle\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edea99ce-d5a4-486f-ac8a-0deb0c726942-service-ca-bundle\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edea99ce-d5a4-486f-ac8a-0deb0c726942-serving-cert\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edea99ce-d5a4-486f-ac8a-0deb0c726942-tmp\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bc3c612-2c52-46de-80b9-2b5be013dd74-cert\") pod \"ingress-canary-nggcf\" (UID: \"9bc3c612-2c52-46de-80b9-2b5be013dd74\") " pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309348 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309405 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-stats-auth\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-serving-cert\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/29afa0d1-1603-4521-961c-46b333e4c7a6-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.309718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-config-volume\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.310284 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-tmp-dir\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.310444 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:50:22.313127 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.310494 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls podName:a2c24cf2-68d3-415f-86dd-1fbcdf68256c nodeName:}" failed. No retries permitted until 2026-06-10 19:50:22.810477416 +0000 UTC m=+36.909871149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls") pod "dns-default-95bbc" (UID: "a2c24cf2-68d3-415f-86dd-1fbcdf68256c") : secret "dns-default-metrics-tls" not found Jun 10 19:50:22.325895 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.325863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bc3c612-2c52-46de-80b9-2b5be013dd74-cert\") pod \"ingress-canary-nggcf\" (UID: \"9bc3c612-2c52-46de-80b9-2b5be013dd74\") " pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.328639 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.328589 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5542\" (UniqueName: \"kubernetes.io/projected/976081e7-eea3-4996-bfa9-8debc8d3cd64-kube-api-access-r5542\") pod \"network-check-source-dbd9cf844-clmwm\" (UID: \"976081e7-eea3-4996-bfa9-8debc8d3cd64\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" Jun 10 19:50:22.328759 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.328728 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdj2z\" (UniqueName: \"kubernetes.io/projected/9bc3c612-2c52-46de-80b9-2b5be013dd74-kube-api-access-tdj2z\") pod \"ingress-canary-nggcf\" (UID: \"9bc3c612-2c52-46de-80b9-2b5be013dd74\") " pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.340415 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.334064 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjfjk\" (UniqueName: \"kubernetes.io/projected/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-kube-api-access-tjfjk\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.393542 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.393519 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nggcf" Jun 10 19:50:22.410554 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.410680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.410680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.410680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-stats-auth\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.410680 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.410641 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:50:22.410680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-serving-cert\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjj4\" (UniqueName: \"kubernetes.io/projected/781b0632-67b4-43cd-92ab-a97088cf8ba2-kube-api-access-4gjj4\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.410705 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:22.910683064 +0000 UTC m=+37.010076799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : secret "router-metrics-certs-default" not found Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.410727 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:22.910717841 +0000 UTC m=+37.010111564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : configmap references non-existent config key: service-ca.crt Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/29afa0d1-1603-4521-961c-46b333e4c7a6-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88c8k\" (UniqueName: \"kubernetes.io/projected/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-kube-api-access-88c8k\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edea99ce-d5a4-486f-ac8a-0deb0c726942-snapshots\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410878 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9knls\" (UniqueName: \"kubernetes.io/projected/edea99ce-d5a4-486f-ac8a-0deb0c726942-kube-api-access-9knls\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78v7v\" (UniqueName: \"kubernetes.io/projected/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-kube-api-access-78v7v\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.410941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-config\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdn6\" (UniqueName: \"kubernetes.io/projected/8baf22c2-d22a-4660-805e-e6bb41245dfb-kube-api-access-xzdn6\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.410987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-trusted-ca\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-default-certificate\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edea99ce-d5a4-486f-ac8a-0deb0c726942-trusted-ca-bundle\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edea99ce-d5a4-486f-ac8a-0deb0c726942-service-ca-bundle\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edea99ce-d5a4-486f-ac8a-0deb0c726942-serving-cert\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edea99ce-d5a4-486f-ac8a-0deb0c726942-tmp\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/781b0632-67b4-43cd-92ab-a97088cf8ba2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.411373 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.411362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:22.411730 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.411508 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 19:50:22.411730 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.411560 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls podName:8baf22c2-d22a-4660-805e-e6bb41245dfb nodeName:}" failed. No retries permitted until 2026-06-10 19:50:22.91154249 +0000 UTC m=+37.010936223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gtg7n" (UID: "8baf22c2-d22a-4660-805e-e6bb41245dfb") : secret "samples-operator-tls" not found Jun 10 19:50:22.411957 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.411939 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:50:22.412024 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.412010 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/edea99ce-d5a4-486f-ac8a-0deb0c726942-snapshots\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.412091 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.412010 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-config\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.412091 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.412020 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert podName:29afa0d1-1603-4521-961c-46b333e4c7a6 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:22.912003526 +0000 UTC m=+37.011397251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zc84s" (UID: "29afa0d1-1603-4521-961c-46b333e4c7a6") : secret "networking-console-plugin-cert" not found Jun 10 19:50:22.412091 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.412052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/29afa0d1-1603-4521-961c-46b333e4c7a6-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:22.412091 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.412085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edea99ce-d5a4-486f-ac8a-0deb0c726942-service-ca-bundle\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.412324 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.412291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edea99ce-d5a4-486f-ac8a-0deb0c726942-tmp\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.413085 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.413057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-trusted-ca\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.413269 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.413249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edea99ce-d5a4-486f-ac8a-0deb0c726942-trusted-ca-bundle\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.414551 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.414533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-default-certificate\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.414551 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.414548 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-stats-auth\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.414699 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.414536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-serving-cert\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.415005 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.414986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edea99ce-d5a4-486f-ac8a-0deb0c726942-serving-cert\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.418804 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.418784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" Jun 10 19:50:22.424058 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.424038 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knls\" (UniqueName: \"kubernetes.io/projected/edea99ce-d5a4-486f-ac8a-0deb0c726942-kube-api-access-9knls\") pod \"insights-operator-896549976-5jv8x\" (UID: \"edea99ce-d5a4-486f-ac8a-0deb0c726942\") " pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.425466 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.425443 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78v7v\" (UniqueName: \"kubernetes.io/projected/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-kube-api-access-78v7v\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.429564 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.429541 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf"] Jun 10 19:50:22.430495 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.430471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdn6\" (UniqueName: \"kubernetes.io/projected/8baf22c2-d22a-4660-805e-e6bb41245dfb-kube-api-access-xzdn6\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:22.430710 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:22.430692 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ca5ba4_7e29_4d87_b300_65f239e9514e.slice/crio-6ad31ceaaf63b2b31eb895efb6c3372e0a6d827db6c7d1b1f1c0479539770ff7 WatchSource:0}: Error finding container 6ad31ceaaf63b2b31eb895efb6c3372e0a6d827db6c7d1b1f1c0479539770ff7: Status 404 returned error can't find the container with id 6ad31ceaaf63b2b31eb895efb6c3372e0a6d827db6c7d1b1f1c0479539770ff7 Jun 10 19:50:22.435614 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.435578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88c8k\" (UniqueName: \"kubernetes.io/projected/2c03f74c-3831-4e71-a3a1-458b7e68ff6d-kube-api-access-88c8k\") pod \"console-operator-668fdbf85c-gtzwp\" (UID: \"2c03f74c-3831-4e71-a3a1-458b7e68ff6d\") " pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.437750 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.437720 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss"] Jun 10 19:50:22.442746 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:22.442723 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d98caa_fe9f_4009_9a3c_fe17d60ff581.slice/crio-0fcf3da6f7f8bb5c60d285b4ab1cdfc4dcf7d706139be8f92dc0ae3862cf3ceb WatchSource:0}: Error finding container 0fcf3da6f7f8bb5c60d285b4ab1cdfc4dcf7d706139be8f92dc0ae3862cf3ceb: Status 404 returned error can't find the container with id 0fcf3da6f7f8bb5c60d285b4ab1cdfc4dcf7d706139be8f92dc0ae3862cf3ceb Jun 10 19:50:22.479861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.479840 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5jv8x" Jun 10 19:50:22.502739 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.502637 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkcst" event={"ID":"6880c3bf-299e-488a-8c72-b48b14ba4640","Type":"ContainerStarted","Data":"28e96fab4816fc48f6da2d954814eefa9561c701f03d064d7cad960c68e70cf2"} Jun 10 19:50:22.504758 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.504732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" event={"ID":"b9ca5ba4-7e29-4d87-b300-65f239e9514e","Type":"ContainerStarted","Data":"6ad31ceaaf63b2b31eb895efb6c3372e0a6d827db6c7d1b1f1c0479539770ff7"} Jun 10 19:50:22.505986 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.505965 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" event={"ID":"48d98caa-fe9f-4009-9a3c-fe17d60ff581","Type":"ContainerStarted","Data":"0fcf3da6f7f8bb5c60d285b4ab1cdfc4dcf7d706139be8f92dc0ae3862cf3ceb"} Jun 10 19:50:22.512118 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.512090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.512254 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.512148 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjj4\" (UniqueName: \"kubernetes.io/projected/781b0632-67b4-43cd-92ab-a97088cf8ba2-kube-api-access-4gjj4\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.512648 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.512328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/781b0632-67b4-43cd-92ab-a97088cf8ba2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.512648 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.512359 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:22.512648 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.512431 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls podName:781b0632-67b4-43cd-92ab-a97088cf8ba2 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:23.012412785 +0000 UTC m=+37.111806504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2bvqw" (UID: "781b0632-67b4-43cd-92ab-a97088cf8ba2") : secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:22.513150 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.513127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/781b0632-67b4-43cd-92ab-a97088cf8ba2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.521886 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.521744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjj4\" (UniqueName: \"kubernetes.io/projected/781b0632-67b4-43cd-92ab-a97088cf8ba2-kube-api-access-4gjj4\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:22.527805 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.527749 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rkcst" podStartSLOduration=7.922427658 podStartE2EDuration="36.527728616s" totalImagesPullingTime="28.605300958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:22.526392807 +0000 UTC m=+36.625786548" watchObservedRunningTime="2026-06-10 19:50:22.527728616 +0000 UTC m=+36.627122359" Jun 10 19:50:22.556334 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.556305 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nggcf"] Jun 10 19:50:22.558016 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:22.557981 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc3c612_2c52_46de_80b9_2b5be013dd74.slice/crio-e9cc5c168cbc036fa29c1ec60eda94ce6b7b09ccf9ae2e171aada7b4f2254aa8 WatchSource:0}: Error finding container e9cc5c168cbc036fa29c1ec60eda94ce6b7b09ccf9ae2e171aada7b4f2254aa8: Status 404 returned error can't find the container with id e9cc5c168cbc036fa29c1ec60eda94ce6b7b09ccf9ae2e171aada7b4f2254aa8 Jun 10 19:50:22.579162 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.576723 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm"] Jun 10 19:50:22.583462 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:22.583433 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976081e7_eea3_4996_bfa9_8debc8d3cd64.slice/crio-4790cd8e3c18aa1adc678e2388697f01a8e69f4a5492d4e78652ad70f18ead28 WatchSource:0}: Error finding container 4790cd8e3c18aa1adc678e2388697f01a8e69f4a5492d4e78652ad70f18ead28: Status 404 returned error can't find the container with id 4790cd8e3c18aa1adc678e2388697f01a8e69f4a5492d4e78652ad70f18ead28 Jun 10 19:50:22.613675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.613615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:22.613892 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.613866 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:50:22.613892 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.613881 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c857bf459-r76d9: secret "image-registry-tls" not found Jun 10 19:50:22.614066 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.614030 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls podName:80856b70-5375-4e88-bfac-0791c1bcb250 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:23.614009475 +0000 UTC m=+37.713403198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls") pod "image-registry-7c857bf459-r76d9" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250") : secret "image-registry-tls" not found Jun 10 19:50:22.644099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.644075 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5jv8x"] Jun 10 19:50:22.647279 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:22.647255 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedea99ce_d5a4_486f_ac8a_0deb0c726942.slice/crio-6df49633aeefa3bd5a26ac0d68add4a38e060b92c374de69219b01edb88a3757 WatchSource:0}: Error finding container 6df49633aeefa3bd5a26ac0d68add4a38e060b92c374de69219b01edb88a3757: Status 404 returned error can't find the container with id 6df49633aeefa3bd5a26ac0d68add4a38e060b92c374de69219b01edb88a3757 Jun 10 19:50:22.732513 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.732483 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:22.815766 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.815734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:22.815912 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.815895 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:50:22.815987 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.815946 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls podName:a2c24cf2-68d3-415f-86dd-1fbcdf68256c nodeName:}" failed. No retries permitted until 2026-06-10 19:50:23.815932779 +0000 UTC m=+37.915326497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls") pod "dns-default-95bbc" (UID: "a2c24cf2-68d3-415f-86dd-1fbcdf68256c") : secret "dns-default-metrics-tls" not found Jun 10 19:50:22.888283 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.888202 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-gtzwp"] Jun 10 19:50:22.891178 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:22.891154 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c03f74c_3831_4e71_a3a1_458b7e68ff6d.slice/crio-7b62e225b955ab6bf1da210a5ac78fe63a5084c1c812044b4dcdea1815f02464 WatchSource:0}: Error finding container 7b62e225b955ab6bf1da210a5ac78fe63a5084c1c812044b4dcdea1815f02464: Status 404 returned error can't find the container with id 7b62e225b955ab6bf1da210a5ac78fe63a5084c1c812044b4dcdea1815f02464 Jun 10 19:50:22.916889 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.916858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:22.917057 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.916911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.917057 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.916940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:22.917057 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:22.917001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:22.917057 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.917007 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 19:50:22.917057 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.917037 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:50:22.917248 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.917073 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls podName:8baf22c2-d22a-4660-805e-e6bb41245dfb nodeName:}" failed. No retries permitted until 2026-06-10 19:50:23.917053417 +0000 UTC m=+38.016447139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gtg7n" (UID: "8baf22c2-d22a-4660-805e-e6bb41245dfb") : secret "samples-operator-tls" not found Jun 10 19:50:22.917248 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.917090 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:23.917083776 +0000 UTC m=+38.016477494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : secret "router-metrics-certs-default" not found Jun 10 19:50:22.917248 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.917093 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:50:22.917248 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.917129 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert podName:29afa0d1-1603-4521-961c-46b333e4c7a6 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:23.917118183 +0000 UTC m=+38.016511901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zc84s" (UID: "29afa0d1-1603-4521-961c-46b333e4c7a6") : secret "networking-console-plugin-cert" not found Jun 10 19:50:22.917248 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:22.917146 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:23.917136757 +0000 UTC m=+38.016530476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : configmap references non-existent config key: service-ca.crt Jun 10 19:50:23.017754 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.017723 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:23.017916 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.017864 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:23.017967 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.017925 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls podName:781b0632-67b4-43cd-92ab-a97088cf8ba2 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:24.01790984 +0000 UTC m=+38.117303559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2bvqw" (UID: "781b0632-67b4-43cd-92ab-a97088cf8ba2") : secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:23.225328 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.225038 2567 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jun 10 19:50:23.225328 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.225101 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" Jun 10 19:50:23.299327 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.299251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:23.302891 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.302663 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 19:50:23.409898 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.409780 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7"] Jun 10 19:50:23.414276 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:23.414235 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449ec46e_14cc_4981_af6a_dfe3fd38f28e.slice/crio-0f8fe843e50b5310847f6885613804b4b3c8c0711e3f1d2f1ac7e07b53bc0dfa WatchSource:0}: Error finding container 0f8fe843e50b5310847f6885613804b4b3c8c0711e3f1d2f1ac7e07b53bc0dfa: Status 404 returned error can't find the container with id 0f8fe843e50b5310847f6885613804b4b3c8c0711e3f1d2f1ac7e07b53bc0dfa Jun 10 19:50:23.436822 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.436614 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lnjrs\"" Jun 10 19:50:23.510587 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.510456 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" event={"ID":"2c03f74c-3831-4e71-a3a1-458b7e68ff6d","Type":"ContainerStarted","Data":"7b62e225b955ab6bf1da210a5ac78fe63a5084c1c812044b4dcdea1815f02464"} Jun 10 19:50:23.512509 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.512457 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" event={"ID":"976081e7-eea3-4996-bfa9-8debc8d3cd64","Type":"ContainerStarted","Data":"4790cd8e3c18aa1adc678e2388697f01a8e69f4a5492d4e78652ad70f18ead28"} Jun 10 19:50:23.514238 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.514196 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nggcf" event={"ID":"9bc3c612-2c52-46de-80b9-2b5be013dd74","Type":"ContainerStarted","Data":"e9cc5c168cbc036fa29c1ec60eda94ce6b7b09ccf9ae2e171aada7b4f2254aa8"} Jun 10 19:50:23.517179 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.517130 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" event={"ID":"449ec46e-14cc-4981-af6a-dfe3fd38f28e","Type":"ContainerStarted","Data":"0f8fe843e50b5310847f6885613804b4b3c8c0711e3f1d2f1ac7e07b53bc0dfa"} Jun 10 19:50:23.520422 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.520355 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5jv8x" event={"ID":"edea99ce-d5a4-486f-ac8a-0deb0c726942","Type":"ContainerStarted","Data":"6df49633aeefa3bd5a26ac0d68add4a38e060b92c374de69219b01edb88a3757"} Jun 10 19:50:23.623965 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.623734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:23.624168 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.624053 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:50:23.624168 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.624072 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c857bf459-r76d9: secret "image-registry-tls" not found Jun 10 19:50:23.624168 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.624126 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls podName:80856b70-5375-4e88-bfac-0791c1bcb250 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:25.62410701 +0000 UTC m=+39.723500734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls") pod "image-registry-7c857bf459-r76d9" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250") : secret "image-registry-tls" not found Jun 10 19:50:23.827819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.827730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:23.827977 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.827899 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:50:23.827977 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.827967 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls podName:a2c24cf2-68d3-415f-86dd-1fbcdf68256c nodeName:}" failed. No retries permitted until 2026-06-10 19:50:25.827945823 +0000 UTC m=+39.927339542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls") pod "dns-default-95bbc" (UID: "a2c24cf2-68d3-415f-86dd-1fbcdf68256c") : secret "dns-default-metrics-tls" not found Jun 10 19:50:23.929190 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.929153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:23.929368 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.929250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:23.929368 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.929292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:23.929487 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:23.929393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:23.930585 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.929544 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:50:23.930585 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.929610 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert podName:29afa0d1-1603-4521-961c-46b333e4c7a6 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:25.92959068 +0000 UTC m=+40.028984399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zc84s" (UID: "29afa0d1-1603-4521-961c-46b333e4c7a6") : secret "networking-console-plugin-cert" not found Jun 10 19:50:23.930585 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.930009 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 19:50:23.930585 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.930060 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls podName:8baf22c2-d22a-4660-805e-e6bb41245dfb nodeName:}" failed. No retries permitted until 2026-06-10 19:50:25.930044767 +0000 UTC m=+40.029438492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gtg7n" (UID: "8baf22c2-d22a-4660-805e-e6bb41245dfb") : secret "samples-operator-tls" not found Jun 10 19:50:23.930585 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.930147 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:50:23.930585 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.930184 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:25.930172031 +0000 UTC m=+40.029565766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : secret "router-metrics-certs-default" not found Jun 10 19:50:23.930585 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:23.930274 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:25.930260138 +0000 UTC m=+40.029653869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : configmap references non-existent config key: service-ca.crt Jun 10 19:50:24.031168 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:24.030605 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:24.031168 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:24.030679 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls podName:781b0632-67b4-43cd-92ab-a97088cf8ba2 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:26.030660274 +0000 UTC m=+40.130054010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2bvqw" (UID: "781b0632-67b4-43cd-92ab-a97088cf8ba2") : secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:24.031506 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:24.030404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:25.648180 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:25.648138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:25.648607 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.648332 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:50:25.648607 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.648355 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c857bf459-r76d9: secret "image-registry-tls" not found Jun 10 19:50:25.648607 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.648421 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls podName:80856b70-5375-4e88-bfac-0791c1bcb250 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:29.648397553 +0000 UTC m=+43.747791271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls") pod "image-registry-7c857bf459-r76d9" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250") : secret "image-registry-tls" not found Jun 10 19:50:25.849625 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:25.849591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:25.849777 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.849745 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:50:25.849822 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.849810 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls podName:a2c24cf2-68d3-415f-86dd-1fbcdf68256c nodeName:}" failed. No retries permitted until 2026-06-10 19:50:29.849794786 +0000 UTC m=+43.949188504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls") pod "dns-default-95bbc" (UID: "a2c24cf2-68d3-415f-86dd-1fbcdf68256c") : secret "dns-default-metrics-tls" not found Jun 10 19:50:25.950715 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:25.950547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:25.950715 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.950685 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:50:25.950908 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:25.950736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:25.950908 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.950759 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:29.950744905 +0000 UTC m=+44.050138624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : secret "router-metrics-certs-default" not found Jun 10 19:50:25.950908 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.950813 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:29.950800141 +0000 UTC m=+44.050193860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : configmap references non-existent config key: service-ca.crt Jun 10 19:50:25.950908 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:25.950856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:25.950908 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:25.950893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:25.951159 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.951008 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:50:25.951159 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.951028 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 19:50:25.951159 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.951069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert podName:29afa0d1-1603-4521-961c-46b333e4c7a6 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:29.95105221 +0000 UTC m=+44.050445929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zc84s" (UID: "29afa0d1-1603-4521-961c-46b333e4c7a6") : secret "networking-console-plugin-cert" not found Jun 10 19:50:25.951159 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:25.951091 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls podName:8baf22c2-d22a-4660-805e-e6bb41245dfb nodeName:}" failed. No retries permitted until 2026-06-10 19:50:29.951081428 +0000 UTC m=+44.050475146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gtg7n" (UID: "8baf22c2-d22a-4660-805e-e6bb41245dfb") : secret "samples-operator-tls" not found Jun 10 19:50:26.051702 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:26.051666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:26.051872 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:26.051828 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:26.051914 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:26.051893 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls podName:781b0632-67b4-43cd-92ab-a97088cf8ba2 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:30.051877646 +0000 UTC m=+44.151271363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2bvqw" (UID: "781b0632-67b4-43cd-92ab-a97088cf8ba2") : secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:29.684819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:29.684764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:29.685255 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.684928 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:50:29.685255 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.684948 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c857bf459-r76d9: secret "image-registry-tls" not found Jun 10 19:50:29.685255 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.685023 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls podName:80856b70-5375-4e88-bfac-0791c1bcb250 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:37.685006356 +0000 UTC m=+51.784400086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls") pod "image-registry-7c857bf459-r76d9" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250") : secret "image-registry-tls" not found Jun 10 19:50:29.886842 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:29.886806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:29.886978 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.886952 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:50:29.887030 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.887014 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls podName:a2c24cf2-68d3-415f-86dd-1fbcdf68256c nodeName:}" failed. No retries permitted until 2026-06-10 19:50:37.886999244 +0000 UTC m=+51.986392963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls") pod "dns-default-95bbc" (UID: "a2c24cf2-68d3-415f-86dd-1fbcdf68256c") : secret "dns-default-metrics-tls" not found Jun 10 19:50:29.988004 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:29.987981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:29.988069 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:29.988022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:29.988109 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:29.988087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:29.988148 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.988130 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:50:29.988193 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.988184 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:37.988170195 +0000 UTC m=+52.087563912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : secret "router-metrics-certs-default" not found Jun 10 19:50:29.988287 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:29.988132 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:29.988287 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.988200 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 19:50:29.988287 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.988217 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:37.988201556 +0000 UTC m=+52.087595285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : configmap references non-existent config key: service-ca.crt Jun 10 19:50:29.988287 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.988241 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:50:29.988287 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.988262 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls podName:8baf22c2-d22a-4660-805e-e6bb41245dfb nodeName:}" failed. No retries permitted until 2026-06-10 19:50:37.988251706 +0000 UTC m=+52.087645431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gtg7n" (UID: "8baf22c2-d22a-4660-805e-e6bb41245dfb") : secret "samples-operator-tls" not found Jun 10 19:50:29.988468 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:29.988300 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert podName:29afa0d1-1603-4521-961c-46b333e4c7a6 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:37.988284141 +0000 UTC m=+52.087677878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zc84s" (UID: "29afa0d1-1603-4521-961c-46b333e4c7a6") : secret "networking-console-plugin-cert" not found Jun 10 19:50:30.088912 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.088875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:30.089050 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:30.088998 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:30.089050 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:30.089048 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls podName:781b0632-67b4-43cd-92ab-a97088cf8ba2 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:38.089035392 +0000 UTC m=+52.188429124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2bvqw" (UID: "781b0632-67b4-43cd-92ab-a97088cf8ba2") : secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:30.541619 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.541582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" event={"ID":"449ec46e-14cc-4981-af6a-dfe3fd38f28e","Type":"ContainerStarted","Data":"9a91fa1b8b213f07bff7ed7235445d72194e6f04ec3e6c14421dcee0865935cf"} Jun 10 19:50:30.543631 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.543577 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5jv8x" event={"ID":"edea99ce-d5a4-486f-ac8a-0deb0c726942","Type":"ContainerStarted","Data":"4f08cdd2137baa071931e3669671ce331d2a82d8cec6a0bd1ff84b452c884a26"} Jun 10 19:50:30.545704 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.545654 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" event={"ID":"976081e7-eea3-4996-bfa9-8debc8d3cd64","Type":"ContainerStarted","Data":"0678eb968f62901948cce0997fc1c413706b67b7aa04ca04be5531fee14e83fb"} Jun 10 19:50:30.549336 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.549077 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nggcf" event={"ID":"9bc3c612-2c52-46de-80b9-2b5be013dd74","Type":"ContainerStarted","Data":"d45fc2b2f2676bfa5ff7ede79bdaa3c98e12833d6156bf0e3d23217a68a77f40"} Jun 10 19:50:30.551512 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.551076 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" event={"ID":"48d98caa-fe9f-4009-9a3c-fe17d60ff581","Type":"ContainerStarted","Data":"d50155e6fea1276d316585db7b362307a0c09d78b3d34a6cba8d498479f34684"} Jun 10 19:50:30.564056 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.563799 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hksp7" podStartSLOduration=30.680404999 podStartE2EDuration="37.563775535s" totalImagesPullingTime="6.883370536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:30.560504564 +0000 UTC m=+44.659898305" watchObservedRunningTime="2026-06-10 19:50:30.563775535 +0000 UTC m=+44.663169277" Jun 10 19:50:30.584188 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.583398 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" podStartSLOduration=29.726902665 podStartE2EDuration="37.583364269s" totalImagesPullingTime="7.856461604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:30.582160887 +0000 UTC m=+44.681554628" watchObservedRunningTime="2026-06-10 19:50:30.583364269 +0000 UTC m=+44.682758011" Jun 10 19:50:30.603248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:30.601866 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-clmwm" podStartSLOduration=27.885189155 podStartE2EDuration="35.601845325s" totalImagesPullingTime="7.71665617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:30.600951943 +0000 UTC m=+44.700345683" watchObservedRunningTime="2026-06-10 19:50:30.601845325 +0000 UTC m=+44.701239066" Jun 10 19:50:31.556877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.556806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" event={"ID":"b9ca5ba4-7e29-4d87-b300-65f239e9514e","Type":"ContainerStarted","Data":"c2410bfee2fcd3ebe862ffa49054fa775a7d7ddcfc186e2d37fb205734ca2559"} Jun 10 19:50:31.558523 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.558500 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/0.log" Jun 10 19:50:31.558627 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.558542 2567 generic.go:356] "Generic (PLEG): container finished" podID="2c03f74c-3831-4e71-a3a1-458b7e68ff6d" containerID="7e6c75c62ce5c0a6d3e8e00c48bfd48087574f09dfdb5e4e6a1c851f8f432578" exitCode=255 Jun 10 19:50:31.558688 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.558650 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" event={"ID":"2c03f74c-3831-4e71-a3a1-458b7e68ff6d","Type":"ContainerDied","Data":"7e6c75c62ce5c0a6d3e8e00c48bfd48087574f09dfdb5e4e6a1c851f8f432578"} Jun 10 19:50:31.558815 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.558798 2567 scope.go:117] "RemoveContainer" containerID="7e6c75c62ce5c0a6d3e8e00c48bfd48087574f09dfdb5e4e6a1c851f8f432578" Jun 10 19:50:31.573945 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.573354 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" podStartSLOduration=30.70343242 podStartE2EDuration="38.573335786s" totalImagesPullingTime="7.869903366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:31.572664293 +0000 UTC m=+45.672058034" watchObservedRunningTime="2026-06-10 19:50:31.573335786 +0000 UTC m=+45.672729527" Jun 10 19:50:31.573945 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.573512 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nggcf" podStartSLOduration=2.832386573 podStartE2EDuration="10.573504291s" totalImagesPullingTime="7.741117718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:30.631888402 +0000 UTC m=+44.731282143" watchObservedRunningTime="2026-06-10 19:50:31.573504291 +0000 UTC m=+45.672898032" Jun 10 19:50:31.611099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:31.610772 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-5jv8x" podStartSLOduration=30.958143696 podStartE2EDuration="38.610740994s" totalImagesPullingTime="7.652597298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:31.608416334 +0000 UTC m=+45.707810077" watchObservedRunningTime="2026-06-10 19:50:31.610740994 +0000 UTC m=+45.710134739" Jun 10 19:50:32.562545 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.562510 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 19:50:32.562999 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.562958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/0.log" Jun 10 19:50:32.563050 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.562994 2567 generic.go:356] "Generic (PLEG): container finished" podID="2c03f74c-3831-4e71-a3a1-458b7e68ff6d" containerID="1ff0146d23a8e76736f7ed345990b24024124c8b73f84df0cddd4753cb6300d3" exitCode=255 Jun 10 19:50:32.563105 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.563072 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" event={"ID":"2c03f74c-3831-4e71-a3a1-458b7e68ff6d","Type":"ContainerDied","Data":"1ff0146d23a8e76736f7ed345990b24024124c8b73f84df0cddd4753cb6300d3"} Jun 10 19:50:32.563157 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.563115 2567 scope.go:117] "RemoveContainer" containerID="7e6c75c62ce5c0a6d3e8e00c48bfd48087574f09dfdb5e4e6a1c851f8f432578" Jun 10 19:50:32.563367 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.563349 2567 scope.go:117] "RemoveContainer" containerID="1ff0146d23a8e76736f7ed345990b24024124c8b73f84df0cddd4753cb6300d3" Jun 10 19:50:32.563543 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:32.563522 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-gtzwp_openshift-console-operator(2c03f74c-3831-4e71-a3a1-458b7e68ff6d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" podUID="2c03f74c-3831-4e71-a3a1-458b7e68ff6d" Jun 10 19:50:32.733174 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.733135 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:32.733350 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:32.733239 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:33.567850 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:33.567827 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 19:50:33.568213 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:33.568132 2567 scope.go:117] "RemoveContainer" containerID="1ff0146d23a8e76736f7ed345990b24024124c8b73f84df0cddd4753cb6300d3" Jun 10 19:50:33.568324 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:33.568303 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-gtzwp_openshift-console-operator(2c03f74c-3831-4e71-a3a1-458b7e68ff6d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" podUID="2c03f74c-3831-4e71-a3a1-458b7e68ff6d" Jun 10 19:50:33.570172 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:33.570156 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bg6bp_6d209f8d-33a4-4544-9363-3dd0e523d7c7/dns-node-resolver/0.log" Jun 10 19:50:34.571705 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:34.571677 2567 scope.go:117] "RemoveContainer" containerID="1ff0146d23a8e76736f7ed345990b24024124c8b73f84df0cddd4753cb6300d3" Jun 10 19:50:34.572063 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:34.571831 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-gtzwp_openshift-console-operator(2c03f74c-3831-4e71-a3a1-458b7e68ff6d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" podUID="2c03f74c-3831-4e71-a3a1-458b7e68ff6d" Jun 10 19:50:34.971280 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:34.971256 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvn5v_9416fb12-c296-4de0-9790-c049a1be95cd/node-ca/0.log" Jun 10 19:50:35.571385 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:35.571352 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nggcf_9bc3c612-2c52-46de-80b9-2b5be013dd74/serve-healthcheck-canary/0.log" Jun 10 19:50:37.752467 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:37.752425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:37.752943 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:37.752573 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:50:37.752943 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:37.752592 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c857bf459-r76d9: secret "image-registry-tls" not found Jun 10 19:50:37.752943 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:37.752661 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls podName:80856b70-5375-4e88-bfac-0791c1bcb250 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:53.7526453 +0000 UTC m=+67.852039018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls") pod "image-registry-7c857bf459-r76d9" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250") : secret "image-registry-tls" not found Jun 10 19:50:37.954121 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:37.954080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:37.954312 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:37.954246 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:50:37.954363 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:37.954314 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls podName:a2c24cf2-68d3-415f-86dd-1fbcdf68256c nodeName:}" failed. No retries permitted until 2026-06-10 19:50:53.954297791 +0000 UTC m=+68.053691508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls") pod "dns-default-95bbc" (UID: "a2c24cf2-68d3-415f-86dd-1fbcdf68256c") : secret "dns-default-metrics-tls" not found Jun 10 19:50:38.055437 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:38.055346 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:38.055437 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:38.055399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:38.055437 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:38.055433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:38.055460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.055512 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.055556 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.055575 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:54.055562244 +0000 UTC m=+68.154955962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : configmap references non-existent config key: service-ca.crt Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.055579 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.055632 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls podName:8baf22c2-d22a-4660-805e-e6bb41245dfb nodeName:}" failed. No retries permitted until 2026-06-10 19:50:54.05561149 +0000 UTC m=+68.155005218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gtg7n" (UID: "8baf22c2-d22a-4660-805e-e6bb41245dfb") : secret "samples-operator-tls" not found Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.055651 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert podName:29afa0d1-1603-4521-961c-46b333e4c7a6 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:54.055645003 +0000 UTC m=+68.155038720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zc84s" (UID: "29afa0d1-1603-4521-961c-46b333e4c7a6") : secret "networking-console-plugin-cert" not found Jun 10 19:50:38.055683 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.055663 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs podName:bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:54.055658071 +0000 UTC m=+68.155051789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs") pod "router-default-7868745755-r5db4" (UID: "bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0") : secret "router-metrics-certs-default" not found Jun 10 19:50:38.156195 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:38.156157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:38.156379 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.156302 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:38.156379 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:50:38.156372 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls podName:781b0632-67b4-43cd-92ab-a97088cf8ba2 nodeName:}" failed. No retries permitted until 2026-06-10 19:50:54.156357008 +0000 UTC m=+68.255750727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2bvqw" (UID: "781b0632-67b4-43cd-92ab-a97088cf8ba2") : secret "cluster-monitoring-operator-tls" not found Jun 10 19:50:46.485881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:46.485854 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ncjw" Jun 10 19:50:49.299906 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:49.299866 2567 scope.go:117] "RemoveContainer" containerID="1ff0146d23a8e76736f7ed345990b24024124c8b73f84df0cddd4753cb6300d3" Jun 10 19:50:49.620484 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:49.620402 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 19:50:49.620484 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:49.620468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" event={"ID":"2c03f74c-3831-4e71-a3a1-458b7e68ff6d","Type":"ContainerStarted","Data":"6d66460da455ff316a9373a098ec393c0513090e09cc5b5a19260b091d4f9b43"} Jun 10 19:50:49.620769 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:49.620750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:49.638724 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:49.638680 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" podStartSLOduration=49.223584906 podStartE2EDuration="56.638664693s" totalImagesPullingTime="7.415079787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:49.63782459 +0000 UTC m=+63.737218331" watchObservedRunningTime="2026-06-10 19:50:49.638664693 +0000 UTC m=+63.738058471" Jun 10 19:50:50.120188 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:50.120157 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-gtzwp" Jun 10 19:50:52.074135 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.074095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:52.077596 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.077568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxt9d\" (UniqueName: \"kubernetes.io/projected/a18f28f6-70b9-4f38-b7e1-deef4df4e9df-kube-api-access-pxt9d\") pod \"network-check-target-vs7cp\" (UID: \"a18f28f6-70b9-4f38-b7e1-deef4df4e9df\") " pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:52.174803 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.174768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:52.174988 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.174848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:52.177408 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.177379 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 19:50:52.177941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.177923 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 19:50:52.188041 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.188008 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83-metrics-certs\") pod \"network-metrics-daemon-9ctj9\" (UID: \"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83\") " pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:52.188041 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.188025 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cdc7488-1c8f-424b-be1d-fb08e3c7db2a-original-pull-secret\") pod \"global-pull-secret-syncer-65hm9\" (UID: \"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a\") " pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:52.331711 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.331629 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-km5qb\"" Jun 10 19:50:52.339545 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.339522 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:52.351479 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.351455 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l9txq\"" Jun 10 19:50:52.360215 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.360198 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9ctj9" Jun 10 19:50:52.416376 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.416339 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65hm9" Jun 10 19:50:52.517776 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.517730 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vs7cp"] Jun 10 19:50:52.521249 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:52.521160 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18f28f6_70b9_4f38_b7e1_deef4df4e9df.slice/crio-355ff77b1fae5f6ca5ce1517814062589fa18c9fe57772f57e8d161ee81c76bb WatchSource:0}: Error finding container 355ff77b1fae5f6ca5ce1517814062589fa18c9fe57772f57e8d161ee81c76bb: Status 404 returned error can't find the container with id 355ff77b1fae5f6ca5ce1517814062589fa18c9fe57772f57e8d161ee81c76bb Jun 10 19:50:52.535204 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.534661 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9ctj9"] Jun 10 19:50:52.538267 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:52.538234 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b171ac5_1b3f_46ce_9d3b_8c01bfc67f83.slice/crio-453e4db73677cd06a7929d9b5bd12fd4d35499df375c4a0cdda1407362c9c8cc WatchSource:0}: Error finding container 453e4db73677cd06a7929d9b5bd12fd4d35499df375c4a0cdda1407362c9c8cc: Status 404 returned error can't find the container with id 453e4db73677cd06a7929d9b5bd12fd4d35499df375c4a0cdda1407362c9c8cc Jun 10 19:50:52.582344 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.582317 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-65hm9"] Jun 10 19:50:52.586188 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:52.586167 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdc7488_1c8f_424b_be1d_fb08e3c7db2a.slice/crio-d1ae23e2b87c3e96639a78e5cf7dba6e66b7b2a54b06aacc71b4585a0b6cd9b8 WatchSource:0}: Error finding container d1ae23e2b87c3e96639a78e5cf7dba6e66b7b2a54b06aacc71b4585a0b6cd9b8: Status 404 returned error can't find the container with id d1ae23e2b87c3e96639a78e5cf7dba6e66b7b2a54b06aacc71b4585a0b6cd9b8 Jun 10 19:50:52.631446 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.631419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-65hm9" event={"ID":"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a","Type":"ContainerStarted","Data":"d1ae23e2b87c3e96639a78e5cf7dba6e66b7b2a54b06aacc71b4585a0b6cd9b8"} Jun 10 19:50:52.632650 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.632548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9ctj9" event={"ID":"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83","Type":"ContainerStarted","Data":"453e4db73677cd06a7929d9b5bd12fd4d35499df375c4a0cdda1407362c9c8cc"} Jun 10 19:50:52.634047 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.634028 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vs7cp" event={"ID":"a18f28f6-70b9-4f38-b7e1-deef4df4e9df","Type":"ContainerStarted","Data":"b4d4d13a5865553ed7e5efd73ab0b12069253507b0ec38e2564aa1acf42bc9ef"} Jun 10 19:50:52.634129 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:52.634060 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vs7cp" event={"ID":"a18f28f6-70b9-4f38-b7e1-deef4df4e9df","Type":"ContainerStarted","Data":"355ff77b1fae5f6ca5ce1517814062589fa18c9fe57772f57e8d161ee81c76bb"} Jun 10 19:50:53.639909 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.639872 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9ctj9" event={"ID":"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83","Type":"ContainerStarted","Data":"a293fd30ac7e59fa5e21ec398b96483895190646ab3d15341b947a6e67eb3802"} Jun 10 19:50:53.640353 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.639984 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:50:53.657816 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.657765 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vs7cp" podStartSLOduration=67.657748621 podStartE2EDuration="1m7.657748621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:53.656548322 +0000 UTC m=+67.755942062" watchObservedRunningTime="2026-06-10 19:50:53.657748621 +0000 UTC m=+67.757142361" Jun 10 19:50:53.790008 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.789967 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:53.792773 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.792743 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"image-registry-7c857bf459-r76d9\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:53.957519 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.957488 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7nhw\"" Jun 10 19:50:53.965772 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.965739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:53.992416 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.992205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:53.995032 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:53.995005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2c24cf2-68d3-415f-86dd-1fbcdf68256c-metrics-tls\") pod \"dns-default-95bbc\" (UID: \"a2c24cf2-68d3-415f-86dd-1fbcdf68256c\") " pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:54.093788 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.093708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:54.093945 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.093818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:54.093945 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.093844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:54.093945 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.093874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:54.094580 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.094556 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-service-ca-bundle\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:54.096268 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.096245 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0-metrics-certs\") pod \"router-default-7868745755-r5db4\" (UID: \"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0\") " pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:54.096390 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.096269 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8baf22c2-d22a-4660-805e-e6bb41245dfb-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gtg7n\" (UID: \"8baf22c2-d22a-4660-805e-e6bb41245dfb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:54.096390 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.096321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29afa0d1-1603-4521-961c-46b333e4c7a6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zc84s\" (UID: \"29afa0d1-1603-4521-961c-46b333e4c7a6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:54.113415 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.113392 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c857bf459-r76d9"] Jun 10 19:50:54.116956 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:54.116928 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80856b70_5375_4e88_bfac_0791c1bcb250.slice/crio-eb9f70a3819aa4b908d07d5a14f75eb63ff37855150da2fd12632b46cf0f3580 WatchSource:0}: Error finding container eb9f70a3819aa4b908d07d5a14f75eb63ff37855150da2fd12632b46cf0f3580: Status 404 returned error can't find the container with id eb9f70a3819aa4b908d07d5a14f75eb63ff37855150da2fd12632b46cf0f3580 Jun 10 19:50:54.181120 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.181095 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-md4pq\"" Jun 10 19:50:54.189030 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.189002 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95bbc" Jun 10 19:50:54.195193 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.195165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:54.197843 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.197807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/781b0632-67b4-43cd-92ab-a97088cf8ba2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2bvqw\" (UID: \"781b0632-67b4-43cd-92ab-a97088cf8ba2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:54.259777 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.259605 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wr5sq\"" Jun 10 19:50:54.267797 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.267732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" Jun 10 19:50:54.303413 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.303375 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-plkzc\"" Jun 10 19:50:54.311783 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.311546 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" Jun 10 19:50:54.325149 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.325122 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ncc6f\"" Jun 10 19:50:54.333985 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.333723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:54.342779 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.342753 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95bbc"] Jun 10 19:50:54.350922 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.350783 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kjdq7\"" Jun 10 19:50:54.358144 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.358012 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" Jun 10 19:50:54.477766 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.477670 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n"] Jun 10 19:50:54.553675 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.553536 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s"] Jun 10 19:50:54.556854 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:54.556821 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29afa0d1_1603_4521_961c_46b333e4c7a6.slice/crio-269807a5c799a7320bcaf7a7eb4eed641e9cc3160c213e75071c2a9ea2ac2878 WatchSource:0}: Error finding container 269807a5c799a7320bcaf7a7eb4eed641e9cc3160c213e75071c2a9ea2ac2878: Status 404 returned error can't find the container with id 269807a5c799a7320bcaf7a7eb4eed641e9cc3160c213e75071c2a9ea2ac2878 Jun 10 19:50:54.569281 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.569006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7868745755-r5db4"] Jun 10 19:50:54.571693 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:54.571659 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfc6e4b_28d7_4e87_a4fc_b3d7dfe662d0.slice/crio-eecf46912704dc0a6e4dd7dd0dd5b55f3c92a0a5293ad6b0aba9cf56d6021897 WatchSource:0}: Error finding container eecf46912704dc0a6e4dd7dd0dd5b55f3c92a0a5293ad6b0aba9cf56d6021897: Status 404 returned error can't find the container with id eecf46912704dc0a6e4dd7dd0dd5b55f3c92a0a5293ad6b0aba9cf56d6021897 Jun 10 19:50:54.596325 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.595354 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw"] Jun 10 19:50:54.598600 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:54.598573 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781b0632_67b4_43cd_92ab_a97088cf8ba2.slice/crio-87c4bf5d9183b4e47fff9c5521fd4aa3b10d0a1e09e1fb9c9a427783f55a2369 WatchSource:0}: Error finding container 87c4bf5d9183b4e47fff9c5521fd4aa3b10d0a1e09e1fb9c9a427783f55a2369: Status 404 returned error can't find the container with id 87c4bf5d9183b4e47fff9c5521fd4aa3b10d0a1e09e1fb9c9a427783f55a2369 Jun 10 19:50:54.645336 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.645302 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7868745755-r5db4" event={"ID":"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0","Type":"ContainerStarted","Data":"b847b1ce4182191d0a56e9bd98dfc5e5448c3aeb287b3e5540eb3c0fce00e69b"} Jun 10 19:50:54.645773 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.645361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7868745755-r5db4" event={"ID":"bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0","Type":"ContainerStarted","Data":"eecf46912704dc0a6e4dd7dd0dd5b55f3c92a0a5293ad6b0aba9cf56d6021897"} Jun 10 19:50:54.647350 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.647313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" event={"ID":"29afa0d1-1603-4521-961c-46b333e4c7a6","Type":"ContainerStarted","Data":"269807a5c799a7320bcaf7a7eb4eed641e9cc3160c213e75071c2a9ea2ac2878"} Jun 10 19:50:54.648841 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.648590 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95bbc" event={"ID":"a2c24cf2-68d3-415f-86dd-1fbcdf68256c","Type":"ContainerStarted","Data":"ef06b22cf49fd8a9eacca8d5242e9b30f94d3392f11e20909258c76f065eea8f"} Jun 10 19:50:54.650080 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.650054 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" event={"ID":"781b0632-67b4-43cd-92ab-a97088cf8ba2","Type":"ContainerStarted","Data":"87c4bf5d9183b4e47fff9c5521fd4aa3b10d0a1e09e1fb9c9a427783f55a2369"} Jun 10 19:50:54.652094 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.652049 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9ctj9" event={"ID":"3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83","Type":"ContainerStarted","Data":"a2f9b40a3a2230e73f175a9dd06e476b06b4ad481f189ee35febc3ee7c28abb9"} Jun 10 19:50:54.653522 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.653476 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" event={"ID":"8baf22c2-d22a-4660-805e-e6bb41245dfb","Type":"ContainerStarted","Data":"646abdfddff39feb9bdfbe7d4589b1868f2a7138719f305dc46fa8a8fcaf8807"} Jun 10 19:50:54.655367 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.655205 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" event={"ID":"80856b70-5375-4e88-bfac-0791c1bcb250","Type":"ContainerStarted","Data":"1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4"} Jun 10 19:50:54.655367 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.655266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" event={"ID":"80856b70-5375-4e88-bfac-0791c1bcb250","Type":"ContainerStarted","Data":"eb9f70a3819aa4b908d07d5a14f75eb63ff37855150da2fd12632b46cf0f3580"} Jun 10 19:50:54.655367 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.655312 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:50:54.668008 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.667953 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7868745755-r5db4" podStartSLOduration=61.667936003 podStartE2EDuration="1m1.667936003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:54.66660666 +0000 UTC m=+68.766000399" watchObservedRunningTime="2026-06-10 19:50:54.667936003 +0000 UTC m=+68.767329744" Jun 10 19:50:54.690397 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.690348 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9ctj9" podStartSLOduration=67.797387539 podStartE2EDuration="1m8.690327573s" totalImagesPullingTime="892.940034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:54.690181118 +0000 UTC m=+68.789574862" watchObservedRunningTime="2026-06-10 19:50:54.690327573 +0000 UTC m=+68.789721312" Jun 10 19:50:54.713576 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:54.713528 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" podStartSLOduration=68.713509948 podStartE2EDuration="1m8.713509948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:54.712803286 +0000 UTC m=+68.812197025" watchObservedRunningTime="2026-06-10 19:50:54.713509948 +0000 UTC m=+68.812903689" Jun 10 19:50:55.334532 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:55.334473 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:55.337426 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:55.337400 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:55.665252 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:55.664029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:55.665700 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:55.665280 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7868745755-r5db4" Jun 10 19:50:57.477308 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.477273 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wfsgp"] Jun 10 19:50:57.480888 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.480865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.484382 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.484307 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 19:50:57.484382 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.484307 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zb54d\"" Jun 10 19:50:57.484382 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.484316 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 19:50:57.496182 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.496156 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfsgp"] Jun 10 19:50:57.628730 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.628660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c271732-b059-4134-a3da-50f64eadec32-data-volume\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.628730 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.628729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c271732-b059-4134-a3da-50f64eadec32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.628976 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.628780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c271732-b059-4134-a3da-50f64eadec32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.628976 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.628862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c271732-b059-4134-a3da-50f64eadec32-crio-socket\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.628976 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.628882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kmpr\" (UniqueName: \"kubernetes.io/projected/3c271732-b059-4134-a3da-50f64eadec32-kube-api-access-2kmpr\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.729464 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.729427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c271732-b059-4134-a3da-50f64eadec32-data-volume\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.729637 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.729485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c271732-b059-4134-a3da-50f64eadec32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.729637 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.729515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c271732-b059-4134-a3da-50f64eadec32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.729637 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.729535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c271732-b059-4134-a3da-50f64eadec32-crio-socket\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.729637 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.729552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kmpr\" (UniqueName: \"kubernetes.io/projected/3c271732-b059-4134-a3da-50f64eadec32-kube-api-access-2kmpr\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.729868 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.729632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c271732-b059-4134-a3da-50f64eadec32-crio-socket\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.729868 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.729842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c271732-b059-4134-a3da-50f64eadec32-data-volume\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.730216 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.730192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c271732-b059-4134-a3da-50f64eadec32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.732318 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.732296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c271732-b059-4134-a3da-50f64eadec32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.744979 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.744950 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kmpr\" (UniqueName: \"kubernetes.io/projected/3c271732-b059-4134-a3da-50f64eadec32-kube-api-access-2kmpr\") pod \"insights-runtime-extractor-wfsgp\" (UID: \"3c271732-b059-4134-a3da-50f64eadec32\") " pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:57.793803 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:57.793764 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfsgp" Jun 10 19:50:59.529059 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.529031 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfsgp"] Jun 10 19:50:59.532084 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:50:59.532056 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c271732_b059_4134_a3da_50f64eadec32.slice/crio-7afaed305bc941bcb54669a1d11ab90f5557e908807c9353506d08b0c108ee4e WatchSource:0}: Error finding container 7afaed305bc941bcb54669a1d11ab90f5557e908807c9353506d08b0c108ee4e: Status 404 returned error can't find the container with id 7afaed305bc941bcb54669a1d11ab90f5557e908807c9353506d08b0c108ee4e Jun 10 19:50:59.684725 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.684652 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" event={"ID":"8baf22c2-d22a-4660-805e-e6bb41245dfb","Type":"ContainerStarted","Data":"02d2825c4f8c29b50a170573bbc221d382b86cdfc2b708c96f6d39baf2791a69"} Jun 10 19:50:59.687410 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.687329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" event={"ID":"29afa0d1-1603-4521-961c-46b333e4c7a6","Type":"ContainerStarted","Data":"ff3fb5c41dbce03035111fbd1c34ec75c68fcd0e6f82b36891b96cfc8b57f9fa"} Jun 10 19:50:59.690713 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.690688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95bbc" event={"ID":"a2c24cf2-68d3-415f-86dd-1fbcdf68256c","Type":"ContainerStarted","Data":"d8967cc9a7ac21c84da71eb8d0302057f1e1b9c275a2d17de6c387e99db5f64a"} Jun 10 19:50:59.692383 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.692362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-65hm9" event={"ID":"7cdc7488-1c8f-424b-be1d-fb08e3c7db2a","Type":"ContainerStarted","Data":"66f00fe46406e8b1f2bf3cd6d2b0496ae33c0f562e892c1b6809bcce172b2da6"} Jun 10 19:50:59.697864 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.697197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" event={"ID":"781b0632-67b4-43cd-92ab-a97088cf8ba2","Type":"ContainerStarted","Data":"146c3abb2f9094a02baf257a4403c4d48e738912af98229c02f20b7e67dc0371"} Jun 10 19:50:59.700792 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.700744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsgp" event={"ID":"3c271732-b059-4134-a3da-50f64eadec32","Type":"ContainerStarted","Data":"ac9012ea3d3d4beb009aed470feddbf7ea4b8e3db89869b79b21d7e01bff462c"} Jun 10 19:50:59.701026 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.700983 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsgp" event={"ID":"3c271732-b059-4134-a3da-50f64eadec32","Type":"ContainerStarted","Data":"7afaed305bc941bcb54669a1d11ab90f5557e908807c9353506d08b0c108ee4e"} Jun 10 19:50:59.720790 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.720737 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zc84s" podStartSLOduration=54.904158662 podStartE2EDuration="59.720716003s" totalImagesPullingTime="4.816557341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:59.720629802 +0000 UTC m=+73.820023542" watchObservedRunningTime="2026-06-10 19:50:59.720716003 +0000 UTC m=+73.820109744" Jun 10 19:50:59.757817 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.756604 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" podStartSLOduration=61.979768922 podStartE2EDuration="1m6.756585343s" totalImagesPullingTime="4.776816421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:59.756086565 +0000 UTC m=+73.855480306" watchObservedRunningTime="2026-06-10 19:50:59.756585343 +0000 UTC m=+73.855979084" Jun 10 19:50:59.774416 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:50:59.773928 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-65hm9" podStartSLOduration=66.986335508 podStartE2EDuration="1m13.773908439s" totalImagesPullingTime="6.787572931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:50:59.773542498 +0000 UTC m=+73.872936239" watchObservedRunningTime="2026-06-10 19:50:59.773908439 +0000 UTC m=+73.873302181" Jun 10 19:51:00.706634 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:00.706598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" event={"ID":"8baf22c2-d22a-4660-805e-e6bb41245dfb","Type":"ContainerStarted","Data":"98cb1931c59fc31705183bbfe61d9e3ebb51d5ba21df22b2517b88e693cb2141"} Jun 10 19:51:00.708912 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:00.708778 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95bbc" event={"ID":"a2c24cf2-68d3-415f-86dd-1fbcdf68256c","Type":"ContainerStarted","Data":"40710d3d2ede6c9bb25fec48519e018ad58df8e38072667a64e65aba8c907717"} Jun 10 19:51:00.712244 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:00.710214 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-95bbc" Jun 10 19:51:00.730359 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:00.730318 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gtg7n" podStartSLOduration=62.90888163 podStartE2EDuration="1m7.730303335s" totalImagesPullingTime="4.821421705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:00.729473727 +0000 UTC m=+74.828867467" watchObservedRunningTime="2026-06-10 19:51:00.730303335 +0000 UTC m=+74.829697320" Jun 10 19:51:00.746698 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:00.746484 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-95bbc" podStartSLOduration=34.720945197 podStartE2EDuration="39.746466863s" totalImagesPullingTime="5.025521666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:00.74571347 +0000 UTC m=+74.845107210" watchObservedRunningTime="2026-06-10 19:51:00.746466863 +0000 UTC m=+74.845860604" Jun 10 19:51:01.716046 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:01.715994 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsgp" event={"ID":"3c271732-b059-4134-a3da-50f64eadec32","Type":"ContainerStarted","Data":"1961df86c96d8e4a35bed93e2af7b292e9077f6d3865b9de765cf7843bca28cc"} Jun 10 19:51:02.722716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:02.722671 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsgp" event={"ID":"3c271732-b059-4134-a3da-50f64eadec32","Type":"ContainerStarted","Data":"cc92136cb8216961de6c786cdc83678fef25ec8374aca0a406469d49893a8d87"} Jun 10 19:51:02.742881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:02.742836 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wfsgp" podStartSLOduration=2.957076158 podStartE2EDuration="5.742820733s" totalImagesPullingTime="2.785744575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:50:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:02.741855213 +0000 UTC m=+76.841248953" watchObservedRunningTime="2026-06-10 19:51:02.742820733 +0000 UTC m=+76.842214473" Jun 10 19:51:10.018442 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.018326 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9c98f689-zl4x4"] Jun 10 19:51:10.021332 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.021311 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.025093 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.025071 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 19:51:10.025350 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.025332 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 19:51:10.025847 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.025834 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 19:51:10.026121 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.026106 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 19:51:10.026175 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.026160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 19:51:10.027251 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.027215 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 19:51:10.027348 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.027261 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4kltv\"" Jun 10 19:51:10.027348 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.027287 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 19:51:10.030951 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.030932 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 19:51:10.034598 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.034569 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9c98f689-zl4x4"] Jun 10 19:51:10.133861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.133825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-serving-cert\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.134044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.133875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-trusted-ca-bundle\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.134044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.133902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-console-config\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.134044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.133926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-service-ca\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.134044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.133949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-oauth-serving-cert\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.134044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.133967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kshnj\" (UniqueName: \"kubernetes.io/projected/10997af2-8ad7-4b73-835d-ee6cf3803171-kube-api-access-kshnj\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.134044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.133994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-oauth-config\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.234695 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.234665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-serving-cert\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.234801 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.234706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-trusted-ca-bundle\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.234801 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.234730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-console-config\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.234887 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.234853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-service-ca\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.234937 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.234893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-oauth-serving-cert\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.234937 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.234924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kshnj\" (UniqueName: \"kubernetes.io/projected/10997af2-8ad7-4b73-835d-ee6cf3803171-kube-api-access-kshnj\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.235040 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.234974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-oauth-config\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.235538 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.235514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-console-config\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.235538 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.235526 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-service-ca\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.235690 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.235567 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-trusted-ca-bundle\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.235778 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.235762 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-oauth-serving-cert\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.237516 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.237475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-serving-cert\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.237993 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.237968 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-oauth-config\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.245546 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.245525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kshnj\" (UniqueName: \"kubernetes.io/projected/10997af2-8ad7-4b73-835d-ee6cf3803171-kube-api-access-kshnj\") pod \"console-5d9c98f689-zl4x4\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.330585 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.330487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:10.460049 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.460023 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9c98f689-zl4x4"] Jun 10 19:51:10.462639 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:51:10.462607 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10997af2_8ad7_4b73_835d_ee6cf3803171.slice/crio-716208ff89e82013124a199901c74cc83d8fdce0d1f26e2aa4ee9995fc84ace0 WatchSource:0}: Error finding container 716208ff89e82013124a199901c74cc83d8fdce0d1f26e2aa4ee9995fc84ace0: Status 404 returned error can't find the container with id 716208ff89e82013124a199901c74cc83d8fdce0d1f26e2aa4ee9995fc84ace0 Jun 10 19:51:10.750430 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.750395 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9c98f689-zl4x4" event={"ID":"10997af2-8ad7-4b73-835d-ee6cf3803171","Type":"ContainerStarted","Data":"716208ff89e82013124a199901c74cc83d8fdce0d1f26e2aa4ee9995fc84ace0"} Jun 10 19:51:10.751993 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.751972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/0.log" Jun 10 19:51:10.752099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.752006 2567 generic.go:356] "Generic (PLEG): container finished" podID="781b0632-67b4-43cd-92ab-a97088cf8ba2" containerID="146c3abb2f9094a02baf257a4403c4d48e738912af98229c02f20b7e67dc0371" exitCode=2 Jun 10 19:51:10.752099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.752044 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" event={"ID":"781b0632-67b4-43cd-92ab-a97088cf8ba2","Type":"ContainerDied","Data":"146c3abb2f9094a02baf257a4403c4d48e738912af98229c02f20b7e67dc0371"} Jun 10 19:51:10.752354 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:10.752340 2567 scope.go:117] "RemoveContainer" containerID="146c3abb2f9094a02baf257a4403c4d48e738912af98229c02f20b7e67dc0371" Jun 10 19:51:11.725548 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:11.725516 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-95bbc" Jun 10 19:51:11.759301 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:11.759268 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/0.log" Jun 10 19:51:11.759482 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:11.759365 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2bvqw" event={"ID":"781b0632-67b4-43cd-92ab-a97088cf8ba2","Type":"ContainerStarted","Data":"4ed9df31b80ccd02df5ba55bc2891d9b32747253f207096d69c10537c82905a1"} Jun 10 19:51:13.769426 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:13.769387 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9c98f689-zl4x4" event={"ID":"10997af2-8ad7-4b73-835d-ee6cf3803171","Type":"ContainerStarted","Data":"4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5"} Jun 10 19:51:13.786838 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:13.786796 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9c98f689-zl4x4" podStartSLOduration=2.179423459 podStartE2EDuration="4.786780881s" totalImagesPullingTime="2.607357422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:13.786534909 +0000 UTC m=+87.885928649" watchObservedRunningTime="2026-06-10 19:51:13.786780881 +0000 UTC m=+87.886174631" Jun 10 19:51:13.970053 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:13.970017 2567 patch_prober.go:28] interesting pod/image-registry-7c857bf459-r76d9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 19:51:13.970203 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:13.970072 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" podUID="80856b70-5375-4e88-bfac-0791c1bcb250" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:51:14.482422 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.482386 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fg8rb"] Jun 10 19:51:14.484783 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.484761 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.487907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.487877 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 19:51:14.488004 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.487937 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 19:51:14.488635 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.488618 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 19:51:14.488693 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.488623 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zsd7g\"" Jun 10 19:51:14.488693 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.488688 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 19:51:14.565498 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-textfile\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565498 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-sys\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-metrics-client-ca\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-wtmp\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq267\" (UniqueName: \"kubernetes.io/projected/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-kube-api-access-tq267\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-tls\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.565703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.565702 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-root\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666702 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-textfile\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666702 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666723 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-sys\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-metrics-client-ca\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-wtmp\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666818 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-sys\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq267\" (UniqueName: \"kubernetes.io/projected/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-kube-api-access-tq267\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.666890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-tls\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.667163 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.667163 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-root\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.667163 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.666952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-wtmp\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.667163 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.667017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-root\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.667163 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.667024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-textfile\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.667442 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.667414 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-metrics-client-ca\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.667562 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.667425 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.669400 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.669371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.669507 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.669448 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-node-exporter-tls\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.675355 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.675327 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq267\" (UniqueName: \"kubernetes.io/projected/5ac8cfd6-4b64-444a-b2d6-8da45814f8dc-kube-api-access-tq267\") pod \"node-exporter-fg8rb\" (UID: \"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc\") " pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.793927 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:14.793856 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fg8rb" Jun 10 19:51:14.805744 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:51:14.805710 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac8cfd6_4b64_444a_b2d6_8da45814f8dc.slice/crio-28756034aff9493a70463469a2fda567e6d615c7512c6c6e5983037b247331b9 WatchSource:0}: Error finding container 28756034aff9493a70463469a2fda567e6d615c7512c6c6e5983037b247331b9: Status 404 returned error can't find the container with id 28756034aff9493a70463469a2fda567e6d615c7512c6c6e5983037b247331b9 Jun 10 19:51:15.669784 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:15.669756 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:51:15.778828 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:15.778788 2567 generic.go:356] "Generic (PLEG): container finished" podID="5ac8cfd6-4b64-444a-b2d6-8da45814f8dc" containerID="ed2a5e8c1a49ab05717d69124e6d7a842c3fa7c48ecb3e5c2f81cde55b2b1ec6" exitCode=0 Jun 10 19:51:15.778988 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:15.778856 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg8rb" event={"ID":"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc","Type":"ContainerDied","Data":"ed2a5e8c1a49ab05717d69124e6d7a842c3fa7c48ecb3e5c2f81cde55b2b1ec6"} Jun 10 19:51:15.778988 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:15.778910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg8rb" event={"ID":"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc","Type":"ContainerStarted","Data":"28756034aff9493a70463469a2fda567e6d615c7512c6c6e5983037b247331b9"} Jun 10 19:51:16.455838 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.455804 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54cb49bcbf-n2knf"] Jun 10 19:51:16.459011 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.458992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.462398 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.462376 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 19:51:16.463099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.463073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 19:51:16.463203 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.463100 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 19:51:16.463203 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.463163 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 19:51:16.463317 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.463249 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 19:51:16.463317 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.463275 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6bns3tqtiect7\"" Jun 10 19:51:16.463418 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.463342 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q4zpl\"" Jun 10 19:51:16.477490 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.474886 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54cb49bcbf-n2knf"] Jun 10 19:51:16.479726 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.479705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-tls\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.479849 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.479739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5c9fae-89ae-4565-a662-a28aaef28e27-metrics-client-ca\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.479849 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.479761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.479849 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.479814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8bp\" (UniqueName: \"kubernetes.io/projected/ab5c9fae-89ae-4565-a662-a28aaef28e27-kube-api-access-gr8bp\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.480006 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.479861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-grpc-tls\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.480006 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.479890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.480006 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.479965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.480147 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.480053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580505 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580505 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8bp\" (UniqueName: \"kubernetes.io/projected/ab5c9fae-89ae-4565-a662-a28aaef28e27-kube-api-access-gr8bp\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580753 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-grpc-tls\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580753 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580753 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580753 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580753 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-tls\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.580996 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.580769 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5c9fae-89ae-4565-a662-a28aaef28e27-metrics-client-ca\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.581573 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.581547 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5c9fae-89ae-4565-a662-a28aaef28e27-metrics-client-ca\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.583488 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.583449 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.583604 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.583574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.583604 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.583598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.583745 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.583718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-tls\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.583793 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.583739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.583826 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.583809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab5c9fae-89ae-4565-a662-a28aaef28e27-secret-grpc-tls\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.589897 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.589878 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8bp\" (UniqueName: \"kubernetes.io/projected/ab5c9fae-89ae-4565-a662-a28aaef28e27-kube-api-access-gr8bp\") pod \"thanos-querier-54cb49bcbf-n2knf\" (UID: \"ab5c9fae-89ae-4565-a662-a28aaef28e27\") " pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.768827 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.768751 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:16.786639 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.786607 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg8rb" event={"ID":"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc","Type":"ContainerStarted","Data":"a71a73ff4c62670ce5010a96c07bb18765a2e30ed5eb0f5391fd46f26272dd77"} Jun 10 19:51:16.786751 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.786675 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg8rb" event={"ID":"5ac8cfd6-4b64-444a-b2d6-8da45814f8dc","Type":"ContainerStarted","Data":"e0a264d66099719361e496a9408e7f50906b6fecca4703637a91dd8e32047533"} Jun 10 19:51:16.804776 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.804717 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fg8rb" podStartSLOduration=1.980491857 podStartE2EDuration="2.804697622s" totalImagesPullingTime="757.719245ms" totalInitContainerRuntime="66.48652ms" isStatefulPod=true podCreationTimestamp="2026-06-10 19:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:16.804322712 +0000 UTC m=+90.903716457" watchObservedRunningTime="2026-06-10 19:51:16.804697622 +0000 UTC m=+90.904091363" Jun 10 19:51:16.904481 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:16.904439 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54cb49bcbf-n2knf"] Jun 10 19:51:16.908208 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:51:16.908177 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5c9fae_89ae_4565_a662_a28aaef28e27.slice/crio-0780397ce7a0ee41467ea00cd710ba0a572b9d9a6221ad99a083e1c3475b06f3 WatchSource:0}: Error finding container 0780397ce7a0ee41467ea00cd710ba0a572b9d9a6221ad99a083e1c3475b06f3: Status 404 returned error can't find the container with id 0780397ce7a0ee41467ea00cd710ba0a572b9d9a6221ad99a083e1c3475b06f3 Jun 10 19:51:17.792342 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:17.792298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" event={"ID":"ab5c9fae-89ae-4565-a662-a28aaef28e27","Type":"ContainerStarted","Data":"0780397ce7a0ee41467ea00cd710ba0a572b9d9a6221ad99a083e1c3475b06f3"} Jun 10 19:51:18.797886 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.797854 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d7bc7f7f-gv5fr"] Jun 10 19:51:18.800959 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.800937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:18.803843 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.803821 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 19:51:18.804745 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.804721 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 19:51:18.804745 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.804740 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 19:51:18.804918 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.804725 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4i95prvdl5r8q\"" Jun 10 19:51:18.804918 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.804818 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 19:51:18.804918 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.804833 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-f9447\"" Jun 10 19:51:18.819242 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.819186 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d7bc7f7f-gv5fr"] Jun 10 19:51:18.900303 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.900266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-secret-metrics-server-client-certs\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:18.900475 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.900318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9caf6641-dce5-4474-9cb5-ca642105a899-metrics-server-audit-profiles\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:18.900475 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.900361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6smp\" (UniqueName: \"kubernetes.io/projected/9caf6641-dce5-4474-9cb5-ca642105a899-kube-api-access-t6smp\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:18.900475 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.900400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caf6641-dce5-4474-9cb5-ca642105a899-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:18.900475 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.900437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-client-ca-bundle\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:18.900475 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.900471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9caf6641-dce5-4474-9cb5-ca642105a899-audit-log\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:18.900663 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:18.900543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-secret-metrics-server-tls\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.001682 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.001641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-client-ca-bundle\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.001833 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.001705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9caf6641-dce5-4474-9cb5-ca642105a899-audit-log\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.001833 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.001768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-secret-metrics-server-tls\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.001833 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.001799 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-secret-metrics-server-client-certs\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.001983 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.001844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9caf6641-dce5-4474-9cb5-ca642105a899-metrics-server-audit-profiles\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.001983 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.001875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6smp\" (UniqueName: \"kubernetes.io/projected/9caf6641-dce5-4474-9cb5-ca642105a899-kube-api-access-t6smp\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.001983 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.001910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caf6641-dce5-4474-9cb5-ca642105a899-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.002523 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.002207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9caf6641-dce5-4474-9cb5-ca642105a899-audit-log\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.002736 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.002711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caf6641-dce5-4474-9cb5-ca642105a899-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.002872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.002852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9caf6641-dce5-4474-9cb5-ca642105a899-metrics-server-audit-profiles\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.004428 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.004386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-client-ca-bundle\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.004428 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.004396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-secret-metrics-server-client-certs\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.004764 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.004744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9caf6641-dce5-4474-9cb5-ca642105a899-secret-metrics-server-tls\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.012068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.012044 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6smp\" (UniqueName: \"kubernetes.io/projected/9caf6641-dce5-4474-9cb5-ca642105a899-kube-api-access-t6smp\") pod \"metrics-server-d7bc7f7f-gv5fr\" (UID: \"9caf6641-dce5-4474-9cb5-ca642105a899\") " pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.110696 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.110611 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:19.224120 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.224083 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rc99m"] Jun 10 19:51:19.227818 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.227790 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:19.230352 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.230295 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 19:51:19.230462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.230351 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h4rtv\"" Jun 10 19:51:19.245668 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.245211 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rc99m"] Jun 10 19:51:19.304556 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.304522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rc99m\" (UID: \"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:19.304726 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.304621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wk8p\" (UniqueName: \"kubernetes.io/projected/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-kube-api-access-8wk8p\") pod \"monitoring-plugin-76b68cc874-rc99m\" (UID: \"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:19.405281 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.405183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rc99m\" (UID: \"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:19.405444 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.405302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wk8p\" (UniqueName: \"kubernetes.io/projected/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-kube-api-access-8wk8p\") pod \"monitoring-plugin-76b68cc874-rc99m\" (UID: \"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:19.405444 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:51:19.405370 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 19:51:19.405538 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:51:19.405462 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-monitoring-plugin-cert podName:3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd nodeName:}" failed. No retries permitted until 2026-06-10 19:51:19.905437203 +0000 UTC m=+94.004830930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-rc99m" (UID: "3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd") : secret "monitoring-plugin-cert" not found Jun 10 19:51:19.414325 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.414297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wk8p\" (UniqueName: \"kubernetes.io/projected/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-kube-api-access-8wk8p\") pod \"monitoring-plugin-76b68cc874-rc99m\" (UID: \"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:19.644085 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.644046 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d7bc7f7f-gv5fr"] Jun 10 19:51:19.646453 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:51:19.646431 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9caf6641_dce5_4474_9cb5_ca642105a899.slice/crio-9f1cb52a5b785ed16605b5e58b303894548b50475fbd860ac2d37a7d3bb4673a WatchSource:0}: Error finding container 9f1cb52a5b785ed16605b5e58b303894548b50475fbd860ac2d37a7d3bb4673a: Status 404 returned error can't find the container with id 9f1cb52a5b785ed16605b5e58b303894548b50475fbd860ac2d37a7d3bb4673a Jun 10 19:51:19.802925 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.802889 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" event={"ID":"ab5c9fae-89ae-4565-a662-a28aaef28e27","Type":"ContainerStarted","Data":"d9e4b6a5a1b72bbe4735c3b2a2d28483c7a2cc3832e7ecd09a9f0a38332dce7b"} Jun 10 19:51:19.803346 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.802977 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" event={"ID":"ab5c9fae-89ae-4565-a662-a28aaef28e27","Type":"ContainerStarted","Data":"c432192fcd11d23c1777203ae07c28ec866546a0472e62e4a522e5daf29c47da"} Jun 10 19:51:19.803346 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.803017 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" event={"ID":"ab5c9fae-89ae-4565-a662-a28aaef28e27","Type":"ContainerStarted","Data":"98f7c1f549295403bb8501a2eb93140455fcf79f2c2bdef6aea912c8001b3d34"} Jun 10 19:51:19.804071 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.804044 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" event={"ID":"9caf6641-dce5-4474-9cb5-ca642105a899","Type":"ContainerStarted","Data":"9f1cb52a5b785ed16605b5e58b303894548b50475fbd860ac2d37a7d3bb4673a"} Jun 10 19:51:19.910859 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.910753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rc99m\" (UID: \"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:19.913262 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:19.913210 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rc99m\" (UID: \"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:20.139769 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.139732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:20.270403 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.270372 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rc99m"] Jun 10 19:51:20.275510 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:51:20.275482 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf535ca_6fc3_4c4f_8201_8cb25c6bfebd.slice/crio-f17dfaa4dd94804f0e8b6e70c45aaf09cc7ee35087f0363cd85b8a818f489e04 WatchSource:0}: Error finding container f17dfaa4dd94804f0e8b6e70c45aaf09cc7ee35087f0363cd85b8a818f489e04: Status 404 returned error can't find the container with id f17dfaa4dd94804f0e8b6e70c45aaf09cc7ee35087f0363cd85b8a818f489e04 Jun 10 19:51:20.330855 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.330825 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:20.331009 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.330875 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:20.336315 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.336287 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:20.649745 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.649708 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c857bf459-r76d9"] Jun 10 19:51:20.809633 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.809596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" event={"ID":"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd","Type":"ContainerStarted","Data":"f17dfaa4dd94804f0e8b6e70c45aaf09cc7ee35087f0363cd85b8a818f489e04"} Jun 10 19:51:20.814711 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:20.814687 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:21.227660 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.227627 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7678bc6677-tm8b9"] Jun 10 19:51:21.231236 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.231198 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.242953 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.242929 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7678bc6677-tm8b9"] Jun 10 19:51:21.325548 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.325465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-serving-cert\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.325548 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.325543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-service-ca\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.325736 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.325576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-config\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.325736 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.325599 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-trusted-ca-bundle\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.325736 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.325673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-oauth-config\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.325736 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.325696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfbgb\" (UniqueName: \"kubernetes.io/projected/b415d8df-6d32-4db2-92d5-0ec88cf87782-kube-api-access-mfbgb\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.325736 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.325727 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-oauth-serving-cert\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427034 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.426992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-serving-cert\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-service-ca\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-config\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-trusted-ca-bundle\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-oauth-config\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfbgb\" (UniqueName: \"kubernetes.io/projected/b415d8df-6d32-4db2-92d5-0ec88cf87782-kube-api-access-mfbgb\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-oauth-serving-cert\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.427913 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427886 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-config\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.428020 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.427955 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-service-ca\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.428088 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.428034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-oauth-serving-cert\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.428271 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.428207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-trusted-ca-bundle\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.430052 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.430031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-serving-cert\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.430188 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.430173 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-oauth-config\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.442039 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.442015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfbgb\" (UniqueName: \"kubernetes.io/projected/b415d8df-6d32-4db2-92d5-0ec88cf87782-kube-api-access-mfbgb\") pod \"console-7678bc6677-tm8b9\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.541706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.541685 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:21.713783 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.713661 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7678bc6677-tm8b9"] Jun 10 19:51:21.818276 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.818214 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" event={"ID":"ab5c9fae-89ae-4565-a662-a28aaef28e27","Type":"ContainerStarted","Data":"b622620a2458ba21c53603ca51d474e48d53d8443c67ab70ef918a6b6fffb46c"} Jun 10 19:51:21.818683 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.818314 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" event={"ID":"ab5c9fae-89ae-4565-a662-a28aaef28e27","Type":"ContainerStarted","Data":"a4289e96a3bf200aac7a439c40e088cb827d70000bcf5a0db12a927c55448bc6"} Jun 10 19:51:21.818683 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.818353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" event={"ID":"ab5c9fae-89ae-4565-a662-a28aaef28e27","Type":"ContainerStarted","Data":"e6e117984c08d7d741ac77b7af871737256553f7a1b2174501158e30dd6a7089"} Jun 10 19:51:21.818683 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.818591 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:21.820461 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.820405 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" event={"ID":"9caf6641-dce5-4474-9cb5-ca642105a899","Type":"ContainerStarted","Data":"d8e1b2ccada8b7bcd23a1bc5a29b620f57dabd3882882af3f815f8d36a54d681"} Jun 10 19:51:21.846420 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.846336 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" podStartSLOduration=1.921095451 podStartE2EDuration="5.846320797s" totalImagesPullingTime="3.925225346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:51:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:21.84515103 +0000 UTC m=+95.944544772" watchObservedRunningTime="2026-06-10 19:51:21.846320797 +0000 UTC m=+95.945714537" Jun 10 19:51:21.866508 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:21.866460 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" podStartSLOduration=1.9862366059999998 podStartE2EDuration="3.86644435s" totalImagesPullingTime="1.880207744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:21.865298429 +0000 UTC m=+95.964692171" watchObservedRunningTime="2026-06-10 19:51:21.86644435 +0000 UTC m=+95.965838089" Jun 10 19:51:22.036349 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:51:22.036314 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb415d8df_6d32_4db2_92d5_0ec88cf87782.slice/crio-a0ad7bf1df0925f7ec2d4206e3f09afedda06311e864df24d052efa2a83541e0 WatchSource:0}: Error finding container a0ad7bf1df0925f7ec2d4206e3f09afedda06311e864df24d052efa2a83541e0: Status 404 returned error can't find the container with id a0ad7bf1df0925f7ec2d4206e3f09afedda06311e864df24d052efa2a83541e0 Jun 10 19:51:22.825527 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:22.825487 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" event={"ID":"3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd","Type":"ContainerStarted","Data":"d8fc50b5560f3e27de29b3a6683037af00b8f639d4bee92478a54ab93ed0c8b0"} Jun 10 19:51:22.825994 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:22.825552 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:22.827345 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:22.827314 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7678bc6677-tm8b9" event={"ID":"b415d8df-6d32-4db2-92d5-0ec88cf87782","Type":"ContainerStarted","Data":"9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b"} Jun 10 19:51:22.827462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:22.827364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7678bc6677-tm8b9" event={"ID":"b415d8df-6d32-4db2-92d5-0ec88cf87782","Type":"ContainerStarted","Data":"a0ad7bf1df0925f7ec2d4206e3f09afedda06311e864df24d052efa2a83541e0"} Jun 10 19:51:22.830931 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:22.830904 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" Jun 10 19:51:22.842151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:22.842102 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rc99m" podStartSLOduration=2.036501625 podStartE2EDuration="3.842090107s" totalImagesPullingTime="1.805588482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:22.841016796 +0000 UTC m=+96.940410536" watchObservedRunningTime="2026-06-10 19:51:22.842090107 +0000 UTC m=+96.941483871" Jun 10 19:51:22.870594 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:22.867084 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7678bc6677-tm8b9" podStartSLOduration=1.867066995 podStartE2EDuration="1.867066995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:51:22.865637077 +0000 UTC m=+96.965030817" watchObservedRunningTime="2026-06-10 19:51:22.867066995 +0000 UTC m=+96.966460739" Jun 10 19:51:24.658010 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:24.657977 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vs7cp" Jun 10 19:51:27.833631 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:27.833604 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54cb49bcbf-n2knf" Jun 10 19:51:31.542872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:31.542833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:31.543397 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:31.542941 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:31.547870 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:31.547847 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:31.866864 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:31.866788 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:51:31.918203 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:31.918173 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9c98f689-zl4x4"] Jun 10 19:51:39.110775 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:39.110734 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:39.111310 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:39.110801 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:45.669589 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.669553 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" podUID="80856b70-5375-4e88-bfac-0791c1bcb250" containerName="registry" containerID="cri-o://1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4" gracePeriod=30 Jun 10 19:51:45.918114 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.918083 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:51:45.922013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.921915 2567 generic.go:356] "Generic (PLEG): container finished" podID="80856b70-5375-4e88-bfac-0791c1bcb250" containerID="1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4" exitCode=0 Jun 10 19:51:45.922013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.921954 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" Jun 10 19:51:45.922013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.921976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" event={"ID":"80856b70-5375-4e88-bfac-0791c1bcb250","Type":"ContainerDied","Data":"1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4"} Jun 10 19:51:45.922169 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.922026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c857bf459-r76d9" event={"ID":"80856b70-5375-4e88-bfac-0791c1bcb250","Type":"ContainerDied","Data":"eb9f70a3819aa4b908d07d5a14f75eb63ff37855150da2fd12632b46cf0f3580"} Jun 10 19:51:45.922169 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.922052 2567 scope.go:117] "RemoveContainer" containerID="1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4" Jun 10 19:51:45.929898 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.929882 2567 scope.go:117] "RemoveContainer" containerID="1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4" Jun 10 19:51:45.930166 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:51:45.930147 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4\": container with ID starting with 1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4 not found: ID does not exist" containerID="1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4" Jun 10 19:51:45.930248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:45.930175 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4"} err="failed to get container status \"1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4\": rpc error: code = NotFound desc = could not find container \"1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4\": container with ID starting with 1891bbf09d55c467d1f5032f384bfd8af5ba9aa724d600c8d6683ce63420deb4 not found: ID does not exist" Jun 10 19:51:46.042981 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.042950 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtckb\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-kube-api-access-jtckb\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.042981 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.042987 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.043246 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.043022 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80856b70-5375-4e88-bfac-0791c1bcb250-ca-trust-extracted\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.043246 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.043144 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-image-registry-private-configuration\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.043246 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.043192 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-bound-sa-token\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.043414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.043253 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-registry-certificates\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.043414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.043307 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-trusted-ca\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.043414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.043332 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-installation-pull-secrets\") pod \"80856b70-5375-4e88-bfac-0791c1bcb250\" (UID: \"80856b70-5375-4e88-bfac-0791c1bcb250\") " Jun 10 19:51:46.044005 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.043950 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:51:46.044247 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.044198 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:51:46.045728 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.045693 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:51:46.045829 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.045772 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:51:46.045829 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.045810 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-kube-api-access-jtckb" (OuterVolumeSpecName: "kube-api-access-jtckb") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "kube-api-access-jtckb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:51:46.045941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.045855 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:51:46.045941 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.045894 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:51:46.051304 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.051284 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80856b70-5375-4e88-bfac-0791c1bcb250-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "80856b70-5375-4e88-bfac-0791c1bcb250" (UID: "80856b70-5375-4e88-bfac-0791c1bcb250"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:51:46.144835 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144804 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtckb\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-kube-api-access-jtckb\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.144835 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144831 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-registry-tls\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.144835 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144841 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80856b70-5375-4e88-bfac-0791c1bcb250-ca-trust-extracted\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.145037 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144850 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-image-registry-private-configuration\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.145037 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144859 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80856b70-5375-4e88-bfac-0791c1bcb250-bound-sa-token\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.145037 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144867 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-registry-certificates\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.145037 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144875 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80856b70-5375-4e88-bfac-0791c1bcb250-trusted-ca\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.145037 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.144883 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80856b70-5375-4e88-bfac-0791c1bcb250-installation-pull-secrets\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:46.250076 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.250044 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c857bf459-r76d9"] Jun 10 19:51:46.254420 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.254394 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c857bf459-r76d9"] Jun 10 19:51:46.304595 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:46.304560 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80856b70-5375-4e88-bfac-0791c1bcb250" path="/var/lib/kubelet/pods/80856b70-5375-4e88-bfac-0791c1bcb250/volumes" Jun 10 19:51:50.941739 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:50.941707 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9ca5ba4-7e29-4d87-b300-65f239e9514e" containerID="c2410bfee2fcd3ebe862ffa49054fa775a7d7ddcfc186e2d37fb205734ca2559" exitCode=0 Jun 10 19:51:50.942058 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:50.941776 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" event={"ID":"b9ca5ba4-7e29-4d87-b300-65f239e9514e","Type":"ContainerDied","Data":"c2410bfee2fcd3ebe862ffa49054fa775a7d7ddcfc186e2d37fb205734ca2559"} Jun 10 19:51:50.942107 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:50.942094 2567 scope.go:117] "RemoveContainer" containerID="c2410bfee2fcd3ebe862ffa49054fa775a7d7ddcfc186e2d37fb205734ca2559" Jun 10 19:51:51.947806 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:51.947775 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-cb7cf" event={"ID":"b9ca5ba4-7e29-4d87-b300-65f239e9514e","Type":"ContainerStarted","Data":"9dab49507a3d61edc23ae2d0796c465df7b430cc0f139ca123920d0817ffb653"} Jun 10 19:51:56.940696 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:56.940656 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d9c98f689-zl4x4" podUID="10997af2-8ad7-4b73-835d-ee6cf3803171" containerName="console" containerID="cri-o://4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5" gracePeriod=15 Jun 10 19:51:57.191707 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.191651 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:57.338960 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.338931 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-serving-cert\") pod \"10997af2-8ad7-4b73-835d-ee6cf3803171\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " Jun 10 19:51:57.339135 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.338975 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-oauth-serving-cert\") pod \"10997af2-8ad7-4b73-835d-ee6cf3803171\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " Jun 10 19:51:57.339135 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339020 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-trusted-ca-bundle\") pod \"10997af2-8ad7-4b73-835d-ee6cf3803171\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " Jun 10 19:51:57.339135 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339054 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-service-ca\") pod \"10997af2-8ad7-4b73-835d-ee6cf3803171\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " Jun 10 19:51:57.339135 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339085 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-console-config\") pod \"10997af2-8ad7-4b73-835d-ee6cf3803171\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " Jun 10 19:51:57.339135 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339109 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-oauth-config\") pod \"10997af2-8ad7-4b73-835d-ee6cf3803171\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " Jun 10 19:51:57.339426 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339144 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kshnj\" (UniqueName: \"kubernetes.io/projected/10997af2-8ad7-4b73-835d-ee6cf3803171-kube-api-access-kshnj\") pod \"10997af2-8ad7-4b73-835d-ee6cf3803171\" (UID: \"10997af2-8ad7-4b73-835d-ee6cf3803171\") " Jun 10 19:51:57.339483 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339432 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "10997af2-8ad7-4b73-835d-ee6cf3803171" (UID: "10997af2-8ad7-4b73-835d-ee6cf3803171"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:51:57.339553 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339528 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "10997af2-8ad7-4b73-835d-ee6cf3803171" (UID: "10997af2-8ad7-4b73-835d-ee6cf3803171"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:51:57.339553 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339537 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-service-ca" (OuterVolumeSpecName: "service-ca") pod "10997af2-8ad7-4b73-835d-ee6cf3803171" (UID: "10997af2-8ad7-4b73-835d-ee6cf3803171"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:51:57.339645 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.339555 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-console-config" (OuterVolumeSpecName: "console-config") pod "10997af2-8ad7-4b73-835d-ee6cf3803171" (UID: "10997af2-8ad7-4b73-835d-ee6cf3803171"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:51:57.341402 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.341378 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "10997af2-8ad7-4b73-835d-ee6cf3803171" (UID: "10997af2-8ad7-4b73-835d-ee6cf3803171"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:51:57.341543 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.341389 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10997af2-8ad7-4b73-835d-ee6cf3803171-kube-api-access-kshnj" (OuterVolumeSpecName: "kube-api-access-kshnj") pod "10997af2-8ad7-4b73-835d-ee6cf3803171" (UID: "10997af2-8ad7-4b73-835d-ee6cf3803171"). InnerVolumeSpecName "kube-api-access-kshnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:51:57.341543 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.341400 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "10997af2-8ad7-4b73-835d-ee6cf3803171" (UID: "10997af2-8ad7-4b73-835d-ee6cf3803171"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:51:57.440299 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.440251 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kshnj\" (UniqueName: \"kubernetes.io/projected/10997af2-8ad7-4b73-835d-ee6cf3803171-kube-api-access-kshnj\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:57.440299 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.440303 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:57.440299 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.440319 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-oauth-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:57.440546 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.440335 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-trusted-ca-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:57.440546 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.440351 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-service-ca\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:57.440546 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.440365 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10997af2-8ad7-4b73-835d-ee6cf3803171-console-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:57.440546 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.440379 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10997af2-8ad7-4b73-835d-ee6cf3803171-console-oauth-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:51:57.971553 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.971518 2567 generic.go:356] "Generic (PLEG): container finished" podID="10997af2-8ad7-4b73-835d-ee6cf3803171" containerID="4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5" exitCode=0 Jun 10 19:51:57.972023 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.971565 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9c98f689-zl4x4" event={"ID":"10997af2-8ad7-4b73-835d-ee6cf3803171","Type":"ContainerDied","Data":"4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5"} Jun 10 19:51:57.972023 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.971586 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9c98f689-zl4x4" Jun 10 19:51:57.972023 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.971631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9c98f689-zl4x4" event={"ID":"10997af2-8ad7-4b73-835d-ee6cf3803171","Type":"ContainerDied","Data":"716208ff89e82013124a199901c74cc83d8fdce0d1f26e2aa4ee9995fc84ace0"} Jun 10 19:51:57.972023 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.971652 2567 scope.go:117] "RemoveContainer" containerID="4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5" Jun 10 19:51:57.980642 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.980622 2567 scope.go:117] "RemoveContainer" containerID="4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5" Jun 10 19:51:57.980896 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:51:57.980877 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5\": container with ID starting with 4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5 not found: ID does not exist" containerID="4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5" Jun 10 19:51:57.980971 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.980909 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5"} err="failed to get container status \"4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5\": rpc error: code = NotFound desc = could not find container \"4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5\": container with ID starting with 4a7e096b9ee65e76fccc065fd43e92a9797c459fd40e05b8a1fcd68c283bebb5 not found: ID does not exist" Jun 10 19:51:57.996937 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:57.996908 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9c98f689-zl4x4"] Jun 10 19:51:58.003126 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:58.003106 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d9c98f689-zl4x4"] Jun 10 19:51:58.304911 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:58.304835 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10997af2-8ad7-4b73-835d-ee6cf3803171" path="/var/lib/kubelet/pods/10997af2-8ad7-4b73-835d-ee6cf3803171/volumes" Jun 10 19:51:59.116516 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:59.116486 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:51:59.120497 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:51:59.120473 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d7bc7f7f-gv5fr" Jun 10 19:52:01.990692 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:01.990658 2567 generic.go:356] "Generic (PLEG): container finished" podID="edea99ce-d5a4-486f-ac8a-0deb0c726942" containerID="4f08cdd2137baa071931e3669671ce331d2a82d8cec6a0bd1ff84b452c884a26" exitCode=0 Jun 10 19:52:01.991159 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:01.990732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5jv8x" event={"ID":"edea99ce-d5a4-486f-ac8a-0deb0c726942","Type":"ContainerDied","Data":"4f08cdd2137baa071931e3669671ce331d2a82d8cec6a0bd1ff84b452c884a26"} Jun 10 19:52:01.991258 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:01.991180 2567 scope.go:117] "RemoveContainer" containerID="4f08cdd2137baa071931e3669671ce331d2a82d8cec6a0bd1ff84b452c884a26" Jun 10 19:52:02.995885 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:02.995852 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5jv8x" event={"ID":"edea99ce-d5a4-486f-ac8a-0deb0c726942","Type":"ContainerStarted","Data":"f708be1cd691cd5f57e436d19226865bc856ee767ac987ff01ed95634dc71e06"} Jun 10 19:52:07.013324 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:07.013289 2567 generic.go:356] "Generic (PLEG): container finished" podID="48d98caa-fe9f-4009-9a3c-fe17d60ff581" containerID="d50155e6fea1276d316585db7b362307a0c09d78b3d34a6cba8d498479f34684" exitCode=0 Jun 10 19:52:07.013721 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:07.013342 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" event={"ID":"48d98caa-fe9f-4009-9a3c-fe17d60ff581","Type":"ContainerDied","Data":"d50155e6fea1276d316585db7b362307a0c09d78b3d34a6cba8d498479f34684"} Jun 10 19:52:07.013721 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:07.013624 2567 scope.go:117] "RemoveContainer" containerID="d50155e6fea1276d316585db7b362307a0c09d78b3d34a6cba8d498479f34684" Jun 10 19:52:08.021504 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:08.021454 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8ktss" event={"ID":"48d98caa-fe9f-4009-9a3c-fe17d60ff581","Type":"ContainerStarted","Data":"0cd75115ecaeb94091c65b6d2031139346efdc0485d5b52337df9544c77016e5"} Jun 10 19:52:42.862290 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.862186 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5488497558-j7skd"] Jun 10 19:52:42.862819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.862574 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80856b70-5375-4e88-bfac-0791c1bcb250" containerName="registry" Jun 10 19:52:42.862819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.862590 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="80856b70-5375-4e88-bfac-0791c1bcb250" containerName="registry" Jun 10 19:52:42.862819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.862598 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10997af2-8ad7-4b73-835d-ee6cf3803171" containerName="console" Jun 10 19:52:42.862819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.862603 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="10997af2-8ad7-4b73-835d-ee6cf3803171" containerName="console" Jun 10 19:52:42.862819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.862666 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="10997af2-8ad7-4b73-835d-ee6cf3803171" containerName="console" Jun 10 19:52:42.862819 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.862674 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="80856b70-5375-4e88-bfac-0791c1bcb250" containerName="registry" Jun 10 19:52:42.865905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.865884 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:42.874527 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:42.874466 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5488497558-j7skd"] Jun 10 19:52:43.009048 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.009011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9f5j\" (UniqueName: \"kubernetes.io/projected/2c6d40ef-370f-4555-888b-0d8b06bd0895-kube-api-access-v9f5j\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.009290 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.009069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-oauth-config\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.009290 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.009118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-config\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.009290 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.009181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-serving-cert\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.009290 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.009216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-trusted-ca-bundle\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.009290 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.009270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-oauth-serving-cert\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.009484 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.009303 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-service-ca\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.110069 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.110034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-oauth-config\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.110251 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.110093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-config\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.110251 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.110138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-serving-cert\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.110251 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.110175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-trusted-ca-bundle\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.110251 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.110201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-oauth-serving-cert\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.110251 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.110251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-service-ca\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.110527 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.110282 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9f5j\" (UniqueName: \"kubernetes.io/projected/2c6d40ef-370f-4555-888b-0d8b06bd0895-kube-api-access-v9f5j\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.111131 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.111092 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-oauth-serving-cert\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.111275 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.111098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-trusted-ca-bundle\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.111275 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.111218 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-service-ca\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.111462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.111442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-config\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.112651 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.112597 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-serving-cert\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.112751 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.112732 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-oauth-config\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.119937 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.119917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9f5j\" (UniqueName: \"kubernetes.io/projected/2c6d40ef-370f-4555-888b-0d8b06bd0895-kube-api-access-v9f5j\") pod \"console-5488497558-j7skd\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.181160 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.181133 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5488497558-j7skd" Jun 10 19:52:43.308944 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:43.308921 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5488497558-j7skd"] Jun 10 19:52:43.311111 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:52:43.311081 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6d40ef_370f_4555_888b_0d8b06bd0895.slice/crio-54e8b0949e3ed950dce97aea65d2d6ee4b96aa14f1d09aa7e67676fb91945b88 WatchSource:0}: Error finding container 54e8b0949e3ed950dce97aea65d2d6ee4b96aa14f1d09aa7e67676fb91945b88: Status 404 returned error can't find the container with id 54e8b0949e3ed950dce97aea65d2d6ee4b96aa14f1d09aa7e67676fb91945b88 Jun 10 19:52:44.172808 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:44.172770 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5488497558-j7skd" event={"ID":"2c6d40ef-370f-4555-888b-0d8b06bd0895","Type":"ContainerStarted","Data":"d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18"} Jun 10 19:52:44.173199 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:44.172830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5488497558-j7skd" event={"ID":"2c6d40ef-370f-4555-888b-0d8b06bd0895","Type":"ContainerStarted","Data":"54e8b0949e3ed950dce97aea65d2d6ee4b96aa14f1d09aa7e67676fb91945b88"} Jun 10 19:52:44.190611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:44.190562 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5488497558-j7skd" podStartSLOduration=2.190547987 podStartE2EDuration="2.190547987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:52:44.189027974 +0000 UTC m=+178.288421713" watchObservedRunningTime="2026-06-10 19:52:44.190547987 +0000 UTC m=+178.289941728" Jun 10 19:52:50.318976 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.318935 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5488497558-j7skd"] Jun 10 19:52:50.349197 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.349168 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ddd8c554f-m8fq2"] Jun 10 19:52:50.353724 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.353701 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.363599 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.363576 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ddd8c554f-m8fq2"] Jun 10 19:52:50.474142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.474097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-oauth-config\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.474142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.474146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-service-ca\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.474142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.474166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr9kg\" (UniqueName: \"kubernetes.io/projected/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-kube-api-access-cr9kg\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.474462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.474242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-oauth-serving-cert\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.474462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.474286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-config\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.474462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.474383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-trusted-ca-bundle\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.474581 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.474514 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-serving-cert\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575138 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-serving-cert\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575138 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-oauth-config\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575409 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-service-ca\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575409 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9kg\" (UniqueName: \"kubernetes.io/projected/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-kube-api-access-cr9kg\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575409 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-oauth-serving-cert\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575409 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-config\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575616 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-trusted-ca-bundle\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.575965 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.575943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-service-ca\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.576075 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.576044 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-oauth-serving-cert\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.576075 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.576066 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-config\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.576260 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.576216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-trusted-ca-bundle\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.577756 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.577730 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-oauth-config\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.577852 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.577766 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-serving-cert\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.584355 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.584334 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr9kg\" (UniqueName: \"kubernetes.io/projected/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-kube-api-access-cr9kg\") pod \"console-ddd8c554f-m8fq2\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.663359 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.663329 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:52:50.820300 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:50.820272 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ddd8c554f-m8fq2"] Jun 10 19:52:50.821405 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:52:50.821370 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed098e7_f4ea_47e8_b66d_7a04a0f58961.slice/crio-587a0f7d3d9c11afe8398d70cebfb1c19d7738d5c5688e21e55938aa46840d1c WatchSource:0}: Error finding container 587a0f7d3d9c11afe8398d70cebfb1c19d7738d5c5688e21e55938aa46840d1c: Status 404 returned error can't find the container with id 587a0f7d3d9c11afe8398d70cebfb1c19d7738d5c5688e21e55938aa46840d1c Jun 10 19:52:51.201706 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:51.201667 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddd8c554f-m8fq2" event={"ID":"3ed098e7-f4ea-47e8-b66d-7a04a0f58961","Type":"ContainerStarted","Data":"dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc"} Jun 10 19:52:51.201872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:51.201730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddd8c554f-m8fq2" event={"ID":"3ed098e7-f4ea-47e8-b66d-7a04a0f58961","Type":"ContainerStarted","Data":"587a0f7d3d9c11afe8398d70cebfb1c19d7738d5c5688e21e55938aa46840d1c"} Jun 10 19:52:51.220234 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:51.220177 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ddd8c554f-m8fq2" podStartSLOduration=1.220162727 podStartE2EDuration="1.220162727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:52:51.218306552 +0000 UTC m=+185.317700289" watchObservedRunningTime="2026-06-10 19:52:51.220162727 +0000 UTC m=+185.319556467" Jun 10 19:52:53.181778 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:52:53.181736 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5488497558-j7skd" Jun 10 19:53:00.663882 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:00.663840 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:53:00.664293 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:00.663913 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:53:00.668640 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:00.668615 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:53:01.255697 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:01.255670 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:53:01.297987 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:01.297947 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7678bc6677-tm8b9"] Jun 10 19:53:15.342339 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.342287 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5488497558-j7skd" podUID="2c6d40ef-370f-4555-888b-0d8b06bd0895" containerName="console" containerID="cri-o://d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18" gracePeriod=15 Jun 10 19:53:15.593179 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.593123 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5488497558-j7skd" Jun 10 19:53:15.659437 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659411 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-service-ca\") pod \"2c6d40ef-370f-4555-888b-0d8b06bd0895\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " Jun 10 19:53:15.659595 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659471 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-trusted-ca-bundle\") pod \"2c6d40ef-370f-4555-888b-0d8b06bd0895\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " Jun 10 19:53:15.659595 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659495 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-serving-cert\") pod \"2c6d40ef-370f-4555-888b-0d8b06bd0895\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " Jun 10 19:53:15.659680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659590 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9f5j\" (UniqueName: \"kubernetes.io/projected/2c6d40ef-370f-4555-888b-0d8b06bd0895-kube-api-access-v9f5j\") pod \"2c6d40ef-370f-4555-888b-0d8b06bd0895\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " Jun 10 19:53:15.659680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659641 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-config\") pod \"2c6d40ef-370f-4555-888b-0d8b06bd0895\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " Jun 10 19:53:15.659775 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659755 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-oauth-config\") pod \"2c6d40ef-370f-4555-888b-0d8b06bd0895\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " Jun 10 19:53:15.659839 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659824 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-oauth-serving-cert\") pod \"2c6d40ef-370f-4555-888b-0d8b06bd0895\" (UID: \"2c6d40ef-370f-4555-888b-0d8b06bd0895\") " Jun 10 19:53:15.659926 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659898 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-service-ca" (OuterVolumeSpecName: "service-ca") pod "2c6d40ef-370f-4555-888b-0d8b06bd0895" (UID: "2c6d40ef-370f-4555-888b-0d8b06bd0895"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:15.660004 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659938 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-config" (OuterVolumeSpecName: "console-config") pod "2c6d40ef-370f-4555-888b-0d8b06bd0895" (UID: "2c6d40ef-370f-4555-888b-0d8b06bd0895"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:15.660004 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.659958 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2c6d40ef-370f-4555-888b-0d8b06bd0895" (UID: "2c6d40ef-370f-4555-888b-0d8b06bd0895"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:15.660244 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.660202 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:15.660330 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.660241 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2c6d40ef-370f-4555-888b-0d8b06bd0895" (UID: "2c6d40ef-370f-4555-888b-0d8b06bd0895"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:15.660330 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.660249 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-service-ca\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:15.660330 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.660287 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-trusted-ca-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:15.661724 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.661702 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2c6d40ef-370f-4555-888b-0d8b06bd0895" (UID: "2c6d40ef-370f-4555-888b-0d8b06bd0895"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:53:15.661796 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.661749 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2c6d40ef-370f-4555-888b-0d8b06bd0895" (UID: "2c6d40ef-370f-4555-888b-0d8b06bd0895"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:53:15.661848 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.661827 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6d40ef-370f-4555-888b-0d8b06bd0895-kube-api-access-v9f5j" (OuterVolumeSpecName: "kube-api-access-v9f5j") pod "2c6d40ef-370f-4555-888b-0d8b06bd0895" (UID: "2c6d40ef-370f-4555-888b-0d8b06bd0895"). InnerVolumeSpecName "kube-api-access-v9f5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:53:15.760978 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.760929 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:15.760978 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.760972 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9f5j\" (UniqueName: \"kubernetes.io/projected/2c6d40ef-370f-4555-888b-0d8b06bd0895-kube-api-access-v9f5j\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:15.760978 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.760984 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c6d40ef-370f-4555-888b-0d8b06bd0895-console-oauth-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:15.760978 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:15.760993 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c6d40ef-370f-4555-888b-0d8b06bd0895-oauth-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:16.307661 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.307622 2567 generic.go:356] "Generic (PLEG): container finished" podID="2c6d40ef-370f-4555-888b-0d8b06bd0895" containerID="d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18" exitCode=0 Jun 10 19:53:16.307661 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.307664 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5488497558-j7skd" Jun 10 19:53:16.307926 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.307666 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5488497558-j7skd" event={"ID":"2c6d40ef-370f-4555-888b-0d8b06bd0895","Type":"ContainerDied","Data":"d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18"} Jun 10 19:53:16.307926 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.307782 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5488497558-j7skd" event={"ID":"2c6d40ef-370f-4555-888b-0d8b06bd0895","Type":"ContainerDied","Data":"54e8b0949e3ed950dce97aea65d2d6ee4b96aa14f1d09aa7e67676fb91945b88"} Jun 10 19:53:16.307926 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.307815 2567 scope.go:117] "RemoveContainer" containerID="d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18" Jun 10 19:53:16.317769 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.317741 2567 scope.go:117] "RemoveContainer" containerID="d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18" Jun 10 19:53:16.318085 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:53:16.318059 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18\": container with ID starting with d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18 not found: ID does not exist" containerID="d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18" Jun 10 19:53:16.318172 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.318096 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18"} err="failed to get container status \"d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18\": rpc error: code = NotFound desc = could not find container \"d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18\": container with ID starting with d143ab56eeb16a8730fef2fb02194a40ad4dcd4efd61d47b6c02938f63a8ca18 not found: ID does not exist" Jun 10 19:53:16.341307 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.340882 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5488497558-j7skd"] Jun 10 19:53:16.342816 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:16.342790 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5488497558-j7skd"] Jun 10 19:53:18.304604 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:18.304572 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c6d40ef-370f-4555-888b-0d8b06bd0895" path="/var/lib/kubelet/pods/2c6d40ef-370f-4555-888b-0d8b06bd0895/volumes" Jun 10 19:53:26.322120 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.322079 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7678bc6677-tm8b9" podUID="b415d8df-6d32-4db2-92d5-0ec88cf87782" containerName="console" containerID="cri-o://9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b" gracePeriod=15 Jun 10 19:53:26.570604 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.570580 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:53:26.647127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647048 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-serving-cert\") pod \"b415d8df-6d32-4db2-92d5-0ec88cf87782\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " Jun 10 19:53:26.647127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647086 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-oauth-serving-cert\") pod \"b415d8df-6d32-4db2-92d5-0ec88cf87782\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " Jun 10 19:53:26.647127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647125 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfbgb\" (UniqueName: \"kubernetes.io/projected/b415d8df-6d32-4db2-92d5-0ec88cf87782-kube-api-access-mfbgb\") pod \"b415d8df-6d32-4db2-92d5-0ec88cf87782\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " Jun 10 19:53:26.647414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647146 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-service-ca\") pod \"b415d8df-6d32-4db2-92d5-0ec88cf87782\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " Jun 10 19:53:26.647414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647169 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-trusted-ca-bundle\") pod \"b415d8df-6d32-4db2-92d5-0ec88cf87782\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " Jun 10 19:53:26.647414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647253 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-config\") pod \"b415d8df-6d32-4db2-92d5-0ec88cf87782\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " Jun 10 19:53:26.647414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647276 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-oauth-config\") pod \"b415d8df-6d32-4db2-92d5-0ec88cf87782\" (UID: \"b415d8df-6d32-4db2-92d5-0ec88cf87782\") " Jun 10 19:53:26.647859 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647663 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-service-ca" (OuterVolumeSpecName: "service-ca") pod "b415d8df-6d32-4db2-92d5-0ec88cf87782" (UID: "b415d8df-6d32-4db2-92d5-0ec88cf87782"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:26.647859 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647670 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b415d8df-6d32-4db2-92d5-0ec88cf87782" (UID: "b415d8df-6d32-4db2-92d5-0ec88cf87782"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:26.647859 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647806 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-config" (OuterVolumeSpecName: "console-config") pod "b415d8df-6d32-4db2-92d5-0ec88cf87782" (UID: "b415d8df-6d32-4db2-92d5-0ec88cf87782"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:26.647859 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.647844 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b415d8df-6d32-4db2-92d5-0ec88cf87782" (UID: "b415d8df-6d32-4db2-92d5-0ec88cf87782"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:53:26.649399 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.649374 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b415d8df-6d32-4db2-92d5-0ec88cf87782" (UID: "b415d8df-6d32-4db2-92d5-0ec88cf87782"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:53:26.649399 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.649386 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b415d8df-6d32-4db2-92d5-0ec88cf87782-kube-api-access-mfbgb" (OuterVolumeSpecName: "kube-api-access-mfbgb") pod "b415d8df-6d32-4db2-92d5-0ec88cf87782" (UID: "b415d8df-6d32-4db2-92d5-0ec88cf87782"). InnerVolumeSpecName "kube-api-access-mfbgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:53:26.649517 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.649410 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b415d8df-6d32-4db2-92d5-0ec88cf87782" (UID: "b415d8df-6d32-4db2-92d5-0ec88cf87782"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:53:26.748567 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.748538 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfbgb\" (UniqueName: \"kubernetes.io/projected/b415d8df-6d32-4db2-92d5-0ec88cf87782-kube-api-access-mfbgb\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:26.748567 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.748569 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-service-ca\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:26.748716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.748581 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-trusted-ca-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:26.748716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.748590 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:26.748716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.748599 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-oauth-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:26.748716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.748607 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b415d8df-6d32-4db2-92d5-0ec88cf87782-console-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:26.748716 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:26.748615 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b415d8df-6d32-4db2-92d5-0ec88cf87782-oauth-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:53:27.352410 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.352377 2567 generic.go:356] "Generic (PLEG): container finished" podID="b415d8df-6d32-4db2-92d5-0ec88cf87782" containerID="9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b" exitCode=0 Jun 10 19:53:27.352877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.352422 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7678bc6677-tm8b9" Jun 10 19:53:27.352877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.352470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7678bc6677-tm8b9" event={"ID":"b415d8df-6d32-4db2-92d5-0ec88cf87782","Type":"ContainerDied","Data":"9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b"} Jun 10 19:53:27.352877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.352525 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7678bc6677-tm8b9" event={"ID":"b415d8df-6d32-4db2-92d5-0ec88cf87782","Type":"ContainerDied","Data":"a0ad7bf1df0925f7ec2d4206e3f09afedda06311e864df24d052efa2a83541e0"} Jun 10 19:53:27.352877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.352556 2567 scope.go:117] "RemoveContainer" containerID="9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b" Jun 10 19:53:27.361761 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.361744 2567 scope.go:117] "RemoveContainer" containerID="9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b" Jun 10 19:53:27.362034 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:53:27.362014 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b\": container with ID starting with 9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b not found: ID does not exist" containerID="9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b" Jun 10 19:53:27.362080 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.362042 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b"} err="failed to get container status \"9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b\": rpc error: code = NotFound desc = could not find container \"9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b\": container with ID starting with 9925fdaaa53bb967408af7532eaf8122f07e3e9f21a14507fe7c3049bc05bc9b not found: ID does not exist" Jun 10 19:53:27.373720 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.373696 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7678bc6677-tm8b9"] Jun 10 19:53:27.377365 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:27.377343 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7678bc6677-tm8b9"] Jun 10 19:53:28.308365 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:28.308333 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b415d8df-6d32-4db2-92d5-0ec88cf87782" path="/var/lib/kubelet/pods/b415d8df-6d32-4db2-92d5-0ec88cf87782/volumes" Jun 10 19:53:44.124629 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.124593 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797"] Jun 10 19:53:44.125013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.124882 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6d40ef-370f-4555-888b-0d8b06bd0895" containerName="console" Jun 10 19:53:44.125013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.124893 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6d40ef-370f-4555-888b-0d8b06bd0895" containerName="console" Jun 10 19:53:44.125013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.124910 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b415d8df-6d32-4db2-92d5-0ec88cf87782" containerName="console" Jun 10 19:53:44.125013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.124915 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b415d8df-6d32-4db2-92d5-0ec88cf87782" containerName="console" Jun 10 19:53:44.125013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.124972 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b415d8df-6d32-4db2-92d5-0ec88cf87782" containerName="console" Jun 10 19:53:44.125013 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.124981 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c6d40ef-370f-4555-888b-0d8b06bd0895" containerName="console" Jun 10 19:53:44.127859 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.127843 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.130427 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.130405 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xnsxg\"" Jun 10 19:53:44.130568 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.130450 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:53:44.131286 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.131266 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:53:44.137644 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.137621 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797"] Jun 10 19:53:44.188963 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.188928 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-688gm\" (UniqueName: \"kubernetes.io/projected/77d939fe-8701-416d-8e0e-6b6da52bace1-kube-api-access-688gm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.188963 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.188966 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.189142 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.189029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.289518 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.289474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-688gm\" (UniqueName: \"kubernetes.io/projected/77d939fe-8701-416d-8e0e-6b6da52bace1-kube-api-access-688gm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.289694 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.289526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.289694 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.289579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.289954 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.289934 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.289991 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.289972 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.298732 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.298700 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-688gm\" (UniqueName: \"kubernetes.io/projected/77d939fe-8701-416d-8e0e-6b6da52bace1-kube-api-access-688gm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.437395 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.437315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:53:44.568946 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:44.568922 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797"] Jun 10 19:53:44.571616 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:53:44.571582 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d939fe_8701_416d_8e0e_6b6da52bace1.slice/crio-4f3d023446957ba3ba310a8f93bf353c355e005ced7056df163f3ef51783c7c5 WatchSource:0}: Error finding container 4f3d023446957ba3ba310a8f93bf353c355e005ced7056df163f3ef51783c7c5: Status 404 returned error can't find the container with id 4f3d023446957ba3ba310a8f93bf353c355e005ced7056df163f3ef51783c7c5 Jun 10 19:53:45.424345 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:45.424309 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" event={"ID":"77d939fe-8701-416d-8e0e-6b6da52bace1","Type":"ContainerStarted","Data":"4f3d023446957ba3ba310a8f93bf353c355e005ced7056df163f3ef51783c7c5"} Jun 10 19:53:53.462328 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:53.462290 2567 generic.go:356] "Generic (PLEG): container finished" podID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerID="aba1e3ab41614ef62147ae8478e7916745f769b8015e3add76baa23698b21868" exitCode=0 Jun 10 19:53:53.462700 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:53.462371 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" event={"ID":"77d939fe-8701-416d-8e0e-6b6da52bace1","Type":"ContainerDied","Data":"aba1e3ab41614ef62147ae8478e7916745f769b8015e3add76baa23698b21868"} Jun 10 19:53:55.473369 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:55.473334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" event={"ID":"77d939fe-8701-416d-8e0e-6b6da52bace1","Type":"ContainerStarted","Data":"abf2f7856a9ac6201d30f9fef6644899bf6e6b88dcbb41636ba3f9f9380e0033"} Jun 10 19:53:56.484426 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:56.484391 2567 generic.go:356] "Generic (PLEG): container finished" podID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerID="abf2f7856a9ac6201d30f9fef6644899bf6e6b88dcbb41636ba3f9f9380e0033" exitCode=0 Jun 10 19:53:56.484872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:53:56.484475 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" event={"ID":"77d939fe-8701-416d-8e0e-6b6da52bace1","Type":"ContainerDied","Data":"abf2f7856a9ac6201d30f9fef6644899bf6e6b88dcbb41636ba3f9f9380e0033"} Jun 10 19:54:05.524758 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:05.524723 2567 generic.go:356] "Generic (PLEG): container finished" podID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerID="6c8a9455f95d36e85527fff54a104991e8ae31f1519a9942e6b23e9d5d8d5750" exitCode=0 Jun 10 19:54:05.525114 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:05.524765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" event={"ID":"77d939fe-8701-416d-8e0e-6b6da52bace1","Type":"ContainerDied","Data":"6c8a9455f95d36e85527fff54a104991e8ae31f1519a9942e6b23e9d5d8d5750"} Jun 10 19:54:06.701949 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.701919 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:54:06.884881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.884803 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-688gm\" (UniqueName: \"kubernetes.io/projected/77d939fe-8701-416d-8e0e-6b6da52bace1-kube-api-access-688gm\") pod \"77d939fe-8701-416d-8e0e-6b6da52bace1\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " Jun 10 19:54:06.885023 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.884880 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-util\") pod \"77d939fe-8701-416d-8e0e-6b6da52bace1\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " Jun 10 19:54:06.885023 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.884929 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-bundle\") pod \"77d939fe-8701-416d-8e0e-6b6da52bace1\" (UID: \"77d939fe-8701-416d-8e0e-6b6da52bace1\") " Jun 10 19:54:06.885644 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.885616 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-bundle" (OuterVolumeSpecName: "bundle") pod "77d939fe-8701-416d-8e0e-6b6da52bace1" (UID: "77d939fe-8701-416d-8e0e-6b6da52bace1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:54:06.887079 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.887053 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77d939fe-8701-416d-8e0e-6b6da52bace1-kube-api-access-688gm" (OuterVolumeSpecName: "kube-api-access-688gm") pod "77d939fe-8701-416d-8e0e-6b6da52bace1" (UID: "77d939fe-8701-416d-8e0e-6b6da52bace1"). InnerVolumeSpecName "kube-api-access-688gm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:54:06.889133 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.889101 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-util" (OuterVolumeSpecName: "util") pod "77d939fe-8701-416d-8e0e-6b6da52bace1" (UID: "77d939fe-8701-416d-8e0e-6b6da52bace1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:54:06.986167 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.986141 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-688gm\" (UniqueName: \"kubernetes.io/projected/77d939fe-8701-416d-8e0e-6b6da52bace1-kube-api-access-688gm\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:06.986167 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.986165 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:06.986328 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:06.986174 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77d939fe-8701-416d-8e0e-6b6da52bace1-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:07.534301 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:07.534268 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" event={"ID":"77d939fe-8701-416d-8e0e-6b6da52bace1","Type":"ContainerDied","Data":"4f3d023446957ba3ba310a8f93bf353c355e005ced7056df163f3ef51783c7c5"} Jun 10 19:54:07.534301 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:07.534293 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djz797" Jun 10 19:54:07.534504 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:07.534312 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f3d023446957ba3ba310a8f93bf353c355e005ced7056df163f3ef51783c7c5" Jun 10 19:54:12.196065 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196028 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j"] Jun 10 19:54:12.196575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196479 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerName="extract" Jun 10 19:54:12.196575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196498 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerName="extract" Jun 10 19:54:12.196575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196517 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerName="pull" Jun 10 19:54:12.196575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196526 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerName="pull" Jun 10 19:54:12.196575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196539 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerName="util" Jun 10 19:54:12.196575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196549 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerName="util" Jun 10 19:54:12.196768 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.196643 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="77d939fe-8701-416d-8e0e-6b6da52bace1" containerName="extract" Jun 10 19:54:12.198988 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.198971 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.201495 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.201470 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 19:54:12.201613 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.201538 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2kw2n\"" Jun 10 19:54:12.201786 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.201771 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:54:12.222431 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.222397 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j"] Jun 10 19:54:12.226112 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.226084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3fa094a-6c80-4591-94c2-272aedd6ea87-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lpb8j\" (UID: \"e3fa094a-6c80-4591-94c2-272aedd6ea87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.226215 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.226154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xtc\" (UniqueName: \"kubernetes.io/projected/e3fa094a-6c80-4591-94c2-272aedd6ea87-kube-api-access-f2xtc\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lpb8j\" (UID: \"e3fa094a-6c80-4591-94c2-272aedd6ea87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.327201 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.327171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xtc\" (UniqueName: \"kubernetes.io/projected/e3fa094a-6c80-4591-94c2-272aedd6ea87-kube-api-access-f2xtc\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lpb8j\" (UID: \"e3fa094a-6c80-4591-94c2-272aedd6ea87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.327405 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.327271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3fa094a-6c80-4591-94c2-272aedd6ea87-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lpb8j\" (UID: \"e3fa094a-6c80-4591-94c2-272aedd6ea87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.327598 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.327581 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3fa094a-6c80-4591-94c2-272aedd6ea87-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lpb8j\" (UID: \"e3fa094a-6c80-4591-94c2-272aedd6ea87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.339321 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.339297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xtc\" (UniqueName: \"kubernetes.io/projected/e3fa094a-6c80-4591-94c2-272aedd6ea87-kube-api-access-f2xtc\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lpb8j\" (UID: \"e3fa094a-6c80-4591-94c2-272aedd6ea87\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.508030 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.508002 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" Jun 10 19:54:12.687601 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:12.687568 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j"] Jun 10 19:54:12.690817 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:54:12.690788 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fa094a_6c80_4591_94c2_272aedd6ea87.slice/crio-59a84cfa605344f2d50af2fea888084e803a829415cfcb029f07478f7b91a382 WatchSource:0}: Error finding container 59a84cfa605344f2d50af2fea888084e803a829415cfcb029f07478f7b91a382: Status 404 returned error can't find the container with id 59a84cfa605344f2d50af2fea888084e803a829415cfcb029f07478f7b91a382 Jun 10 19:54:13.562779 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:13.562740 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" event={"ID":"e3fa094a-6c80-4591-94c2-272aedd6ea87","Type":"ContainerStarted","Data":"59a84cfa605344f2d50af2fea888084e803a829415cfcb029f07478f7b91a382"} Jun 10 19:54:14.569395 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:14.569305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" event={"ID":"e3fa094a-6c80-4591-94c2-272aedd6ea87","Type":"ContainerStarted","Data":"fb5e6077390ef0a5cff422f2b3d17a1f916214f174f36e58dc9647170cc7c39b"} Jun 10 19:54:14.596834 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:14.596388 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lpb8j" podStartSLOduration=1.068356409 podStartE2EDuration="2.596368008s" totalImagesPullingTime="1.528011599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:54:14.593579621 +0000 UTC m=+268.692973361" watchObservedRunningTime="2026-06-10 19:54:14.596368008 +0000 UTC m=+268.695761748" Jun 10 19:54:15.992004 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:15.991968 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds"] Jun 10 19:54:15.994404 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:15.994384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:15.997284 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:15.997257 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xnsxg\"" Jun 10 19:54:15.997670 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:15.997653 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:54:15.999270 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:15.999252 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:54:16.021952 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.021922 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds"] Jun 10 19:54:16.059410 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.059376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.059570 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.059434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dl5n\" (UniqueName: \"kubernetes.io/projected/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-kube-api-access-2dl5n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.059570 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.059483 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.160872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.160833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.161047 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.160893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.161047 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.160932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dl5n\" (UniqueName: \"kubernetes.io/projected/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-kube-api-access-2dl5n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.161250 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.161206 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.161350 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.161329 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.171620 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.171594 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dl5n\" (UniqueName: \"kubernetes.io/projected/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-kube-api-access-2dl5n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.303467 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.303382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:16.433327 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.433288 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds"] Jun 10 19:54:16.437160 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:54:16.437128 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cc1e6d_7170_409b_94b6_43dbfeb7fbd1.slice/crio-9b0105accb79baf02eb1ca6a2ba6d7b7bc36790a8b7271ecb69d4319790768d8 WatchSource:0}: Error finding container 9b0105accb79baf02eb1ca6a2ba6d7b7bc36790a8b7271ecb69d4319790768d8: Status 404 returned error can't find the container with id 9b0105accb79baf02eb1ca6a2ba6d7b7bc36790a8b7271ecb69d4319790768d8 Jun 10 19:54:16.579614 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.579538 2567 generic.go:356] "Generic (PLEG): container finished" podID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerID="9b4fda8300647dde4183a535b4450b81132dba3c5278314f552b7ec50aba7490" exitCode=0 Jun 10 19:54:16.579741 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.579617 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" event={"ID":"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1","Type":"ContainerDied","Data":"9b4fda8300647dde4183a535b4450b81132dba3c5278314f552b7ec50aba7490"} Jun 10 19:54:16.579741 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:16.579670 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" event={"ID":"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1","Type":"ContainerStarted","Data":"9b0105accb79baf02eb1ca6a2ba6d7b7bc36790a8b7271ecb69d4319790768d8"} Jun 10 19:54:18.350890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.350856 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cv69x"] Jun 10 19:54:18.353179 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.353158 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:18.355550 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.355522 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 19:54:18.355672 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.355556 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 19:54:18.355737 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.355683 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h5d8h\"" Jun 10 19:54:18.363768 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.363742 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cv69x"] Jun 10 19:54:18.380578 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.380541 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qlh7\" (UniqueName: \"kubernetes.io/projected/e406061d-7384-4276-96c8-45864c1e8210-kube-api-access-6qlh7\") pod \"cert-manager-webhook-7dc76cbb94-cv69x\" (UID: \"e406061d-7384-4276-96c8-45864c1e8210\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:18.380758 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.380660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e406061d-7384-4276-96c8-45864c1e8210-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cv69x\" (UID: \"e406061d-7384-4276-96c8-45864c1e8210\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:18.481837 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.481799 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qlh7\" (UniqueName: \"kubernetes.io/projected/e406061d-7384-4276-96c8-45864c1e8210-kube-api-access-6qlh7\") pod \"cert-manager-webhook-7dc76cbb94-cv69x\" (UID: \"e406061d-7384-4276-96c8-45864c1e8210\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:18.482026 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.481959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e406061d-7384-4276-96c8-45864c1e8210-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cv69x\" (UID: \"e406061d-7384-4276-96c8-45864c1e8210\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:18.490928 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.490899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e406061d-7384-4276-96c8-45864c1e8210-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cv69x\" (UID: \"e406061d-7384-4276-96c8-45864c1e8210\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:18.491075 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.491014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qlh7\" (UniqueName: \"kubernetes.io/projected/e406061d-7384-4276-96c8-45864c1e8210-kube-api-access-6qlh7\") pod \"cert-manager-webhook-7dc76cbb94-cv69x\" (UID: \"e406061d-7384-4276-96c8-45864c1e8210\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:18.674900 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:18.674814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:19.216721 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:19.216685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cv69x"] Jun 10 19:54:19.218184 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:54:19.218154 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode406061d_7384_4276_96c8_45864c1e8210.slice/crio-f17d188719dc7821bd1608049c0cbb9793a91ccf3a690e5a404ba10939dfc542 WatchSource:0}: Error finding container f17d188719dc7821bd1608049c0cbb9793a91ccf3a690e5a404ba10939dfc542: Status 404 returned error can't find the container with id f17d188719dc7821bd1608049c0cbb9793a91ccf3a690e5a404ba10939dfc542 Jun 10 19:54:19.594382 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:19.594343 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" event={"ID":"e406061d-7384-4276-96c8-45864c1e8210","Type":"ContainerStarted","Data":"f17d188719dc7821bd1608049c0cbb9793a91ccf3a690e5a404ba10939dfc542"} Jun 10 19:54:19.596047 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:19.596024 2567 generic.go:356] "Generic (PLEG): container finished" podID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerID="22fbe99cdf6ec414abdc1b9f624a6db3976ebdea83bcb131f6803c3191422b4f" exitCode=0 Jun 10 19:54:19.596121 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:19.596064 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" event={"ID":"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1","Type":"ContainerDied","Data":"22fbe99cdf6ec414abdc1b9f624a6db3976ebdea83bcb131f6803c3191422b4f"} Jun 10 19:54:20.603979 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:20.603934 2567 generic.go:356] "Generic (PLEG): container finished" podID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerID="6bf91ac599ada68ca8b236a9e6d03637d026e6faad073450b95790fed7f72fa7" exitCode=0 Jun 10 19:54:20.604432 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:20.604027 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" event={"ID":"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1","Type":"ContainerDied","Data":"6bf91ac599ada68ca8b236a9e6d03637d026e6faad073450b95790fed7f72fa7"} Jun 10 19:54:22.088583 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.088555 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:22.118433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.118406 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dl5n\" (UniqueName: \"kubernetes.io/projected/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-kube-api-access-2dl5n\") pod \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " Jun 10 19:54:22.118577 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.118456 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-util\") pod \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " Jun 10 19:54:22.118577 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.118520 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-bundle\") pod \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\" (UID: \"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1\") " Jun 10 19:54:22.118932 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.118904 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-bundle" (OuterVolumeSpecName: "bundle") pod "b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" (UID: "b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:54:22.120549 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.120517 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-kube-api-access-2dl5n" (OuterVolumeSpecName: "kube-api-access-2dl5n") pod "b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" (UID: "b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1"). InnerVolumeSpecName "kube-api-access-2dl5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:54:22.123389 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.123367 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-util" (OuterVolumeSpecName: "util") pod "b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" (UID: "b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:54:22.219298 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.219269 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dl5n\" (UniqueName: \"kubernetes.io/projected/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-kube-api-access-2dl5n\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:22.219298 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.219294 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:22.219298 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.219305 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:22.615608 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.615576 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" Jun 10 19:54:22.615608 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.615601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp72ds" event={"ID":"b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1","Type":"ContainerDied","Data":"9b0105accb79baf02eb1ca6a2ba6d7b7bc36790a8b7271ecb69d4319790768d8"} Jun 10 19:54:22.615830 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.615644 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b0105accb79baf02eb1ca6a2ba6d7b7bc36790a8b7271ecb69d4319790768d8" Jun 10 19:54:22.617187 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.617158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" event={"ID":"e406061d-7384-4276-96c8-45864c1e8210","Type":"ContainerStarted","Data":"d9e6574231c3a345229056602eb21a8ac59584cea6d5b92faf78f3cfcf0bf50b"} Jun 10 19:54:22.617314 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.617257 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:22.635211 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:22.635162 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" podStartSLOduration=1.716973235 podStartE2EDuration="4.635149106s" totalImagesPullingTime="2.918175871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:54:22.634150712 +0000 UTC m=+276.733544451" watchObservedRunningTime="2026-06-10 19:54:22.635149106 +0000 UTC m=+276.734542846" Jun 10 19:54:28.624057 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:28.624024 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cv69x" Jun 10 19:54:35.830307 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830273 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-tz9wg"] Jun 10 19:54:35.830684 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830581 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerName="pull" Jun 10 19:54:35.830684 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830595 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerName="pull" Jun 10 19:54:35.830684 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830608 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerName="util" Jun 10 19:54:35.830684 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830614 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerName="util" Jun 10 19:54:35.830684 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830627 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerName="extract" Jun 10 19:54:35.830684 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830632 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerName="extract" Jun 10 19:54:35.830872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.830689 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2cc1e6d-7170-409b-94b6-43dbfeb7fbd1" containerName="extract" Jun 10 19:54:35.851394 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.851370 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-tz9wg"] Jun 10 19:54:35.851533 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.851454 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:35.853823 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.853802 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-txgwr\"" Jun 10 19:54:35.932417 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.932383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7xw\" (UniqueName: \"kubernetes.io/projected/058eeb03-4a79-414d-b971-7ce64cf30250-kube-api-access-7k7xw\") pod \"cert-manager-59c77684cc-tz9wg\" (UID: \"058eeb03-4a79-414d-b971-7ce64cf30250\") " pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:35.932548 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:35.932443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/058eeb03-4a79-414d-b971-7ce64cf30250-bound-sa-token\") pod \"cert-manager-59c77684cc-tz9wg\" (UID: \"058eeb03-4a79-414d-b971-7ce64cf30250\") " pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:36.033613 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.033576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7xw\" (UniqueName: \"kubernetes.io/projected/058eeb03-4a79-414d-b971-7ce64cf30250-kube-api-access-7k7xw\") pod \"cert-manager-59c77684cc-tz9wg\" (UID: \"058eeb03-4a79-414d-b971-7ce64cf30250\") " pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:36.033746 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.033632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/058eeb03-4a79-414d-b971-7ce64cf30250-bound-sa-token\") pod \"cert-manager-59c77684cc-tz9wg\" (UID: \"058eeb03-4a79-414d-b971-7ce64cf30250\") " pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:36.041624 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.041592 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/058eeb03-4a79-414d-b971-7ce64cf30250-bound-sa-token\") pod \"cert-manager-59c77684cc-tz9wg\" (UID: \"058eeb03-4a79-414d-b971-7ce64cf30250\") " pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:36.041789 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.041770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7xw\" (UniqueName: \"kubernetes.io/projected/058eeb03-4a79-414d-b971-7ce64cf30250-kube-api-access-7k7xw\") pod \"cert-manager-59c77684cc-tz9wg\" (UID: \"058eeb03-4a79-414d-b971-7ce64cf30250\") " pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:36.160652 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.160539 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-tz9wg" Jun 10 19:54:36.311578 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.311550 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-tz9wg"] Jun 10 19:54:36.314396 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:54:36.314368 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod058eeb03_4a79_414d_b971_7ce64cf30250.slice/crio-b8248004f1fb822ac37528cb1fa695053599765009f6f990944dd720bdc25aba WatchSource:0}: Error finding container b8248004f1fb822ac37528cb1fa695053599765009f6f990944dd720bdc25aba: Status 404 returned error can't find the container with id b8248004f1fb822ac37528cb1fa695053599765009f6f990944dd720bdc25aba Jun 10 19:54:36.681328 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.681220 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-tz9wg" event={"ID":"058eeb03-4a79-414d-b971-7ce64cf30250","Type":"ContainerStarted","Data":"2c7ed9ae2707f90d4f3a0b3fb0966fdeb26f796051caa94798c247cc4c41722d"} Jun 10 19:54:36.681328 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.681285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-tz9wg" event={"ID":"058eeb03-4a79-414d-b971-7ce64cf30250","Type":"ContainerStarted","Data":"b8248004f1fb822ac37528cb1fa695053599765009f6f990944dd720bdc25aba"} Jun 10 19:54:36.702543 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:36.702497 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-tz9wg" podStartSLOduration=1.702482222 podStartE2EDuration="1.702482222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:54:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:54:36.700122785 +0000 UTC m=+290.799516524" watchObservedRunningTime="2026-06-10 19:54:36.702482222 +0000 UTC m=+290.801875963" Jun 10 19:54:39.334955 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.334914 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p"] Jun 10 19:54:39.337401 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.337380 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.339856 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.339821 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:54:39.340827 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.340810 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:54:39.340938 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.340815 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xnsxg\"" Jun 10 19:54:39.349927 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.349904 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p"] Jun 10 19:54:39.464642 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.464602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmbm\" (UniqueName: \"kubernetes.io/projected/e28ab719-d7dd-47b7-b964-1dc5e675fff1-kube-api-access-ljmbm\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.464811 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.464657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.464811 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.464688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.565464 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.565428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmbm\" (UniqueName: \"kubernetes.io/projected/e28ab719-d7dd-47b7-b964-1dc5e675fff1-kube-api-access-ljmbm\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.565666 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.565475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.565666 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.565495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.565837 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.565815 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.565891 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.565857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.573802 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.573778 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmbm\" (UniqueName: \"kubernetes.io/projected/e28ab719-d7dd-47b7-b964-1dc5e675fff1-kube-api-access-ljmbm\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.647539 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.647452 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:39.778051 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:39.778030 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p"] Jun 10 19:54:39.780436 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:54:39.780411 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28ab719_d7dd_47b7_b964_1dc5e675fff1.slice/crio-54a411eea500189ec245a395d1a1b0a6fb0ee88eefa7c1ecbc65444c0d258fc2 WatchSource:0}: Error finding container 54a411eea500189ec245a395d1a1b0a6fb0ee88eefa7c1ecbc65444c0d258fc2: Status 404 returned error can't find the container with id 54a411eea500189ec245a395d1a1b0a6fb0ee88eefa7c1ecbc65444c0d258fc2 Jun 10 19:54:40.704526 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:40.704498 2567 generic.go:356] "Generic (PLEG): container finished" podID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerID="3e525fb42e837b27a369bfecc701fac40794fad4ada13f2cf3ee486e04e3c174" exitCode=0 Jun 10 19:54:40.704930 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:40.704578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" event={"ID":"e28ab719-d7dd-47b7-b964-1dc5e675fff1","Type":"ContainerDied","Data":"3e525fb42e837b27a369bfecc701fac40794fad4ada13f2cf3ee486e04e3c174"} Jun 10 19:54:40.704930 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:40.704615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" event={"ID":"e28ab719-d7dd-47b7-b964-1dc5e675fff1","Type":"ContainerStarted","Data":"54a411eea500189ec245a395d1a1b0a6fb0ee88eefa7c1ecbc65444c0d258fc2"} Jun 10 19:54:41.712105 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:41.712068 2567 generic.go:356] "Generic (PLEG): container finished" podID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerID="c6088f3cf64d29dbda11877824e412bcd4c1ed0f5cba32aa5b7212c38954fd34" exitCode=0 Jun 10 19:54:41.712490 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:41.712147 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" event={"ID":"e28ab719-d7dd-47b7-b964-1dc5e675fff1","Type":"ContainerDied","Data":"c6088f3cf64d29dbda11877824e412bcd4c1ed0f5cba32aa5b7212c38954fd34"} Jun 10 19:54:42.718387 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:42.718348 2567 generic.go:356] "Generic (PLEG): container finished" podID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerID="ecdd6906e01d5e158a3f347c71d3de12185c10bb0cc27e3dec760dc2cf912c2b" exitCode=0 Jun 10 19:54:42.718782 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:42.718404 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" event={"ID":"e28ab719-d7dd-47b7-b964-1dc5e675fff1","Type":"ContainerDied","Data":"ecdd6906e01d5e158a3f347c71d3de12185c10bb0cc27e3dec760dc2cf912c2b"} Jun 10 19:54:43.848692 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:43.848663 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:44.003915 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.003830 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljmbm\" (UniqueName: \"kubernetes.io/projected/e28ab719-d7dd-47b7-b964-1dc5e675fff1-kube-api-access-ljmbm\") pod \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " Jun 10 19:54:44.004068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.003917 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-util\") pod \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " Jun 10 19:54:44.004068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.003997 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-bundle\") pod \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\" (UID: \"e28ab719-d7dd-47b7-b964-1dc5e675fff1\") " Jun 10 19:54:44.004915 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.004874 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-bundle" (OuterVolumeSpecName: "bundle") pod "e28ab719-d7dd-47b7-b964-1dc5e675fff1" (UID: "e28ab719-d7dd-47b7-b964-1dc5e675fff1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:54:44.006061 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.006031 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28ab719-d7dd-47b7-b964-1dc5e675fff1-kube-api-access-ljmbm" (OuterVolumeSpecName: "kube-api-access-ljmbm") pod "e28ab719-d7dd-47b7-b964-1dc5e675fff1" (UID: "e28ab719-d7dd-47b7-b964-1dc5e675fff1"). InnerVolumeSpecName "kube-api-access-ljmbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:54:44.009891 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.009870 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-util" (OuterVolumeSpecName: "util") pod "e28ab719-d7dd-47b7-b964-1dc5e675fff1" (UID: "e28ab719-d7dd-47b7-b964-1dc5e675fff1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:54:44.105559 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.105524 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:44.105559 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.105552 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljmbm\" (UniqueName: \"kubernetes.io/projected/e28ab719-d7dd-47b7-b964-1dc5e675fff1-kube-api-access-ljmbm\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:44.105559 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.105562 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e28ab719-d7dd-47b7-b964-1dc5e675fff1-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:54:44.729510 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.729471 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" event={"ID":"e28ab719-d7dd-47b7-b964-1dc5e675fff1","Type":"ContainerDied","Data":"54a411eea500189ec245a395d1a1b0a6fb0ee88eefa7c1ecbc65444c0d258fc2"} Jun 10 19:54:44.729510 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.729492 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb8x5p" Jun 10 19:54:44.729711 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:44.729523 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54a411eea500189ec245a395d1a1b0a6fb0ee88eefa7c1ecbc65444c0d258fc2" Jun 10 19:54:46.240018 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:46.239988 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/0.log" Jun 10 19:54:46.240984 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:46.240961 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/0.log" Jun 10 19:54:46.243641 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:46.243619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 19:54:46.245005 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:46.244979 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 19:54:46.248604 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:46.248584 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 19:54:46.249695 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:46.249679 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 19:54:46.255948 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:46.255933 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 19:54:54.911806 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.911773 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5"] Jun 10 19:54:54.951907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.912084 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerName="util" Jun 10 19:54:54.951907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.912097 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerName="util" Jun 10 19:54:54.951907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.912114 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerName="extract" Jun 10 19:54:54.951907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.912119 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerName="extract" Jun 10 19:54:54.951907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.912134 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerName="pull" Jun 10 19:54:54.951907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.912140 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerName="pull" Jun 10 19:54:54.951907 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.912190 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28ab719-d7dd-47b7-b964-1dc5e675fff1" containerName="extract" Jun 10 19:54:54.959336 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.959312 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5"] Jun 10 19:54:54.959428 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.959416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:54.963432 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.963406 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 19:54:54.963432 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.963427 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 19:54:54.963615 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.963427 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 19:54:54.963615 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.963499 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkprr\"" Jun 10 19:54:54.964162 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:54.964146 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 19:54:55.097239 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.097204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/613009f5-0197-4b9e-b20c-45b537a90233-manifests\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.097415 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.097286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/613009f5-0197-4b9e-b20c-45b537a90233-tmp\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.097415 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.097308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/613009f5-0197-4b9e-b20c-45b537a90233-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.097415 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.097325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m54fb\" (UniqueName: \"kubernetes.io/projected/613009f5-0197-4b9e-b20c-45b537a90233-kube-api-access-m54fb\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.097415 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.097347 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/613009f5-0197-4b9e-b20c-45b537a90233-webhook-cert\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.198653 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.198623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/613009f5-0197-4b9e-b20c-45b537a90233-tmp\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.198821 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.198666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/613009f5-0197-4b9e-b20c-45b537a90233-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.198821 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.198692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m54fb\" (UniqueName: \"kubernetes.io/projected/613009f5-0197-4b9e-b20c-45b537a90233-kube-api-access-m54fb\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.198821 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.198721 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/613009f5-0197-4b9e-b20c-45b537a90233-webhook-cert\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.198821 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.198789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/613009f5-0197-4b9e-b20c-45b537a90233-manifests\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.199155 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.199133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/613009f5-0197-4b9e-b20c-45b537a90233-manifests\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.200957 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.200926 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/613009f5-0197-4b9e-b20c-45b537a90233-tmp\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.201203 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.201183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/613009f5-0197-4b9e-b20c-45b537a90233-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.201299 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.201254 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/613009f5-0197-4b9e-b20c-45b537a90233-webhook-cert\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.209431 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.209406 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m54fb\" (UniqueName: \"kubernetes.io/projected/613009f5-0197-4b9e-b20c-45b537a90233-kube-api-access-m54fb\") pod \"opendatahub-operator-controller-manager-5448666b9-fl8g5\" (UID: \"613009f5-0197-4b9e-b20c-45b537a90233\") " pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.269786 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.269761 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:54:55.479649 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.479620 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5"] Jun 10 19:54:55.481041 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:54:55.481017 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613009f5_0197_4b9e_b20c_45b537a90233.slice/crio-2767bf79aeac924c7db21d52c3210de5aad3172f8b05b920ff9772fc26898db3 WatchSource:0}: Error finding container 2767bf79aeac924c7db21d52c3210de5aad3172f8b05b920ff9772fc26898db3: Status 404 returned error can't find the container with id 2767bf79aeac924c7db21d52c3210de5aad3172f8b05b920ff9772fc26898db3 Jun 10 19:54:55.482880 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.482866 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:54:55.780306 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:55.780212 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" event={"ID":"613009f5-0197-4b9e-b20c-45b537a90233","Type":"ContainerStarted","Data":"2767bf79aeac924c7db21d52c3210de5aad3172f8b05b920ff9772fc26898db3"} Jun 10 19:54:58.798490 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:58.798446 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" event={"ID":"613009f5-0197-4b9e-b20c-45b537a90233","Type":"ContainerStarted","Data":"e6dd8369d3988b80a45e82a7f2128d08d7d51b66008fa147ed0fa5e7018fcf00"} Jun 10 19:54:59.804140 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:59.804103 2567 generic.go:356] "Generic (PLEG): container finished" podID="613009f5-0197-4b9e-b20c-45b537a90233" containerID="e6dd8369d3988b80a45e82a7f2128d08d7d51b66008fa147ed0fa5e7018fcf00" exitCode=0 Jun 10 19:54:59.804572 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:54:59.804188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" event={"ID":"613009f5-0197-4b9e-b20c-45b537a90233","Type":"ContainerDied","Data":"e6dd8369d3988b80a45e82a7f2128d08d7d51b66008fa147ed0fa5e7018fcf00"} Jun 10 19:55:00.813728 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:00.813690 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" event={"ID":"613009f5-0197-4b9e-b20c-45b537a90233","Type":"ContainerStarted","Data":"562eb5260a1b9f8f1a2f0789c18e3d2bf7182463883db6b422a5ad609ab3d1e7"} Jun 10 19:55:00.814147 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:00.813821 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:55:00.869695 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:00.869645 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" podStartSLOduration=2.763312834 podStartE2EDuration="6.869628512s" totalImagesPullingTime="3.184006502s" totalInitContainerRuntime="922.309176ms" isStatefulPod=false podCreationTimestamp="2026-06-10 19:54:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:55:00.867259101 +0000 UTC m=+314.966652841" watchObservedRunningTime="2026-06-10 19:55:00.869628512 +0000 UTC m=+314.969022252" Jun 10 19:55:11.821044 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:11.821014 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5448666b9-fl8g5" Jun 10 19:55:13.437320 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.437283 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f"] Jun 10 19:55:13.442015 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.441995 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.446078 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.446057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 19:55:13.447021 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.447005 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 19:55:13.447096 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.447007 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vsrxb\"" Jun 10 19:55:13.447096 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.447046 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:55:13.448700 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.448432 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 19:55:13.448700 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.448546 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 19:55:13.469191 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.469169 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f"] Jun 10 19:55:13.558963 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.558933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/624d546b-3455-4521-b77d-63fb3012669d-manager-config\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.559115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.558978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/624d546b-3455-4521-b77d-63fb3012669d-metrics-cert\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.559115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.559072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/624d546b-3455-4521-b77d-63fb3012669d-cert\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.559115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.559103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2tp\" (UniqueName: \"kubernetes.io/projected/624d546b-3455-4521-b77d-63fb3012669d-kube-api-access-sg2tp\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.660240 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.660189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/624d546b-3455-4521-b77d-63fb3012669d-metrics-cert\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.660433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.660293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/624d546b-3455-4521-b77d-63fb3012669d-cert\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.660433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.660318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2tp\" (UniqueName: \"kubernetes.io/projected/624d546b-3455-4521-b77d-63fb3012669d-kube-api-access-sg2tp\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.660433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.660339 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/624d546b-3455-4521-b77d-63fb3012669d-manager-config\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.661018 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.660996 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/624d546b-3455-4521-b77d-63fb3012669d-manager-config\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.662764 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.662737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/624d546b-3455-4521-b77d-63fb3012669d-metrics-cert\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.662857 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.662773 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/624d546b-3455-4521-b77d-63fb3012669d-cert\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.670691 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.670671 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2tp\" (UniqueName: \"kubernetes.io/projected/624d546b-3455-4521-b77d-63fb3012669d-kube-api-access-sg2tp\") pod \"lws-controller-manager-7b55d8c87f-p5d5f\" (UID: \"624d546b-3455-4521-b77d-63fb3012669d\") " pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:13.750817 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:13.750786 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:14.002922 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:14.002842 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f"] Jun 10 19:55:14.044131 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:55:14.044103 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624d546b_3455_4521_b77d_63fb3012669d.slice/crio-5cc176283e5d0d0897dfa699d834e6bd533c79233e15701e2ec9d469034b6ad4 WatchSource:0}: Error finding container 5cc176283e5d0d0897dfa699d834e6bd533c79233e15701e2ec9d469034b6ad4: Status 404 returned error can't find the container with id 5cc176283e5d0d0897dfa699d834e6bd533c79233e15701e2ec9d469034b6ad4 Jun 10 19:55:14.881885 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:14.881843 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" event={"ID":"624d546b-3455-4521-b77d-63fb3012669d","Type":"ContainerStarted","Data":"5cc176283e5d0d0897dfa699d834e6bd533c79233e15701e2ec9d469034b6ad4"} Jun 10 19:55:14.941202 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:14.941164 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx"] Jun 10 19:55:14.944088 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:14.944063 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:14.955012 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:14.954985 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:55:14.994043 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:14.994017 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:55:14.994194 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:14.994179 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xnsxg\"" Jun 10 19:55:15.071752 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.071696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.071940 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.071827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.071940 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.071900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mjrc\" (UniqueName: \"kubernetes.io/projected/e23f3c51-8369-49ba-ae9c-bf5f222b624b-kube-api-access-7mjrc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.172618 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.172538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.172618 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.172601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.172842 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.172681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mjrc\" (UniqueName: \"kubernetes.io/projected/e23f3c51-8369-49ba-ae9c-bf5f222b624b-kube-api-access-7mjrc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.173026 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.173001 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.173112 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.173048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.227829 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.227794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx"] Jun 10 19:55:15.236154 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.236125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mjrc\" (UniqueName: \"kubernetes.io/projected/e23f3c51-8369-49ba-ae9c-bf5f222b624b-kube-api-access-7mjrc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.256952 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.256924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:15.582281 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.582245 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx"] Jun 10 19:55:15.586150 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:55:15.586107 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23f3c51_8369_49ba_ae9c_bf5f222b624b.slice/crio-9e50dd59993bcd978813f04eca089a27686a736cf8ec6944a1f2776d4dfb8e13 WatchSource:0}: Error finding container 9e50dd59993bcd978813f04eca089a27686a736cf8ec6944a1f2776d4dfb8e13: Status 404 returned error can't find the container with id 9e50dd59993bcd978813f04eca089a27686a736cf8ec6944a1f2776d4dfb8e13 Jun 10 19:55:15.888073 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.888041 2567 generic.go:356] "Generic (PLEG): container finished" podID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerID="634b14ec65c8df2388a97bb83e88f15ad068cb25d63c1ef17ed3dbc01652d16d" exitCode=0 Jun 10 19:55:15.888532 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.888136 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" event={"ID":"e23f3c51-8369-49ba-ae9c-bf5f222b624b","Type":"ContainerDied","Data":"634b14ec65c8df2388a97bb83e88f15ad068cb25d63c1ef17ed3dbc01652d16d"} Jun 10 19:55:15.888532 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.888198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" event={"ID":"e23f3c51-8369-49ba-ae9c-bf5f222b624b","Type":"ContainerStarted","Data":"9e50dd59993bcd978813f04eca089a27686a736cf8ec6944a1f2776d4dfb8e13"} Jun 10 19:55:15.889770 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.889730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" event={"ID":"624d546b-3455-4521-b77d-63fb3012669d","Type":"ContainerStarted","Data":"c2efc1baf13746d76ac897995e5ebe8453ed56aae412f0869c398363e2aa581a"} Jun 10 19:55:15.889865 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.889800 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:15.951871 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:15.951823 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" podStartSLOduration=1.541745903 podStartE2EDuration="2.951807488s" totalImagesPullingTime="1.410061585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:55:15.949601713 +0000 UTC m=+330.048995452" watchObservedRunningTime="2026-06-10 19:55:15.951807488 +0000 UTC m=+330.051201228" Jun 10 19:55:16.896363 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:16.896336 2567 generic.go:356] "Generic (PLEG): container finished" podID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerID="2b63444cabc01d48ac71330c63c60a6b6b8f3f9fb44a8e2e63b655c593ce9707" exitCode=0 Jun 10 19:55:16.896768 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:16.896414 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" event={"ID":"e23f3c51-8369-49ba-ae9c-bf5f222b624b","Type":"ContainerDied","Data":"2b63444cabc01d48ac71330c63c60a6b6b8f3f9fb44a8e2e63b655c593ce9707"} Jun 10 19:55:17.903358 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:17.903321 2567 generic.go:356] "Generic (PLEG): container finished" podID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerID="043389d42738c3b2d26a25310020e472d519fd2cdaca7bb90c888b315c653500" exitCode=0 Jun 10 19:55:17.903745 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:17.903407 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" event={"ID":"e23f3c51-8369-49ba-ae9c-bf5f222b624b","Type":"ContainerDied","Data":"043389d42738c3b2d26a25310020e472d519fd2cdaca7bb90c888b315c653500"} Jun 10 19:55:19.035089 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.035059 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:19.103908 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.103872 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mjrc\" (UniqueName: \"kubernetes.io/projected/e23f3c51-8369-49ba-ae9c-bf5f222b624b-kube-api-access-7mjrc\") pod \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " Jun 10 19:55:19.104062 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.103921 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-bundle\") pod \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " Jun 10 19:55:19.104062 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.103968 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-util\") pod \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\" (UID: \"e23f3c51-8369-49ba-ae9c-bf5f222b624b\") " Jun 10 19:55:19.104861 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.104826 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-bundle" (OuterVolumeSpecName: "bundle") pod "e23f3c51-8369-49ba-ae9c-bf5f222b624b" (UID: "e23f3c51-8369-49ba-ae9c-bf5f222b624b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:55:19.105983 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.105963 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23f3c51-8369-49ba-ae9c-bf5f222b624b-kube-api-access-7mjrc" (OuterVolumeSpecName: "kube-api-access-7mjrc") pod "e23f3c51-8369-49ba-ae9c-bf5f222b624b" (UID: "e23f3c51-8369-49ba-ae9c-bf5f222b624b"). InnerVolumeSpecName "kube-api-access-7mjrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:55:19.109541 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.109513 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-util" (OuterVolumeSpecName: "util") pod "e23f3c51-8369-49ba-ae9c-bf5f222b624b" (UID: "e23f3c51-8369-49ba-ae9c-bf5f222b624b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:55:19.204681 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.204648 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mjrc\" (UniqueName: \"kubernetes.io/projected/e23f3c51-8369-49ba-ae9c-bf5f222b624b-kube-api-access-7mjrc\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:55:19.204681 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.204681 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:55:19.204864 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.204691 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23f3c51-8369-49ba-ae9c-bf5f222b624b-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:55:19.914765 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.914731 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" event={"ID":"e23f3c51-8369-49ba-ae9c-bf5f222b624b","Type":"ContainerDied","Data":"9e50dd59993bcd978813f04eca089a27686a736cf8ec6944a1f2776d4dfb8e13"} Jun 10 19:55:19.914931 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.914777 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e50dd59993bcd978813f04eca089a27686a736cf8ec6944a1f2776d4dfb8e13" Jun 10 19:55:19.914931 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:19.914779 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fpjdx" Jun 10 19:55:26.898655 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:26.898618 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b55d8c87f-p5d5f" Jun 10 19:55:28.872357 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872322 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc"] Jun 10 19:55:28.872735 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872659 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerName="extract" Jun 10 19:55:28.872735 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872671 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerName="extract" Jun 10 19:55:28.872735 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872681 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerName="pull" Jun 10 19:55:28.872735 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872687 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerName="pull" Jun 10 19:55:28.872735 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872701 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerName="util" Jun 10 19:55:28.872735 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872706 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerName="util" Jun 10 19:55:28.872921 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.872765 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23f3c51-8369-49ba-ae9c-bf5f222b624b" containerName="extract" Jun 10 19:55:28.876901 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.876878 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:28.883882 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.883815 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:55:28.883996 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.883972 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:55:28.884616 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.884601 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xnsxg\"" Jun 10 19:55:28.905943 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.905920 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc"] Jun 10 19:55:28.996498 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.996457 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrct4\" (UniqueName: \"kubernetes.io/projected/0a905045-b5ba-4763-886d-6c7ac73bfdde-kube-api-access-qrct4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:28.996665 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.996528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:28.996665 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:28.996593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.097972 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.097942 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.098123 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.097984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrct4\" (UniqueName: \"kubernetes.io/projected/0a905045-b5ba-4763-886d-6c7ac73bfdde-kube-api-access-qrct4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.098123 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.098025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.098365 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.098344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.098458 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.098370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.119127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.119096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrct4\" (UniqueName: \"kubernetes.io/projected/0a905045-b5ba-4763-886d-6c7ac73bfdde-kube-api-access-qrct4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.186131 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.186067 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:29.326930 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.326903 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc"] Jun 10 19:55:29.328176 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:55:29.328144 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a905045_b5ba_4763_886d_6c7ac73bfdde.slice/crio-e6bf6dbc933d10362d4e58b83a02fbc4b68e127292a6403c53609b2c6f683640 WatchSource:0}: Error finding container e6bf6dbc933d10362d4e58b83a02fbc4b68e127292a6403c53609b2c6f683640: Status 404 returned error can't find the container with id e6bf6dbc933d10362d4e58b83a02fbc4b68e127292a6403c53609b2c6f683640 Jun 10 19:55:29.981412 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.981361 2567 generic.go:356] "Generic (PLEG): container finished" podID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerID="47cdf2fb15fcca72cf05d1d9ae663c0a1b1c6683af297fbf7841183dbd1a5313" exitCode=0 Jun 10 19:55:29.981897 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.981550 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" event={"ID":"0a905045-b5ba-4763-886d-6c7ac73bfdde","Type":"ContainerDied","Data":"47cdf2fb15fcca72cf05d1d9ae663c0a1b1c6683af297fbf7841183dbd1a5313"} Jun 10 19:55:29.981897 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:29.981631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" event={"ID":"0a905045-b5ba-4763-886d-6c7ac73bfdde","Type":"ContainerStarted","Data":"e6bf6dbc933d10362d4e58b83a02fbc4b68e127292a6403c53609b2c6f683640"} Jun 10 19:55:31.992863 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:31.992828 2567 generic.go:356] "Generic (PLEG): container finished" podID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerID="bf16150e1271007460dc010f305221ac6f618889a9afc1e6d6c674df5d23b703" exitCode=0 Jun 10 19:55:31.993348 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:31.992912 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" event={"ID":"0a905045-b5ba-4763-886d-6c7ac73bfdde","Type":"ContainerDied","Data":"bf16150e1271007460dc010f305221ac6f618889a9afc1e6d6c674df5d23b703"} Jun 10 19:55:33.000538 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:33.000506 2567 generic.go:356] "Generic (PLEG): container finished" podID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerID="3eed5c16aba36d5c097f71809f1d10102e4e36d85aa91be7378e88d1c6aaf868" exitCode=0 Jun 10 19:55:33.000904 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:33.000582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" event={"ID":"0a905045-b5ba-4763-886d-6c7ac73bfdde","Type":"ContainerDied","Data":"3eed5c16aba36d5c097f71809f1d10102e4e36d85aa91be7378e88d1c6aaf868"} Jun 10 19:55:34.144511 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.144478 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:34.242051 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.242019 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrct4\" (UniqueName: \"kubernetes.io/projected/0a905045-b5ba-4763-886d-6c7ac73bfdde-kube-api-access-qrct4\") pod \"0a905045-b5ba-4763-886d-6c7ac73bfdde\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " Jun 10 19:55:34.242214 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.242103 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-util\") pod \"0a905045-b5ba-4763-886d-6c7ac73bfdde\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " Jun 10 19:55:34.242214 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.242123 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-bundle\") pod \"0a905045-b5ba-4763-886d-6c7ac73bfdde\" (UID: \"0a905045-b5ba-4763-886d-6c7ac73bfdde\") " Jun 10 19:55:34.243003 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.242977 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-bundle" (OuterVolumeSpecName: "bundle") pod "0a905045-b5ba-4763-886d-6c7ac73bfdde" (UID: "0a905045-b5ba-4763-886d-6c7ac73bfdde"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:55:34.244151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.244126 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a905045-b5ba-4763-886d-6c7ac73bfdde-kube-api-access-qrct4" (OuterVolumeSpecName: "kube-api-access-qrct4") pod "0a905045-b5ba-4763-886d-6c7ac73bfdde" (UID: "0a905045-b5ba-4763-886d-6c7ac73bfdde"). InnerVolumeSpecName "kube-api-access-qrct4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:55:34.248182 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.248142 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-util" (OuterVolumeSpecName: "util") pod "0a905045-b5ba-4763-886d-6c7ac73bfdde" (UID: "0a905045-b5ba-4763-886d-6c7ac73bfdde"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:55:34.342821 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.342789 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrct4\" (UniqueName: \"kubernetes.io/projected/0a905045-b5ba-4763-886d-6c7ac73bfdde-kube-api-access-qrct4\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:55:34.342821 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.342816 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:55:34.342821 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:34.342826 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a905045-b5ba-4763-886d-6c7ac73bfdde-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:55:35.012419 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:35.012391 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" Jun 10 19:55:35.012419 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:35.012410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762am2xjc" event={"ID":"0a905045-b5ba-4763-886d-6c7ac73bfdde","Type":"ContainerDied","Data":"e6bf6dbc933d10362d4e58b83a02fbc4b68e127292a6403c53609b2c6f683640"} Jun 10 19:55:35.012636 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:35.012455 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6bf6dbc933d10362d4e58b83a02fbc4b68e127292a6403c53609b2c6f683640" Jun 10 19:55:45.234787 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.234755 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-64cb4df9fb-8w5gt"] Jun 10 19:55:45.235176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.235109 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerName="util" Jun 10 19:55:45.235176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.235119 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerName="util" Jun 10 19:55:45.235176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.235131 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerName="extract" Jun 10 19:55:45.235176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.235137 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerName="extract" Jun 10 19:55:45.235176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.235148 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerName="pull" Jun 10 19:55:45.235176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.235153 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerName="pull" Jun 10 19:55:45.235386 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.235205 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a905045-b5ba-4763-886d-6c7ac73bfdde" containerName="extract" Jun 10 19:55:45.237437 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.237418 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.239905 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.239887 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n7csp\"" Jun 10 19:55:45.240414 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.240398 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 19:55:45.262466 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.262443 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64cb4df9fb-8w5gt"] Jun 10 19:55:45.340348 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.340318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f-redirect-config\") pod \"dashboard-redirect-64cb4df9fb-8w5gt\" (UID: \"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f\") " pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.340482 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.340433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dm5r\" (UniqueName: \"kubernetes.io/projected/e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f-kube-api-access-2dm5r\") pod \"dashboard-redirect-64cb4df9fb-8w5gt\" (UID: \"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f\") " pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.441104 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.441070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dm5r\" (UniqueName: \"kubernetes.io/projected/e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f-kube-api-access-2dm5r\") pod \"dashboard-redirect-64cb4df9fb-8w5gt\" (UID: \"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f\") " pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.441273 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.441118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f-redirect-config\") pod \"dashboard-redirect-64cb4df9fb-8w5gt\" (UID: \"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f\") " pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.441799 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.441780 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f-redirect-config\") pod \"dashboard-redirect-64cb4df9fb-8w5gt\" (UID: \"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f\") " pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.449579 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.449556 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dm5r\" (UniqueName: \"kubernetes.io/projected/e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f-kube-api-access-2dm5r\") pod \"dashboard-redirect-64cb4df9fb-8w5gt\" (UID: \"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f\") " pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.547697 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.547613 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" Jun 10 19:55:45.682808 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:45.682641 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64cb4df9fb-8w5gt"] Jun 10 19:55:45.685602 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:55:45.685573 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1da5f5c_83aa_41f2_8e0e_ca74151e8a0f.slice/crio-649858108e24953b52d241a8e42abbd8b5b562e8122353f5d80606cc01008a9b WatchSource:0}: Error finding container 649858108e24953b52d241a8e42abbd8b5b562e8122353f5d80606cc01008a9b: Status 404 returned error can't find the container with id 649858108e24953b52d241a8e42abbd8b5b562e8122353f5d80606cc01008a9b Jun 10 19:55:46.069940 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:46.069899 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" event={"ID":"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f","Type":"ContainerStarted","Data":"649858108e24953b52d241a8e42abbd8b5b562e8122353f5d80606cc01008a9b"} Jun 10 19:55:51.101167 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:51.101133 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" event={"ID":"e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f","Type":"ContainerStarted","Data":"a9bd61c16171e9eba829b48b5424a2262d12811209c9a6ea558ac31c8cfdfe32"} Jun 10 19:55:51.119402 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:55:51.119350 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-64cb4df9fb-8w5gt" podStartSLOduration=1.6779126180000001 podStartE2EDuration="6.119332076s" totalImagesPullingTime="4.441419458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:55:51.116992381 +0000 UTC m=+365.216386126" watchObservedRunningTime="2026-06-10 19:55:51.119332076 +0000 UTC m=+365.218725817" Jun 10 19:56:04.743478 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.743448 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg"] Jun 10 19:56:04.747187 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.747168 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.750068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.750043 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 19:56:04.750068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.750043 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-79kqw\"" Jun 10 19:56:04.759136 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.759116 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg"] Jun 10 19:56:04.807188 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59ece26a-2cf0-4214-8348-4bfcddcadca2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807343 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807195 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807343 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807218 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwzvq\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-kube-api-access-qwzvq\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807343 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807518 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807518 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807518 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807518 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807505 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.807702 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.807588 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908400 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908400 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59ece26a-2cf0-4214-8348-4bfcddcadca2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908631 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwzvq\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-kube-api-access-qwzvq\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.908824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.909062 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.908988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.909062 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.909033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.909247 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.909199 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.909415 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.909388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59ece26a-2cf0-4214-8348-4bfcddcadca2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.910862 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.910838 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.910959 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.910935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.916597 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.916574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:04.917204 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:04.917183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwzvq\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-kube-api-access-qwzvq\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:05.015402 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.015337 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx"] Jun 10 19:56:05.020045 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.020027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.029795 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.029773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx"] Jun 10 19:56:05.058183 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.058143 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:05.111303 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdnvv\" (UniqueName: \"kubernetes.io/projected/dfe65433-0fff-4f0c-8d18-f31d285ee59c-kube-api-access-cdnvv\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111449 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111631 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111466 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111631 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111631 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111631 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.111631 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.111608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.191306 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.191276 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg"] Jun 10 19:56:05.194769 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:05.194732 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ece26a_2cf0_4214_8348_4bfcddcadca2.slice/crio-8e8fa01218ea01b1c352b92f783dc74ea31aa4f3cd078f8ed621e7eef3834b18 WatchSource:0}: Error finding container 8e8fa01218ea01b1c352b92f783dc74ea31aa4f3cd078f8ed621e7eef3834b18: Status 404 returned error can't find the container with id 8e8fa01218ea01b1c352b92f783dc74ea31aa4f3cd078f8ed621e7eef3834b18 Jun 10 19:56:05.212881 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.212852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.212992 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.212902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.212992 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.212931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.212992 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.212969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213139 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.212999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213139 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213139 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213139 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213310 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdnvv\" (UniqueName: \"kubernetes.io/projected/dfe65433-0fff-4f0c-8d18-f31d285ee59c-kube-api-access-cdnvv\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213444 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213424 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213667 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213645 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213741 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213741 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213723 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.213824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.213797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.215403 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.215370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.215539 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.215522 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.221846 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.221822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe65433-0fff-4f0c-8d18-f31d285ee59c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.222000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.221982 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdnvv\" (UniqueName: \"kubernetes.io/projected/dfe65433-0fff-4f0c-8d18-f31d285ee59c-kube-api-access-cdnvv\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hcwbx\" (UID: \"dfe65433-0fff-4f0c-8d18-f31d285ee59c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.331026 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.330949 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:05.476751 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:05.476727 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx"] Jun 10 19:56:05.478060 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:05.478031 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe65433_0fff_4f0c_8d18_f31d285ee59c.slice/crio-ea6c9485dd2220a2be8be7213b6ada3cba790f63462dad3cbecffeba8b681168 WatchSource:0}: Error finding container ea6c9485dd2220a2be8be7213b6ada3cba790f63462dad3cbecffeba8b681168: Status 404 returned error can't find the container with id ea6c9485dd2220a2be8be7213b6ada3cba790f63462dad3cbecffeba8b681168 Jun 10 19:56:06.179014 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:06.178978 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" event={"ID":"59ece26a-2cf0-4214-8348-4bfcddcadca2","Type":"ContainerStarted","Data":"8e8fa01218ea01b1c352b92f783dc74ea31aa4f3cd078f8ed621e7eef3834b18"} Jun 10 19:56:06.180807 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:06.180775 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" event={"ID":"dfe65433-0fff-4f0c-8d18-f31d285ee59c","Type":"ContainerStarted","Data":"ea6c9485dd2220a2be8be7213b6ada3cba790f63462dad3cbecffeba8b681168"} Jun 10 19:56:08.265424 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:08.265373 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:56:08.265742 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:08.265476 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:56:08.265742 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:08.265515 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:56:08.271531 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:08.271454 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:56:08.271531 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:08.271518 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:56:08.271674 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:08.271547 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:56:09.204968 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:09.204926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" event={"ID":"dfe65433-0fff-4f0c-8d18-f31d285ee59c","Type":"ContainerStarted","Data":"95a4818a3a9176909e318a587fb2377cf0978628e9dda0c20f776128bf5d6f3b"} Jun 10 19:56:09.206426 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:09.206404 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" event={"ID":"59ece26a-2cf0-4214-8348-4bfcddcadca2","Type":"ContainerStarted","Data":"9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89"} Jun 10 19:56:09.229765 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:09.229719 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" podStartSLOduration=2.438608901 podStartE2EDuration="5.229706455s" totalImagesPullingTime="2.791097554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:56:09.228396621 +0000 UTC m=+383.327790355" watchObservedRunningTime="2026-06-10 19:56:09.229706455 +0000 UTC m=+383.329100194" Jun 10 19:56:09.248157 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:09.248108 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" podStartSLOduration=2.179896734 podStartE2EDuration="5.248094486s" totalImagesPullingTime="3.068197752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:56:09.247129685 +0000 UTC m=+383.346523433" watchObservedRunningTime="2026-06-10 19:56:09.248094486 +0000 UTC m=+383.347488226" Jun 10 19:56:09.331257 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:09.331212 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:09.335508 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:09.335485 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:10.058765 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:10.058735 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:10.060327 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:10.060297 2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jun 10 19:56:10.060464 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:10.060344 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jun 10 19:56:10.211987 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:10.211960 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:10.212914 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:10.212896 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hcwbx" Jun 10 19:56:10.263788 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:10.263759 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg"] Jun 10 19:56:11.058790 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:11.058750 2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jun 10 19:56:11.059176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:11.058823 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jun 10 19:56:12.059203 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:12.059169 2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jun 10 19:56:12.059592 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:12.059245 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jun 10 19:56:12.222749 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:12.222706 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerName="istio-proxy" containerID="cri-o://9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89" gracePeriod=30 Jun 10 19:56:15.644301 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.644267 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-59xg8"] Jun 10 19:56:15.647814 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.647799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" Jun 10 19:56:15.650416 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.650399 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 19:56:15.651208 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.651190 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 19:56:15.651322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.651197 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6h78r\"" Jun 10 19:56:15.660254 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.660215 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-59xg8"] Jun 10 19:56:15.810711 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.810676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/3475303b-5f1a-4a4d-89ab-8f56f02551e3-kube-api-access-q8bth\") pod \"kuadrant-operator-catalog-59xg8\" (UID: \"3475303b-5f1a-4a4d-89ab-8f56f02551e3\") " pod="kuadrant-system/kuadrant-operator-catalog-59xg8" Jun 10 19:56:15.911758 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.911673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/3475303b-5f1a-4a4d-89ab-8f56f02551e3-kube-api-access-q8bth\") pod \"kuadrant-operator-catalog-59xg8\" (UID: \"3475303b-5f1a-4a4d-89ab-8f56f02551e3\") " pod="kuadrant-system/kuadrant-operator-catalog-59xg8" Jun 10 19:56:15.919406 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.919383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/3475303b-5f1a-4a4d-89ab-8f56f02551e3-kube-api-access-q8bth\") pod \"kuadrant-operator-catalog-59xg8\" (UID: \"3475303b-5f1a-4a4d-89ab-8f56f02551e3\") " pod="kuadrant-system/kuadrant-operator-catalog-59xg8" Jun 10 19:56:15.959068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:15.959045 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" Jun 10 19:56:16.089719 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.089687 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-59xg8"] Jun 10 19:56:16.091759 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:16.091733 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3475303b_5f1a_4a4d_89ab_8f56f02551e3.slice/crio-706f06a15f8bd0fd4ed2fa96516392258837115c40a2d30ad4cdabbed5b26baa WatchSource:0}: Error finding container 706f06a15f8bd0fd4ed2fa96516392258837115c40a2d30ad4cdabbed5b26baa: Status 404 returned error can't find the container with id 706f06a15f8bd0fd4ed2fa96516392258837115c40a2d30ad4cdabbed5b26baa Jun 10 19:56:16.232790 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.232754 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-59xg8"] Jun 10 19:56:16.243285 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.243255 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" event={"ID":"3475303b-5f1a-4a4d-89ab-8f56f02551e3","Type":"ContainerStarted","Data":"706f06a15f8bd0fd4ed2fa96516392258837115c40a2d30ad4cdabbed5b26baa"} Jun 10 19:56:16.249362 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.249340 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rdvc2"] Jun 10 19:56:16.253981 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.253967 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:16.259697 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.259678 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rdvc2"] Jun 10 19:56:16.415702 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.415661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctzv5\" (UniqueName: \"kubernetes.io/projected/f659082d-f7ee-464e-b4a8-33e7dc41f9c1-kube-api-access-ctzv5\") pod \"kuadrant-operator-catalog-rdvc2\" (UID: \"f659082d-f7ee-464e-b4a8-33e7dc41f9c1\") " pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:16.517138 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.517053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzv5\" (UniqueName: \"kubernetes.io/projected/f659082d-f7ee-464e-b4a8-33e7dc41f9c1-kube-api-access-ctzv5\") pod \"kuadrant-operator-catalog-rdvc2\" (UID: \"f659082d-f7ee-464e-b4a8-33e7dc41f9c1\") " pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:16.525967 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.525939 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctzv5\" (UniqueName: \"kubernetes.io/projected/f659082d-f7ee-464e-b4a8-33e7dc41f9c1-kube-api-access-ctzv5\") pod \"kuadrant-operator-catalog-rdvc2\" (UID: \"f659082d-f7ee-464e-b4a8-33e7dc41f9c1\") " pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:16.566002 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.565978 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:16.710763 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:16.710724 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rdvc2"] Jun 10 19:56:16.750520 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:16.750486 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf659082d_f7ee_464e_b4a8_33e7dc41f9c1.slice/crio-b04638b8860af8e7561bb8829c038541a70abe21452b0ea45e8696f324d8f203 WatchSource:0}: Error finding container b04638b8860af8e7561bb8829c038541a70abe21452b0ea45e8696f324d8f203: Status 404 returned error can't find the container with id b04638b8860af8e7561bb8829c038541a70abe21452b0ea45e8696f324d8f203 Jun 10 19:56:17.253411 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.253374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" event={"ID":"f659082d-f7ee-464e-b4a8-33e7dc41f9c1","Type":"ContainerStarted","Data":"b04638b8860af8e7561bb8829c038541a70abe21452b0ea45e8696f324d8f203"} Jun 10 19:56:17.271280 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:56:17.271218 2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ece26a_2cf0_4214_8348_4bfcddcadca2.slice/crio-conmon-9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ece26a_2cf0_4214_8348_4bfcddcadca2.slice/crio-9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89.scope\": RecentStats: unable to find data in memory cache]" Jun 10 19:56:17.579869 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.579839 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:17.729395 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729363 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-token\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729417 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-certs\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729453 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-data\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729484 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwzvq\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-kube-api-access-qwzvq\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729518 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-socket\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729791 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-envoy\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729798 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729805 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-data" (OuterVolumeSpecName: "istio-data") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:17.729845 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729822 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:17.730264 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729836 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59ece26a-2cf0-4214-8348-4bfcddcadca2-istiod-ca-cert\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.730264 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729903 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-credential-socket\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.730264 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.729938 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-podinfo\") pod \"59ece26a-2cf0-4214-8348-4bfcddcadca2\" (UID: \"59ece26a-2cf0-4214-8348-4bfcddcadca2\") " Jun 10 19:56:17.730264 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.730120 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ece26a-2cf0-4214-8348-4bfcddcadca2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:56:17.730264 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.730211 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:17.730652 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.730586 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59ece26a-2cf0-4214-8348-4bfcddcadca2-istiod-ca-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.730652 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.730611 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-credential-socket\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.730652 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.730621 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-certs\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.730652 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.730629 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-data\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.730652 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.730637 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-workload-socket\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.732302 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.732261 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-kube-api-access-qwzvq" (OuterVolumeSpecName: "kube-api-access-qwzvq") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "kube-api-access-qwzvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:56:17.732436 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.732409 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:17.732758 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.732731 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-token" (OuterVolumeSpecName: "istio-token") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:56:17.733331 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.733266 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59ece26a-2cf0-4214-8348-4bfcddcadca2" (UID: "59ece26a-2cf0-4214-8348-4bfcddcadca2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 19:56:17.831975 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.831905 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-token\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.831975 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.831933 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwzvq\" (UniqueName: \"kubernetes.io/projected/59ece26a-2cf0-4214-8348-4bfcddcadca2-kube-api-access-qwzvq\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.831975 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.831943 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-envoy\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:17.831975 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:17.831952 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59ece26a-2cf0-4214-8348-4bfcddcadca2-istio-podinfo\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:18.260322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.260289 2567 generic.go:356] "Generic (PLEG): container finished" podID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerID="9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89" exitCode=0 Jun 10 19:56:18.260550 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.260336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" event={"ID":"59ece26a-2cf0-4214-8348-4bfcddcadca2","Type":"ContainerDied","Data":"9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89"} Jun 10 19:56:18.260550 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.260351 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" Jun 10 19:56:18.260550 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.260392 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg" event={"ID":"59ece26a-2cf0-4214-8348-4bfcddcadca2","Type":"ContainerDied","Data":"8e8fa01218ea01b1c352b92f783dc74ea31aa4f3cd078f8ed621e7eef3834b18"} Jun 10 19:56:18.260550 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.260421 2567 scope.go:117] "RemoveContainer" containerID="9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89" Jun 10 19:56:18.276500 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.276470 2567 scope.go:117] "RemoveContainer" containerID="9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89" Jun 10 19:56:18.276773 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:56:18.276753 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89\": container with ID starting with 9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89 not found: ID does not exist" containerID="9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89" Jun 10 19:56:18.276854 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.276780 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89"} err="failed to get container status \"9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89\": rpc error: code = NotFound desc = could not find container \"9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89\": container with ID starting with 9be9577822f9c70dc7dee8bde20cfeb953da0729d47ca71fc8cc173935f77c89 not found: ID does not exist" Jun 10 19:56:18.286022 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.285999 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg"] Jun 10 19:56:18.291433 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.291409 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6frvzzg"] Jun 10 19:56:18.306249 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:18.306208 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" path="/var/lib/kubelet/pods/59ece26a-2cf0-4214-8348-4bfcddcadca2/volumes" Jun 10 19:56:19.267186 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.267144 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" event={"ID":"f659082d-f7ee-464e-b4a8-33e7dc41f9c1","Type":"ContainerStarted","Data":"64ef3d70b86b790be2f20648a5a03d16ffa094143aab2b518445e8e8cdf5a86f"} Jun 10 19:56:19.269056 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.269021 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" podUID="3475303b-5f1a-4a4d-89ab-8f56f02551e3" containerName="registry-server" containerID="cri-o://05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179" gracePeriod=2 Jun 10 19:56:19.269204 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.269024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" event={"ID":"3475303b-5f1a-4a4d-89ab-8f56f02551e3","Type":"ContainerStarted","Data":"05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179"} Jun 10 19:56:19.283079 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.283032 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" podStartSLOduration=1.757978058 podStartE2EDuration="3.283016092s" totalImagesPullingTime="1.525038034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:56:19.280784375 +0000 UTC m=+393.380178116" watchObservedRunningTime="2026-06-10 19:56:19.283016092 +0000 UTC m=+393.382409811" Jun 10 19:56:19.297326 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.297281 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" podStartSLOduration=2.113133564 podStartE2EDuration="4.297267048s" totalImagesPullingTime="2.184133484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:56:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:56:19.295484657 +0000 UTC m=+393.394878397" watchObservedRunningTime="2026-06-10 19:56:19.297267048 +0000 UTC m=+393.396660787" Jun 10 19:56:19.523724 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.523661 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" Jun 10 19:56:19.649730 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.649703 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/3475303b-5f1a-4a4d-89ab-8f56f02551e3-kube-api-access-q8bth\") pod \"3475303b-5f1a-4a4d-89ab-8f56f02551e3\" (UID: \"3475303b-5f1a-4a4d-89ab-8f56f02551e3\") " Jun 10 19:56:19.651954 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.651928 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3475303b-5f1a-4a4d-89ab-8f56f02551e3-kube-api-access-q8bth" (OuterVolumeSpecName: "kube-api-access-q8bth") pod "3475303b-5f1a-4a4d-89ab-8f56f02551e3" (UID: "3475303b-5f1a-4a4d-89ab-8f56f02551e3"). InnerVolumeSpecName "kube-api-access-q8bth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:56:19.750825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:19.750790 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/3475303b-5f1a-4a4d-89ab-8f56f02551e3-kube-api-access-q8bth\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:20.277110 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.277078 2567 generic.go:356] "Generic (PLEG): container finished" podID="3475303b-5f1a-4a4d-89ab-8f56f02551e3" containerID="05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179" exitCode=0 Jun 10 19:56:20.277562 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.277123 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" Jun 10 19:56:20.277562 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.277159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" event={"ID":"3475303b-5f1a-4a4d-89ab-8f56f02551e3","Type":"ContainerDied","Data":"05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179"} Jun 10 19:56:20.277562 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.277207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-59xg8" event={"ID":"3475303b-5f1a-4a4d-89ab-8f56f02551e3","Type":"ContainerDied","Data":"706f06a15f8bd0fd4ed2fa96516392258837115c40a2d30ad4cdabbed5b26baa"} Jun 10 19:56:20.277562 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.277249 2567 scope.go:117] "RemoveContainer" containerID="05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179" Jun 10 19:56:20.286969 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.286947 2567 scope.go:117] "RemoveContainer" containerID="05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179" Jun 10 19:56:20.287215 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:56:20.287196 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179\": container with ID starting with 05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179 not found: ID does not exist" containerID="05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179" Jun 10 19:56:20.287315 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.287242 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179"} err="failed to get container status \"05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179\": rpc error: code = NotFound desc = could not find container \"05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179\": container with ID starting with 05b2f2f08b7f840ac0e69c6c66c0bad816d5ac318951728d4916f52833a11179 not found: ID does not exist" Jun 10 19:56:20.298516 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.298497 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-59xg8"] Jun 10 19:56:20.305538 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:20.305518 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-59xg8"] Jun 10 19:56:22.308252 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:22.306088 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3475303b-5f1a-4a4d-89ab-8f56f02551e3" path="/var/lib/kubelet/pods/3475303b-5f1a-4a4d-89ab-8f56f02551e3/volumes" Jun 10 19:56:26.566488 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:26.566451 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:26.566890 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:26.566524 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:26.588729 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:26.588703 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:27.334983 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:27.334957 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rdvc2" Jun 10 19:56:31.215991 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.215954 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp"] Jun 10 19:56:31.216556 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.216536 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3475303b-5f1a-4a4d-89ab-8f56f02551e3" containerName="registry-server" Jun 10 19:56:31.216639 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.216559 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3475303b-5f1a-4a4d-89ab-8f56f02551e3" containerName="registry-server" Jun 10 19:56:31.216639 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.216580 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerName="istio-proxy" Jun 10 19:56:31.216639 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.216588 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerName="istio-proxy" Jun 10 19:56:31.216795 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.216687 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="59ece26a-2cf0-4214-8348-4bfcddcadca2" containerName="istio-proxy" Jun 10 19:56:31.216795 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.216701 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3475303b-5f1a-4a4d-89ab-8f56f02551e3" containerName="registry-server" Jun 10 19:56:31.232272 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.232245 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp"] Jun 10 19:56:31.232429 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.232355 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.235003 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.234983 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ntgfx\"" Jun 10 19:56:31.249756 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.249722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.249892 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.249804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.249892 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.249831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qg56\" (UniqueName: \"kubernetes.io/projected/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-kube-api-access-7qg56\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.350326 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.350290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.350326 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.350322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qg56\" (UniqueName: \"kubernetes.io/projected/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-kube-api-access-7qg56\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.350522 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.350418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.350680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.350660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.350755 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.350736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.359911 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.359883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qg56\" (UniqueName: \"kubernetes.io/projected/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-kube-api-access-7qg56\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.544169 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.544085 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:31.633655 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.633624 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l"] Jun 10 19:56:31.639427 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.639402 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.646471 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.646407 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l"] Jun 10 19:56:31.653266 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.653217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.653372 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.653318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.653428 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.653383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl974\" (UniqueName: \"kubernetes.io/projected/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-kube-api-access-rl974\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.684736 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.684711 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp"] Jun 10 19:56:31.686209 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:31.686184 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9b1c5c_f0e2_449e_9758_1f57eefd2c07.slice/crio-53d53caf593083628ba8402d1f3926af5ef6ff7782ef6ae0ad358c94de3be973 WatchSource:0}: Error finding container 53d53caf593083628ba8402d1f3926af5ef6ff7782ef6ae0ad358c94de3be973: Status 404 returned error can't find the container with id 53d53caf593083628ba8402d1f3926af5ef6ff7782ef6ae0ad358c94de3be973 Jun 10 19:56:31.753795 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.753764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.753933 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.753818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl974\" (UniqueName: \"kubernetes.io/projected/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-kube-api-access-rl974\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.753933 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.753881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.754180 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.754160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.754261 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.754203 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.763234 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.763202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl974\" (UniqueName: \"kubernetes.io/projected/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-kube-api-access-rl974\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:31.952612 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:31.952579 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:32.024506 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.024470 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx"] Jun 10 19:56:32.029959 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.029938 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.044512 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.043550 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx"] Jun 10 19:56:32.056445 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.056415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.056596 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.056526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59r2p\" (UniqueName: \"kubernetes.io/projected/7d41cda5-903d-4019-9348-c31c37b85bc9-kube-api-access-59r2p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.056596 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.056560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.120487 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.120455 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l"] Jun 10 19:56:32.122712 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:32.122688 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a4b635_1eaa_48d9_ac95_ab0e00eed28e.slice/crio-d7dd7774cc7dfb09df87b33c7a35ba758da8119da2560930d2cb0c34f6f20369 WatchSource:0}: Error finding container d7dd7774cc7dfb09df87b33c7a35ba758da8119da2560930d2cb0c34f6f20369: Status 404 returned error can't find the container with id d7dd7774cc7dfb09df87b33c7a35ba758da8119da2560930d2cb0c34f6f20369 Jun 10 19:56:32.156998 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.156972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.157113 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.157021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59r2p\" (UniqueName: \"kubernetes.io/projected/7d41cda5-903d-4019-9348-c31c37b85bc9-kube-api-access-59r2p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.157113 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.157043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.157320 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.157300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.157397 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.157373 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.167688 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.167665 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59r2p\" (UniqueName: \"kubernetes.io/projected/7d41cda5-903d-4019-9348-c31c37b85bc9-kube-api-access-59r2p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.338663 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.338622 2567 generic.go:356] "Generic (PLEG): container finished" podID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerID="791818ec872a537f336fcb0a6c43a9d214bc5ca3bb35b746362de56116e6ce7c" exitCode=0 Jun 10 19:56:32.339050 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.338704 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" event={"ID":"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e","Type":"ContainerDied","Data":"791818ec872a537f336fcb0a6c43a9d214bc5ca3bb35b746362de56116e6ce7c"} Jun 10 19:56:32.339050 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.338758 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" event={"ID":"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e","Type":"ContainerStarted","Data":"d7dd7774cc7dfb09df87b33c7a35ba758da8119da2560930d2cb0c34f6f20369"} Jun 10 19:56:32.340301 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.340279 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerID="333b82e459d06e9af8c54f23e053ea1e8201fcfb43d2a6759680a0bb5ba8887b" exitCode=0 Jun 10 19:56:32.340395 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.340326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" event={"ID":"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07","Type":"ContainerDied","Data":"333b82e459d06e9af8c54f23e053ea1e8201fcfb43d2a6759680a0bb5ba8887b"} Jun 10 19:56:32.340395 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.340358 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" event={"ID":"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07","Type":"ContainerStarted","Data":"53d53caf593083628ba8402d1f3926af5ef6ff7782ef6ae0ad358c94de3be973"} Jun 10 19:56:32.341154 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.341075 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:32.483824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.478433 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq"] Jun 10 19:56:32.485099 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.485071 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.493114 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.493087 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq"] Jun 10 19:56:32.538078 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.538017 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx"] Jun 10 19:56:32.540324 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:32.540286 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d41cda5_903d_4019_9348_c31c37b85bc9.slice/crio-9c9ecc0c7cc9d921c70a2a695b27dbdd9878874f2ce84fe2451a8818701822dc WatchSource:0}: Error finding container 9c9ecc0c7cc9d921c70a2a695b27dbdd9878874f2ce84fe2451a8818701822dc: Status 404 returned error can't find the container with id 9c9ecc0c7cc9d921c70a2a695b27dbdd9878874f2ce84fe2451a8818701822dc Jun 10 19:56:32.560496 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.560465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.560633 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.560543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.560633 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.560571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxsn9\" (UniqueName: \"kubernetes.io/projected/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-kube-api-access-qxsn9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.661282 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.661254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.661379 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.661299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxsn9\" (UniqueName: \"kubernetes.io/projected/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-kube-api-access-qxsn9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.661379 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.661345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.661616 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.661598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.661656 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.661615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.674242 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.674204 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxsn9\" (UniqueName: \"kubernetes.io/projected/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-kube-api-access-qxsn9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.797748 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.797671 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:32.941134 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:32.941109 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq"] Jun 10 19:56:32.949666 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:32.949636 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d84c66_3dfc_4f7c_9884_15bcc2bc62bc.slice/crio-8a868c2cb74a9d4bd17aa82799ba5e8663b9cb6421ce0775ba24aa16d5822dce WatchSource:0}: Error finding container 8a868c2cb74a9d4bd17aa82799ba5e8663b9cb6421ce0775ba24aa16d5822dce: Status 404 returned error can't find the container with id 8a868c2cb74a9d4bd17aa82799ba5e8663b9cb6421ce0775ba24aa16d5822dce Jun 10 19:56:33.348348 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.348318 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerID="7d0456a07f96175c654f5658bedc8c6a5f99598528dc7b2980ba80cee6b243ed" exitCode=0 Jun 10 19:56:33.348732 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.348401 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" event={"ID":"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07","Type":"ContainerDied","Data":"7d0456a07f96175c654f5658bedc8c6a5f99598528dc7b2980ba80cee6b243ed"} Jun 10 19:56:33.350090 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.350068 2567 generic.go:356] "Generic (PLEG): container finished" podID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerID="333c3767bba2382a6c0b6e0318e9e7fb7116b195f1df1f653f7d17fd94295d9b" exitCode=0 Jun 10 19:56:33.350174 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.350142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" event={"ID":"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc","Type":"ContainerDied","Data":"333c3767bba2382a6c0b6e0318e9e7fb7116b195f1df1f653f7d17fd94295d9b"} Jun 10 19:56:33.350264 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.350176 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" event={"ID":"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc","Type":"ContainerStarted","Data":"8a868c2cb74a9d4bd17aa82799ba5e8663b9cb6421ce0775ba24aa16d5822dce"} Jun 10 19:56:33.351892 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.351873 2567 generic.go:356] "Generic (PLEG): container finished" podID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerID="bafb94a4ffdecff5da62c58dd05bf404cbcb8972e23ca668a831265df0a8220e" exitCode=0 Jun 10 19:56:33.351996 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.351919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" event={"ID":"7d41cda5-903d-4019-9348-c31c37b85bc9","Type":"ContainerDied","Data":"bafb94a4ffdecff5da62c58dd05bf404cbcb8972e23ca668a831265df0a8220e"} Jun 10 19:56:33.351996 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:33.351954 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" event={"ID":"7d41cda5-903d-4019-9348-c31c37b85bc9","Type":"ContainerStarted","Data":"9c9ecc0c7cc9d921c70a2a695b27dbdd9878874f2ce84fe2451a8818701822dc"} Jun 10 19:56:34.360492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:34.360457 2567 generic.go:356] "Generic (PLEG): container finished" podID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerID="fd471bf6a98b06db142383e8b12d72de2e01f5fccd426be9941a97df4c3b00ef" exitCode=0 Jun 10 19:56:34.360859 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:34.360540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" event={"ID":"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e","Type":"ContainerDied","Data":"fd471bf6a98b06db142383e8b12d72de2e01f5fccd426be9941a97df4c3b00ef"} Jun 10 19:56:34.363392 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:34.363370 2567 generic.go:356] "Generic (PLEG): container finished" podID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerID="4d556f54a04d1acf446aac68d6eea9426b58808db99d9bce543256559e44e26c" exitCode=0 Jun 10 19:56:34.363506 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:34.363448 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" event={"ID":"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc","Type":"ContainerDied","Data":"4d556f54a04d1acf446aac68d6eea9426b58808db99d9bce543256559e44e26c"} Jun 10 19:56:34.365586 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:34.365566 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" event={"ID":"7d41cda5-903d-4019-9348-c31c37b85bc9","Type":"ContainerStarted","Data":"19089feaff6e82cdb1dbb548af5826ba1f676714de63c7b79b4749e3ef97e5fa"} Jun 10 19:56:34.368009 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:34.367985 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerID="f03a4fd41180d0e14c228ab7f8130215fce0d04afb3803587be80883867d8125" exitCode=0 Jun 10 19:56:34.368108 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:34.368066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" event={"ID":"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07","Type":"ContainerDied","Data":"f03a4fd41180d0e14c228ab7f8130215fce0d04afb3803587be80883867d8125"} Jun 10 19:56:35.375824 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.375794 2567 generic.go:356] "Generic (PLEG): container finished" podID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerID="39412dd6873fb860c67d1bda67ab4ecf088528977bfb69a2b3c76cdca7f746fb" exitCode=0 Jun 10 19:56:35.376285 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.375864 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" event={"ID":"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e","Type":"ContainerDied","Data":"39412dd6873fb860c67d1bda67ab4ecf088528977bfb69a2b3c76cdca7f746fb"} Jun 10 19:56:35.377947 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.377918 2567 generic.go:356] "Generic (PLEG): container finished" podID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerID="79b10dd411dcd7b26c9b248a69cf1ff8b6378d7f79588dc1891837877083d079" exitCode=0 Jun 10 19:56:35.378067 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.377986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" event={"ID":"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc","Type":"ContainerDied","Data":"79b10dd411dcd7b26c9b248a69cf1ff8b6378d7f79588dc1891837877083d079"} Jun 10 19:56:35.379558 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.379538 2567 generic.go:356] "Generic (PLEG): container finished" podID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerID="19089feaff6e82cdb1dbb548af5826ba1f676714de63c7b79b4749e3ef97e5fa" exitCode=0 Jun 10 19:56:35.379680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.379613 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" event={"ID":"7d41cda5-903d-4019-9348-c31c37b85bc9","Type":"ContainerDied","Data":"19089feaff6e82cdb1dbb548af5826ba1f676714de63c7b79b4749e3ef97e5fa"} Jun 10 19:56:35.524944 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.524917 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:35.586796 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.586772 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qg56\" (UniqueName: \"kubernetes.io/projected/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-kube-api-access-7qg56\") pod \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " Jun 10 19:56:35.586899 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.586856 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-util\") pod \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " Jun 10 19:56:35.586937 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.586899 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-bundle\") pod \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\" (UID: \"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07\") " Jun 10 19:56:35.587314 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.587286 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-bundle" (OuterVolumeSpecName: "bundle") pod "ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" (UID: "ae9b1c5c-f0e2-449e-9758-1f57eefd2c07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:35.588632 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.588611 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-kube-api-access-7qg56" (OuterVolumeSpecName: "kube-api-access-7qg56") pod "ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" (UID: "ae9b1c5c-f0e2-449e-9758-1f57eefd2c07"). InnerVolumeSpecName "kube-api-access-7qg56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:56:35.592409 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.592389 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-util" (OuterVolumeSpecName: "util") pod "ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" (UID: "ae9b1c5c-f0e2-449e-9758-1f57eefd2c07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:35.688149 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.688123 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:35.688149 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.688147 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:35.688322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:35.688158 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qg56\" (UniqueName: \"kubernetes.io/projected/ae9b1c5c-f0e2-449e-9758-1f57eefd2c07-kube-api-access-7qg56\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:36.387145 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.387110 2567 generic.go:356] "Generic (PLEG): container finished" podID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerID="7edc4f849b638c375e0bca467448bb0d5355f9be78c288b4854f38a93375ed7d" exitCode=0 Jun 10 19:56:36.387653 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.387184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" event={"ID":"7d41cda5-903d-4019-9348-c31c37b85bc9","Type":"ContainerDied","Data":"7edc4f849b638c375e0bca467448bb0d5355f9be78c288b4854f38a93375ed7d"} Jun 10 19:56:36.389056 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.389040 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" Jun 10 19:56:36.389168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.389076 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp" event={"ID":"ae9b1c5c-f0e2-449e-9758-1f57eefd2c07","Type":"ContainerDied","Data":"53d53caf593083628ba8402d1f3926af5ef6ff7782ef6ae0ad358c94de3be973"} Jun 10 19:56:36.389168 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.389106 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53d53caf593083628ba8402d1f3926af5ef6ff7782ef6ae0ad358c94de3be973" Jun 10 19:56:36.561697 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.561672 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:36.565126 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.565081 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:36.595909 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.595874 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxsn9\" (UniqueName: \"kubernetes.io/projected/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-kube-api-access-qxsn9\") pod \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " Jun 10 19:56:36.596072 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.595959 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl974\" (UniqueName: \"kubernetes.io/projected/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-kube-api-access-rl974\") pod \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " Jun 10 19:56:36.596072 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.595989 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-bundle\") pod \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " Jun 10 19:56:36.596072 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.596028 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-util\") pod \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\" (UID: \"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc\") " Jun 10 19:56:36.596262 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.596101 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-bundle\") pod \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " Jun 10 19:56:36.596262 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.596129 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-util\") pod \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\" (UID: \"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e\") " Jun 10 19:56:36.596817 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.596701 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-bundle" (OuterVolumeSpecName: "bundle") pod "f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" (UID: "f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:36.596817 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.596787 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-bundle" (OuterVolumeSpecName: "bundle") pod "d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" (UID: "d7a4b635-1eaa-48d9-ac95-ab0e00eed28e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:36.598308 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.598266 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-kube-api-access-rl974" (OuterVolumeSpecName: "kube-api-access-rl974") pod "d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" (UID: "d7a4b635-1eaa-48d9-ac95-ab0e00eed28e"). InnerVolumeSpecName "kube-api-access-rl974". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:56:36.598695 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.598676 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-kube-api-access-qxsn9" (OuterVolumeSpecName: "kube-api-access-qxsn9") pod "f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" (UID: "f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc"). InnerVolumeSpecName "kube-api-access-qxsn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:56:36.601698 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.601671 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-util" (OuterVolumeSpecName: "util") pod "f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" (UID: "f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:36.602812 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.602791 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-util" (OuterVolumeSpecName: "util") pod "d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" (UID: "d7a4b635-1eaa-48d9-ac95-ab0e00eed28e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:36.697551 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.697521 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:36.697551 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.697546 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:36.697551 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.697555 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxsn9\" (UniqueName: \"kubernetes.io/projected/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-kube-api-access-qxsn9\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:36.697757 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.697564 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl974\" (UniqueName: \"kubernetes.io/projected/d7a4b635-1eaa-48d9-ac95-ab0e00eed28e-kube-api-access-rl974\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:36.697757 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.697573 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:36.697757 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:36.697581 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:37.396585 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.396555 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" Jun 10 19:56:37.396997 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.396551 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l" event={"ID":"d7a4b635-1eaa-48d9-ac95-ab0e00eed28e","Type":"ContainerDied","Data":"d7dd7774cc7dfb09df87b33c7a35ba758da8119da2560930d2cb0c34f6f20369"} Jun 10 19:56:37.396997 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.396676 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7dd7774cc7dfb09df87b33c7a35ba758da8119da2560930d2cb0c34f6f20369" Jun 10 19:56:37.398529 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.398501 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" event={"ID":"f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc","Type":"ContainerDied","Data":"8a868c2cb74a9d4bd17aa82799ba5e8663b9cb6421ce0775ba24aa16d5822dce"} Jun 10 19:56:37.398644 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.398545 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq" Jun 10 19:56:37.398644 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.398548 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a868c2cb74a9d4bd17aa82799ba5e8663b9cb6421ce0775ba24aa16d5822dce" Jun 10 19:56:37.539768 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.539744 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:37.609462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.609415 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-util\") pod \"7d41cda5-903d-4019-9348-c31c37b85bc9\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " Jun 10 19:56:37.609462 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.609455 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-bundle\") pod \"7d41cda5-903d-4019-9348-c31c37b85bc9\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " Jun 10 19:56:37.609704 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.609502 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59r2p\" (UniqueName: \"kubernetes.io/projected/7d41cda5-903d-4019-9348-c31c37b85bc9-kube-api-access-59r2p\") pod \"7d41cda5-903d-4019-9348-c31c37b85bc9\" (UID: \"7d41cda5-903d-4019-9348-c31c37b85bc9\") " Jun 10 19:56:37.610211 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.610180 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-bundle" (OuterVolumeSpecName: "bundle") pod "7d41cda5-903d-4019-9348-c31c37b85bc9" (UID: "7d41cda5-903d-4019-9348-c31c37b85bc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:37.612584 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.612555 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d41cda5-903d-4019-9348-c31c37b85bc9-kube-api-access-59r2p" (OuterVolumeSpecName: "kube-api-access-59r2p") pod "7d41cda5-903d-4019-9348-c31c37b85bc9" (UID: "7d41cda5-903d-4019-9348-c31c37b85bc9"). InnerVolumeSpecName "kube-api-access-59r2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:56:37.615161 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.615137 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-util" (OuterVolumeSpecName: "util") pod "7d41cda5-903d-4019-9348-c31c37b85bc9" (UID: "7d41cda5-903d-4019-9348-c31c37b85bc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:56:37.710726 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.710696 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:37.710726 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.710723 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d41cda5-903d-4019-9348-c31c37b85bc9-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:37.710898 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:37.710738 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59r2p\" (UniqueName: \"kubernetes.io/projected/7d41cda5-903d-4019-9348-c31c37b85bc9-kube-api-access-59r2p\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:56:38.405165 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:38.405130 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" event={"ID":"7d41cda5-903d-4019-9348-c31c37b85bc9","Type":"ContainerDied","Data":"9c9ecc0c7cc9d921c70a2a695b27dbdd9878874f2ce84fe2451a8818701822dc"} Jun 10 19:56:38.405165 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:38.405165 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx" Jun 10 19:56:38.405710 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:38.405180 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c9ecc0c7cc9d921c70a2a695b27dbdd9878874f2ce84fe2451a8818701822dc" Jun 10 19:56:48.113769 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.113721 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c"] Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114084 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114096 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114107 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114113 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114119 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114124 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114132 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114137 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerName="util" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114150 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerName="extract" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114155 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerName="extract" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114162 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerName="extract" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114167 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerName="extract" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114173 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerName="pull" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114178 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerName="pull" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114185 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerName="extract" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114189 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerName="extract" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114199 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerName="pull" Jun 10 19:56:48.114196 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114204 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerName="pull" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114211 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerName="pull" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114216 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerName="pull" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114237 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerName="pull" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114243 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerName="pull" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114252 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerName="extract" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114257 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerName="extract" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114312 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a4b635-1eaa-48d9-ac95-ab0e00eed28e" containerName="extract" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114323 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc" containerName="extract" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114328 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9b1c5c-f0e2-449e-9758-1f57eefd2c07" containerName="extract" Jun 10 19:56:48.114825 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.114335 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d41cda5-903d-4019-9348-c31c37b85bc9" containerName="extract" Jun 10 19:56:48.124529 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.124512 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" Jun 10 19:56:48.127515 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.127485 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5cgs5\"" Jun 10 19:56:48.131417 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.131390 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c"] Jun 10 19:56:48.197872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.197843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvjp7\" (UniqueName: \"kubernetes.io/projected/3c2b3ac9-ef41-4736-89dd-c998e13ed833-kube-api-access-bvjp7\") pod \"authorino-operator-75cc8d5cb7-q9x6c\" (UID: \"3c2b3ac9-ef41-4736-89dd-c998e13ed833\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" Jun 10 19:56:48.299115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.299083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvjp7\" (UniqueName: \"kubernetes.io/projected/3c2b3ac9-ef41-4736-89dd-c998e13ed833-kube-api-access-bvjp7\") pod \"authorino-operator-75cc8d5cb7-q9x6c\" (UID: \"3c2b3ac9-ef41-4736-89dd-c998e13ed833\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" Jun 10 19:56:48.315312 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.315281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvjp7\" (UniqueName: \"kubernetes.io/projected/3c2b3ac9-ef41-4736-89dd-c998e13ed833-kube-api-access-bvjp7\") pod \"authorino-operator-75cc8d5cb7-q9x6c\" (UID: \"3c2b3ac9-ef41-4736-89dd-c998e13ed833\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" Jun 10 19:56:48.435853 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.435754 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" Jun 10 19:56:48.598528 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:48.598503 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c"] Jun 10 19:56:48.600697 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:48.600668 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2b3ac9_ef41_4736_89dd_c998e13ed833.slice/crio-6a586b93d65214ac1e19777ba9bb2497d51184759721ebf8843886ada5df376a WatchSource:0}: Error finding container 6a586b93d65214ac1e19777ba9bb2497d51184759721ebf8843886ada5df376a: Status 404 returned error can't find the container with id 6a586b93d65214ac1e19777ba9bb2497d51184759721ebf8843886ada5df376a Jun 10 19:56:49.470656 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:49.470616 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" event={"ID":"3c2b3ac9-ef41-4736-89dd-c998e13ed833","Type":"ContainerStarted","Data":"6a586b93d65214ac1e19777ba9bb2497d51184759721ebf8843886ada5df376a"} Jun 10 19:56:51.483094 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:51.483048 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" event={"ID":"3c2b3ac9-ef41-4736-89dd-c998e13ed833","Type":"ContainerStarted","Data":"f1d9229b55cbf69ed031866b38a7edffa859536404872edac24d847514a32b7f"} Jun 10 19:56:51.483524 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:51.483119 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" Jun 10 19:56:51.505329 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:51.505286 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" podStartSLOduration=1.389815711 podStartE2EDuration="3.505269288s" totalImagesPullingTime="2.115453577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:56:51.503769483 +0000 UTC m=+425.603163226" watchObservedRunningTime="2026-06-10 19:56:51.505269288 +0000 UTC m=+425.604663028" Jun 10 19:56:54.033587 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.033551 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7"] Jun 10 19:56:54.038316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.038298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:56:54.041076 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.041054 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w2kwm\"" Jun 10 19:56:54.055943 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.055906 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7"] Jun 10 19:56:54.149554 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.149503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltmh\" (UniqueName: \"kubernetes.io/projected/8bde07a2-91fe-40d7-b6d1-a6c86508e7f8-kube-api-access-zltmh\") pod \"limitador-operator-controller-manager-859d7b78bd-zc9z7\" (UID: \"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:56:54.250532 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.250479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmh\" (UniqueName: \"kubernetes.io/projected/8bde07a2-91fe-40d7-b6d1-a6c86508e7f8-kube-api-access-zltmh\") pod \"limitador-operator-controller-manager-859d7b78bd-zc9z7\" (UID: \"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:56:54.261468 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.261424 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltmh\" (UniqueName: \"kubernetes.io/projected/8bde07a2-91fe-40d7-b6d1-a6c86508e7f8-kube-api-access-zltmh\") pod \"limitador-operator-controller-manager-859d7b78bd-zc9z7\" (UID: \"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:56:54.348789 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.348695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:56:54.496737 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:54.496707 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7"] Jun 10 19:56:54.498316 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:56:54.498287 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bde07a2_91fe_40d7_b6d1_a6c86508e7f8.slice/crio-732d3a9fdf079abcf336674e476966c99ff417d4399777de9fa0870730e9c267 WatchSource:0}: Error finding container 732d3a9fdf079abcf336674e476966c99ff417d4399777de9fa0870730e9c267: Status 404 returned error can't find the container with id 732d3a9fdf079abcf336674e476966c99ff417d4399777de9fa0870730e9c267 Jun 10 19:56:55.506289 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:55.506255 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" event={"ID":"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8","Type":"ContainerStarted","Data":"732d3a9fdf079abcf336674e476966c99ff417d4399777de9fa0870730e9c267"} Jun 10 19:56:57.519075 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:57.519043 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" event={"ID":"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8","Type":"ContainerStarted","Data":"24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36"} Jun 10 19:56:57.519471 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:57.519171 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:56:57.537202 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:56:57.537154 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" podStartSLOduration=2.519737362 podStartE2EDuration="4.537140081s" totalImagesPullingTime="2.017402719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:56:57.535273343 +0000 UTC m=+431.634667083" watchObservedRunningTime="2026-06-10 19:56:57.537140081 +0000 UTC m=+431.636533821" Jun 10 19:57:02.491254 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:02.491207 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q9x6c" Jun 10 19:57:08.532533 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:08.532452 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:57:12.646919 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:12.646879 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7"] Jun 10 19:57:12.647413 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:12.647159 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" containerName="manager" containerID="cri-o://24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36" gracePeriod=2 Jun 10 19:57:12.668589 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:57:12.668545 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-zc9z7\": pods \"limitador-operator-controller-manager-859d7b78bd-zc9z7\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:57:12.669316 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:12.669282 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7"] Jun 10 19:57:12.890711 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:12.890687 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:57:12.892831 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:57:12.892800 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zc9z7\" is forbidden: User \"system:node:ip-10-0-129-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-154.ec2.internal' and this object" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:57:13.015757 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.015725 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zltmh\" (UniqueName: \"kubernetes.io/projected/8bde07a2-91fe-40d7-b6d1-a6c86508e7f8-kube-api-access-zltmh\") pod \"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8\" (UID: \"8bde07a2-91fe-40d7-b6d1-a6c86508e7f8\") " Jun 10 19:57:13.017797 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.017772 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bde07a2-91fe-40d7-b6d1-a6c86508e7f8-kube-api-access-zltmh" (OuterVolumeSpecName: "kube-api-access-zltmh") pod "8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" (UID: "8bde07a2-91fe-40d7-b6d1-a6c86508e7f8"). InnerVolumeSpecName "kube-api-access-zltmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:57:13.116288 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.116259 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zltmh\" (UniqueName: \"kubernetes.io/projected/8bde07a2-91fe-40d7-b6d1-a6c86508e7f8-kube-api-access-zltmh\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:57:13.613150 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.613117 2567 generic.go:356] "Generic (PLEG): container finished" podID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" containerID="24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36" exitCode=0 Jun 10 19:57:13.613360 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.613169 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:57:13.614294 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.613219 2567 scope.go:117] "RemoveContainer" containerID="24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36" Jun 10 19:57:13.615734 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:57:13.615710 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zc9z7\" is forbidden: User \"system:node:ip-10-0-129-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-154.ec2.internal' and this object" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:57:13.624281 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:57:13.624257 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zc9z7\" is forbidden: User \"system:node:ip-10-0-129-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-154.ec2.internal' and this object" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zc9z7" Jun 10 19:57:13.624374 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.624273 2567 scope.go:117] "RemoveContainer" containerID="24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36" Jun 10 19:57:13.624565 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:57:13.624544 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36\": container with ID starting with 24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36 not found: ID does not exist" containerID="24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36" Jun 10 19:57:13.624614 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:13.624575 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36"} err="failed to get container status \"24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36\": rpc error: code = NotFound desc = could not find container \"24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36\": container with ID starting with 24b47b0e29000f63ffc1c816e0871ee813a804471422864ad0d8bf524f074b36 not found: ID does not exist" Jun 10 19:57:14.305333 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:14.305300 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" path="/var/lib/kubelet/pods/8bde07a2-91fe-40d7-b6d1-a6c86508e7f8/volumes" Jun 10 19:57:25.275035 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.275002 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94"] Jun 10 19:57:25.275429 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.275356 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" containerName="manager" Jun 10 19:57:25.275429 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.275367 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" containerName="manager" Jun 10 19:57:25.275501 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.275435 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bde07a2-91fe-40d7-b6d1-a6c86508e7f8" containerName="manager" Jun 10 19:57:25.283870 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.283844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.286812 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.286786 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vnqjc\"" Jun 10 19:57:25.297474 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.297447 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94"] Jun 10 19:57:25.316636 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.316603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde155-19d3-4a73-b1f0-8fa2d4efa1df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-52j94\" (UID: \"19fde155-19d3-4a73-b1f0-8fa2d4efa1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.316787 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.316720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgbvr\" (UniqueName: \"kubernetes.io/projected/19fde155-19d3-4a73-b1f0-8fa2d4efa1df-kube-api-access-bgbvr\") pod \"kuadrant-operator-controller-manager-86878c769f-52j94\" (UID: \"19fde155-19d3-4a73-b1f0-8fa2d4efa1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.417197 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.417152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgbvr\" (UniqueName: \"kubernetes.io/projected/19fde155-19d3-4a73-b1f0-8fa2d4efa1df-kube-api-access-bgbvr\") pod \"kuadrant-operator-controller-manager-86878c769f-52j94\" (UID: \"19fde155-19d3-4a73-b1f0-8fa2d4efa1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.417406 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.417256 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde155-19d3-4a73-b1f0-8fa2d4efa1df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-52j94\" (UID: \"19fde155-19d3-4a73-b1f0-8fa2d4efa1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.417679 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.417659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19fde155-19d3-4a73-b1f0-8fa2d4efa1df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-52j94\" (UID: \"19fde155-19d3-4a73-b1f0-8fa2d4efa1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.426729 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.426697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgbvr\" (UniqueName: \"kubernetes.io/projected/19fde155-19d3-4a73-b1f0-8fa2d4efa1df-kube-api-access-bgbvr\") pod \"kuadrant-operator-controller-manager-86878c769f-52j94\" (UID: \"19fde155-19d3-4a73-b1f0-8fa2d4efa1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.594640 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.594556 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:25.738051 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:25.738024 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94"] Jun 10 19:57:25.739558 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:57:25.739520 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fde155_19d3_4a73_b1f0_8fa2d4efa1df.slice/crio-080ac6805e69831db28c90f9077457398d7ba84c9687d31dc45710e96d34e8e3 WatchSource:0}: Error finding container 080ac6805e69831db28c90f9077457398d7ba84c9687d31dc45710e96d34e8e3: Status 404 returned error can't find the container with id 080ac6805e69831db28c90f9077457398d7ba84c9687d31dc45710e96d34e8e3 Jun 10 19:57:26.689039 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:26.689008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" event={"ID":"19fde155-19d3-4a73-b1f0-8fa2d4efa1df","Type":"ContainerStarted","Data":"080ac6805e69831db28c90f9077457398d7ba84c9687d31dc45710e96d34e8e3"} Jun 10 19:57:31.722132 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:31.722089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" event={"ID":"19fde155-19d3-4a73-b1f0-8fa2d4efa1df","Type":"ContainerStarted","Data":"1a37ee5bb45e2390e470bde99721c48063f5540a3f9108447d1199be00eda4b3"} Jun 10 19:57:31.722531 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:31.722164 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:31.745307 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:31.745259 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" podStartSLOduration=1.540636879 podStartE2EDuration="6.745244092s" totalImagesPullingTime="5.204607213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:57:31.744249559 +0000 UTC m=+465.843643293" watchObservedRunningTime="2026-06-10 19:57:31.745244092 +0000 UTC m=+465.844637822" Jun 10 19:57:41.268326 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.268293 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7"] Jun 10 19:57:41.271935 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.271913 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.275247 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.275210 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r4xgm\"" Jun 10 19:57:41.285249 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.285208 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7"] Jun 10 19:57:41.369435 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369462 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7d1c20-f473-49ba-843d-bfa93896a439-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369611 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lht9k\" (UniqueName: \"kubernetes.io/projected/fd7d1c20-f473-49ba-843d-bfa93896a439-kube-api-access-lht9k\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369760 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369760 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369760 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369760 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.369912 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.369773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.470920 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.470880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lht9k\" (UniqueName: \"kubernetes.io/projected/fd7d1c20-f473-49ba-843d-bfa93896a439-kube-api-access-lht9k\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.470953 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.470981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471005 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471077 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471115 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471477 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471477 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7d1c20-f473-49ba-843d-bfa93896a439-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471477 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471452 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471649 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471561 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471649 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471597 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471744 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.471944 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.471928 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd7d1c20-f473-49ba-843d-bfa93896a439-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.473458 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.473434 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.473603 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.473585 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.478015 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.477989 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd7d1c20-f473-49ba-843d-bfa93896a439-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.478421 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.478401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lht9k\" (UniqueName: \"kubernetes.io/projected/fd7d1c20-f473-49ba-843d-bfa93896a439-kube-api-access-lht9k\") pod \"maas-default-gateway-openshift-default-687ff6996-xzdd7\" (UID: \"fd7d1c20-f473-49ba-843d-bfa93896a439\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.585705 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.585618 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:41.723112 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.723082 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7"] Jun 10 19:57:41.724271 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:57:41.724217 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7d1c20_f473_49ba_843d_bfa93896a439.slice/crio-6335c564a309a7597d2d92a03f9c1f94d8ffc2934c061530dcdc184e41720e7f WatchSource:0}: Error finding container 6335c564a309a7597d2d92a03f9c1f94d8ffc2934c061530dcdc184e41720e7f: Status 404 returned error can't find the container with id 6335c564a309a7597d2d92a03f9c1f94d8ffc2934c061530dcdc184e41720e7f Jun 10 19:57:41.726489 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.726453 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:57:41.726564 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.726534 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:57:41.726626 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.726580 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 19:57:41.776248 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:41.776197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" event={"ID":"fd7d1c20-f473-49ba-843d-bfa93896a439","Type":"ContainerStarted","Data":"6335c564a309a7597d2d92a03f9c1f94d8ffc2934c061530dcdc184e41720e7f"} Jun 10 19:57:42.729943 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:42.729912 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-52j94" Jun 10 19:57:42.784179 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:42.784142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" event={"ID":"fd7d1c20-f473-49ba-843d-bfa93896a439","Type":"ContainerStarted","Data":"f0abc7e1793359961c74fa8d41179322160a349402f828959af1c5d3f6fc271c"} Jun 10 19:57:42.812507 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:42.812445 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" podStartSLOduration=1.812429631 podStartE2EDuration="1.812429631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:57:42.810000822 +0000 UTC m=+476.909394563" watchObservedRunningTime="2026-06-10 19:57:42.812429631 +0000 UTC m=+476.911823370" Jun 10 19:57:43.586659 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:43.586629 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:43.591895 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:43.591871 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:43.790286 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:43.790255 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:43.791264 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:43.791239 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 19:57:45.946575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:45.946547 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76b6849646-n4mhg"] Jun 10 19:57:45.950575 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:45.950547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:45.961577 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:45.961551 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b6849646-n4mhg"] Jun 10 19:57:46.112376 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.112342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-trusted-ca-bundle\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.112552 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.112391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7j6t\" (UniqueName: \"kubernetes.io/projected/a88f31f5-ceff-4030-886f-de13d0d07a05-kube-api-access-c7j6t\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.112552 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.112475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-oauth-serving-cert\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.112552 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.112518 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88f31f5-ceff-4030-886f-de13d0d07a05-console-oauth-config\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.112552 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.112538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-service-ca\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.112709 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.112615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-console-config\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.112709 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.112666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88f31f5-ceff-4030-886f-de13d0d07a05-console-serving-cert\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213059 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7j6t\" (UniqueName: \"kubernetes.io/projected/a88f31f5-ceff-4030-886f-de13d0d07a05-kube-api-access-c7j6t\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213207 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-oauth-serving-cert\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213207 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88f31f5-ceff-4030-886f-de13d0d07a05-console-oauth-config\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213207 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-service-ca\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213207 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-console-config\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213207 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88f31f5-ceff-4030-886f-de13d0d07a05-console-serving-cert\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213513 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-trusted-ca-bundle\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.213989 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-oauth-serving-cert\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.214102 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.213993 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-service-ca\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.214102 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.214031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-console-config\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.214206 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.214131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88f31f5-ceff-4030-886f-de13d0d07a05-trusted-ca-bundle\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.215794 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.215765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88f31f5-ceff-4030-886f-de13d0d07a05-console-oauth-config\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.215877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.215793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88f31f5-ceff-4030-886f-de13d0d07a05-console-serving-cert\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.221451 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.221434 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7j6t\" (UniqueName: \"kubernetes.io/projected/a88f31f5-ceff-4030-886f-de13d0d07a05-kube-api-access-c7j6t\") pod \"console-76b6849646-n4mhg\" (UID: \"a88f31f5-ceff-4030-886f-de13d0d07a05\") " pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.262740 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.262718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:46.402053 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.402025 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b6849646-n4mhg"] Jun 10 19:57:46.403085 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:57:46.403057 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88f31f5_ceff_4030_886f_de13d0d07a05.slice/crio-b41bfeef82de2a2c3f02e081ff18ddc38e7a5f5979f6ef11b2d2d86e1e83ec60 WatchSource:0}: Error finding container b41bfeef82de2a2c3f02e081ff18ddc38e7a5f5979f6ef11b2d2d86e1e83ec60: Status 404 returned error can't find the container with id b41bfeef82de2a2c3f02e081ff18ddc38e7a5f5979f6ef11b2d2d86e1e83ec60 Jun 10 19:57:46.807605 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.807507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b6849646-n4mhg" event={"ID":"a88f31f5-ceff-4030-886f-de13d0d07a05","Type":"ContainerStarted","Data":"7da2b063d1794775c0d96251f1b23ea502f3d01b654b947db4c07c78b21d61d3"} Jun 10 19:57:46.807605 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.807573 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b6849646-n4mhg" event={"ID":"a88f31f5-ceff-4030-886f-de13d0d07a05","Type":"ContainerStarted","Data":"b41bfeef82de2a2c3f02e081ff18ddc38e7a5f5979f6ef11b2d2d86e1e83ec60"} Jun 10 19:57:46.829331 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:46.829287 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76b6849646-n4mhg" podStartSLOduration=1.829272917 podStartE2EDuration="1.829272917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:57:46.826653809 +0000 UTC m=+480.926047551" watchObservedRunningTime="2026-06-10 19:57:46.829272917 +0000 UTC m=+480.928666656" Jun 10 19:57:56.263203 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:56.263160 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:56.263633 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:56.263279 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:56.268093 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:56.268072 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:56.868409 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:56.868378 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76b6849646-n4mhg" Jun 10 19:57:56.913737 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:57:56.913700 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ddd8c554f-m8fq2"] Jun 10 19:58:00.701332 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:00.701297 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2hsgx"] Jun 10 19:58:00.713006 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:00.712967 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2hsgx"] Jun 10 19:58:00.713151 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:00.713082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2hsgx" Jun 10 19:58:00.715322 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:00.715293 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-84swl\"" Jun 10 19:58:00.748492 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:00.748454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7sb4\" (UniqueName: \"kubernetes.io/projected/833784d9-d61f-40f7-ab8f-1fc3c38d1536-kube-api-access-m7sb4\") pod \"authorino-58cd955675-2hsgx\" (UID: \"833784d9-d61f-40f7-ab8f-1fc3c38d1536\") " pod="kuadrant-system/authorino-58cd955675-2hsgx" Jun 10 19:58:00.849853 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:00.849821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7sb4\" (UniqueName: \"kubernetes.io/projected/833784d9-d61f-40f7-ab8f-1fc3c38d1536-kube-api-access-m7sb4\") pod \"authorino-58cd955675-2hsgx\" (UID: \"833784d9-d61f-40f7-ab8f-1fc3c38d1536\") " pod="kuadrant-system/authorino-58cd955675-2hsgx" Jun 10 19:58:00.861068 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:00.861035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7sb4\" (UniqueName: \"kubernetes.io/projected/833784d9-d61f-40f7-ab8f-1fc3c38d1536-kube-api-access-m7sb4\") pod \"authorino-58cd955675-2hsgx\" (UID: \"833784d9-d61f-40f7-ab8f-1fc3c38d1536\") " pod="kuadrant-system/authorino-58cd955675-2hsgx" Jun 10 19:58:01.024014 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:01.023940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2hsgx" Jun 10 19:58:01.176126 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:01.176100 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2hsgx"] Jun 10 19:58:01.177536 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:58:01.177507 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod833784d9_d61f_40f7_ab8f_1fc3c38d1536.slice/crio-947b522cd00048ac5fb671647ad689e78a77e2ed32ed6c728f84bdb8fd4b2619 WatchSource:0}: Error finding container 947b522cd00048ac5fb671647ad689e78a77e2ed32ed6c728f84bdb8fd4b2619: Status 404 returned error can't find the container with id 947b522cd00048ac5fb671647ad689e78a77e2ed32ed6c728f84bdb8fd4b2619 Jun 10 19:58:01.895236 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:01.895175 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2hsgx" event={"ID":"833784d9-d61f-40f7-ab8f-1fc3c38d1536","Type":"ContainerStarted","Data":"947b522cd00048ac5fb671647ad689e78a77e2ed32ed6c728f84bdb8fd4b2619"} Jun 10 19:58:04.915874 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:04.915784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2hsgx" event={"ID":"833784d9-d61f-40f7-ab8f-1fc3c38d1536","Type":"ContainerStarted","Data":"812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb"} Jun 10 19:58:04.932495 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:04.932441 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2hsgx" podStartSLOduration=1.527786039 podStartE2EDuration="4.932425782s" totalImagesPullingTime="3.404639743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:58:04.929833321 +0000 UTC m=+499.029227061" watchObservedRunningTime="2026-06-10 19:58:04.932425782 +0000 UTC m=+499.031819521" Jun 10 19:58:05.464232 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:05.464185 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2hsgx"] Jun 10 19:58:06.927642 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:06.927582 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2hsgx" podUID="833784d9-d61f-40f7-ab8f-1fc3c38d1536" containerName="authorino" containerID="cri-o://812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb" gracePeriod=30 Jun 10 19:58:07.178642 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.178582 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2hsgx" Jun 10 19:58:07.207410 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.207375 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7sb4\" (UniqueName: \"kubernetes.io/projected/833784d9-d61f-40f7-ab8f-1fc3c38d1536-kube-api-access-m7sb4\") pod \"833784d9-d61f-40f7-ab8f-1fc3c38d1536\" (UID: \"833784d9-d61f-40f7-ab8f-1fc3c38d1536\") " Jun 10 19:58:07.209451 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.209418 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833784d9-d61f-40f7-ab8f-1fc3c38d1536-kube-api-access-m7sb4" (OuterVolumeSpecName: "kube-api-access-m7sb4") pod "833784d9-d61f-40f7-ab8f-1fc3c38d1536" (UID: "833784d9-d61f-40f7-ab8f-1fc3c38d1536"). InnerVolumeSpecName "kube-api-access-m7sb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:58:07.308163 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.308128 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7sb4\" (UniqueName: \"kubernetes.io/projected/833784d9-d61f-40f7-ab8f-1fc3c38d1536-kube-api-access-m7sb4\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:07.934300 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.934268 2567 generic.go:356] "Generic (PLEG): container finished" podID="833784d9-d61f-40f7-ab8f-1fc3c38d1536" containerID="812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb" exitCode=0 Jun 10 19:58:07.934703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.934308 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2hsgx" Jun 10 19:58:07.934703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.934355 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2hsgx" event={"ID":"833784d9-d61f-40f7-ab8f-1fc3c38d1536","Type":"ContainerDied","Data":"812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb"} Jun 10 19:58:07.934703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.934398 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2hsgx" event={"ID":"833784d9-d61f-40f7-ab8f-1fc3c38d1536","Type":"ContainerDied","Data":"947b522cd00048ac5fb671647ad689e78a77e2ed32ed6c728f84bdb8fd4b2619"} Jun 10 19:58:07.934703 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.934416 2567 scope.go:117] "RemoveContainer" containerID="812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb" Jun 10 19:58:07.944261 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.944246 2567 scope.go:117] "RemoveContainer" containerID="812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb" Jun 10 19:58:07.944512 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:58:07.944495 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb\": container with ID starting with 812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb not found: ID does not exist" containerID="812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb" Jun 10 19:58:07.944558 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.944522 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb"} err="failed to get container status \"812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb\": rpc error: code = NotFound desc = could not find container \"812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb\": container with ID starting with 812a493bdfca907358b87eaf859d982f3addace44bc8cb0701871d73c3d9a3bb not found: ID does not exist" Jun 10 19:58:07.955680 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.955659 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2hsgx"] Jun 10 19:58:07.959768 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:07.959746 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2hsgx"] Jun 10 19:58:08.306127 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:08.306094 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="833784d9-d61f-40f7-ab8f-1fc3c38d1536" path="/var/lib/kubelet/pods/833784d9-d61f-40f7-ab8f-1fc3c38d1536/volumes" Jun 10 19:58:21.940770 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:21.940732 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-ddd8c554f-m8fq2" podUID="3ed098e7-f4ea-47e8-b66d-7a04a0f58961" containerName="console" containerID="cri-o://dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc" gracePeriod=15 Jun 10 19:58:22.195694 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.195636 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:58:22.343649 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.343611 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-oauth-serving-cert\") pod \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " Jun 10 19:58:22.343649 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.343644 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-trusted-ca-bundle\") pod \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " Jun 10 19:58:22.343883 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.343664 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-serving-cert\") pod \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " Jun 10 19:58:22.343883 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.343804 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-oauth-config\") pod \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " Jun 10 19:58:22.343991 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.343916 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr9kg\" (UniqueName: \"kubernetes.io/projected/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-kube-api-access-cr9kg\") pod \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " Jun 10 19:58:22.344059 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.343991 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-service-ca\") pod \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " Jun 10 19:58:22.344059 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.344018 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-config\") pod \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\" (UID: \"3ed098e7-f4ea-47e8-b66d-7a04a0f58961\") " Jun 10 19:58:22.344173 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.344012 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ed098e7-f4ea-47e8-b66d-7a04a0f58961" (UID: "3ed098e7-f4ea-47e8-b66d-7a04a0f58961"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:58:22.344173 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.344028 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ed098e7-f4ea-47e8-b66d-7a04a0f58961" (UID: "3ed098e7-f4ea-47e8-b66d-7a04a0f58961"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:58:22.344405 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.344364 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ed098e7-f4ea-47e8-b66d-7a04a0f58961" (UID: "3ed098e7-f4ea-47e8-b66d-7a04a0f58961"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:58:22.344544 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.344420 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-oauth-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:22.344544 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.344434 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-trusted-ca-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:22.344544 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.344460 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-config" (OuterVolumeSpecName: "console-config") pod "3ed098e7-f4ea-47e8-b66d-7a04a0f58961" (UID: "3ed098e7-f4ea-47e8-b66d-7a04a0f58961"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:58:22.345908 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.345877 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ed098e7-f4ea-47e8-b66d-7a04a0f58961" (UID: "3ed098e7-f4ea-47e8-b66d-7a04a0f58961"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:58:22.345908 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.345895 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-kube-api-access-cr9kg" (OuterVolumeSpecName: "kube-api-access-cr9kg") pod "3ed098e7-f4ea-47e8-b66d-7a04a0f58961" (UID: "3ed098e7-f4ea-47e8-b66d-7a04a0f58961"). InnerVolumeSpecName "kube-api-access-cr9kg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:58:22.346036 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.345955 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ed098e7-f4ea-47e8-b66d-7a04a0f58961" (UID: "3ed098e7-f4ea-47e8-b66d-7a04a0f58961"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:58:22.445078 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.445041 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr9kg\" (UniqueName: \"kubernetes.io/projected/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-kube-api-access-cr9kg\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:22.445078 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.445075 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-service-ca\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:22.445078 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.445085 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:22.445312 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.445095 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-serving-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:22.445312 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:22.445104 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed098e7-f4ea-47e8-b66d-7a04a0f58961-console-oauth-config\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:23.019033 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.018995 2567 generic.go:356] "Generic (PLEG): container finished" podID="3ed098e7-f4ea-47e8-b66d-7a04a0f58961" containerID="dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc" exitCode=0 Jun 10 19:58:23.019439 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.019054 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddd8c554f-m8fq2" Jun 10 19:58:23.019439 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.019083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddd8c554f-m8fq2" event={"ID":"3ed098e7-f4ea-47e8-b66d-7a04a0f58961","Type":"ContainerDied","Data":"dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc"} Jun 10 19:58:23.019439 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.019151 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddd8c554f-m8fq2" event={"ID":"3ed098e7-f4ea-47e8-b66d-7a04a0f58961","Type":"ContainerDied","Data":"587a0f7d3d9c11afe8398d70cebfb1c19d7738d5c5688e21e55938aa46840d1c"} Jun 10 19:58:23.019439 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.019172 2567 scope.go:117] "RemoveContainer" containerID="dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc" Jun 10 19:58:23.029273 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.029260 2567 scope.go:117] "RemoveContainer" containerID="dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc" Jun 10 19:58:23.029535 ip-10-0-129-154 kubenswrapper[2567]: E0610 19:58:23.029518 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc\": container with ID starting with dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc not found: ID does not exist" containerID="dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc" Jun 10 19:58:23.029582 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.029542 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc"} err="failed to get container status \"dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc\": rpc error: code = NotFound desc = could not find container \"dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc\": container with ID starting with dd89dd03df6c34991d48521fe5b53f1aa0806bd2a60357d1b054ca01dbec9ddc not found: ID does not exist" Jun 10 19:58:23.040545 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.040521 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ddd8c554f-m8fq2"] Jun 10 19:58:23.044758 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:23.044726 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ddd8c554f-m8fq2"] Jun 10 19:58:24.306258 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:24.306201 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ed098e7-f4ea-47e8-b66d-7a04a0f58961" path="/var/lib/kubelet/pods/3ed098e7-f4ea-47e8-b66d-7a04a0f58961/volumes" Jun 10 19:58:28.744617 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.744585 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7"] Jun 10 19:58:28.744997 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.744938 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833784d9-d61f-40f7-ab8f-1fc3c38d1536" containerName="authorino" Jun 10 19:58:28.744997 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.744949 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="833784d9-d61f-40f7-ab8f-1fc3c38d1536" containerName="authorino" Jun 10 19:58:28.744997 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.744965 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed098e7-f4ea-47e8-b66d-7a04a0f58961" containerName="console" Jun 10 19:58:28.744997 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.744970 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed098e7-f4ea-47e8-b66d-7a04a0f58961" containerName="console" Jun 10 19:58:28.745133 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.745029 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="833784d9-d61f-40f7-ab8f-1fc3c38d1536" containerName="authorino" Jun 10 19:58:28.745133 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.745039 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed098e7-f4ea-47e8-b66d-7a04a0f58961" containerName="console" Jun 10 19:58:28.749714 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.749695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:28.752450 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.752417 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:58:28.752555 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.752464 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:58:28.752555 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.752485 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xnsxg\"" Jun 10 19:58:28.757877 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.757854 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7"] Jun 10 19:58:28.903147 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.903114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:28.903147 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.903148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:28.903375 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:28.903180 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtwj8\" (UniqueName: \"kubernetes.io/projected/31ceb2b8-ee32-43b2-9653-4b7326941e38-kube-api-access-vtwj8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.003902 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.003812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.003902 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.003856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.004124 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.003981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtwj8\" (UniqueName: \"kubernetes.io/projected/31ceb2b8-ee32-43b2-9653-4b7326941e38-kube-api-access-vtwj8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.004207 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.004186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.004298 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.004269 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.013840 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.013805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtwj8\" (UniqueName: \"kubernetes.io/projected/31ceb2b8-ee32-43b2-9653-4b7326941e38-kube-api-access-vtwj8\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.060241 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.060196 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:29.195154 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:29.195124 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7"] Jun 10 19:58:29.196606 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:58:29.196581 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ceb2b8_ee32_43b2_9653_4b7326941e38.slice/crio-988d76134125bc6921fc79111479a10c3f118966ed710aedfb05111a518586b8 WatchSource:0}: Error finding container 988d76134125bc6921fc79111479a10c3f118966ed710aedfb05111a518586b8: Status 404 returned error can't find the container with id 988d76134125bc6921fc79111479a10c3f118966ed710aedfb05111a518586b8 Jun 10 19:58:30.065532 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:30.065495 2567 generic.go:356] "Generic (PLEG): container finished" podID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerID="18e323c8ff3dd167e4a3128c0a51b2e76bbc2b57b04f986bf7b124e96b4d49d6" exitCode=0 Jun 10 19:58:30.065901 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:30.065579 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" event={"ID":"31ceb2b8-ee32-43b2-9653-4b7326941e38","Type":"ContainerDied","Data":"18e323c8ff3dd167e4a3128c0a51b2e76bbc2b57b04f986bf7b124e96b4d49d6"} Jun 10 19:58:30.065901 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:30.065651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" event={"ID":"31ceb2b8-ee32-43b2-9653-4b7326941e38","Type":"ContainerStarted","Data":"988d76134125bc6921fc79111479a10c3f118966ed710aedfb05111a518586b8"} Jun 10 19:58:31.073397 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:31.073360 2567 generic.go:356] "Generic (PLEG): container finished" podID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerID="99e5fa44568e75231a8e2905587deea335f076f365c5bc26d8d300676258b334" exitCode=0 Jun 10 19:58:31.073839 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:31.073447 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" event={"ID":"31ceb2b8-ee32-43b2-9653-4b7326941e38","Type":"ContainerDied","Data":"99e5fa44568e75231a8e2905587deea335f076f365c5bc26d8d300676258b334"} Jun 10 19:58:32.082307 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:32.082270 2567 generic.go:356] "Generic (PLEG): container finished" podID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerID="ac0e66935b2e0db7d22a56d8833d3671e4bbe596a07164438ea794b40e0b4368" exitCode=0 Jun 10 19:58:32.082681 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:32.082358 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" event={"ID":"31ceb2b8-ee32-43b2-9653-4b7326941e38","Type":"ContainerDied","Data":"ac0e66935b2e0db7d22a56d8833d3671e4bbe596a07164438ea794b40e0b4368"} Jun 10 19:58:33.220065 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.220043 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:33.346808 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.346710 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtwj8\" (UniqueName: \"kubernetes.io/projected/31ceb2b8-ee32-43b2-9653-4b7326941e38-kube-api-access-vtwj8\") pod \"31ceb2b8-ee32-43b2-9653-4b7326941e38\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " Jun 10 19:58:33.346808 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.346760 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-bundle\") pod \"31ceb2b8-ee32-43b2-9653-4b7326941e38\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " Jun 10 19:58:33.347031 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.346852 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-util\") pod \"31ceb2b8-ee32-43b2-9653-4b7326941e38\" (UID: \"31ceb2b8-ee32-43b2-9653-4b7326941e38\") " Jun 10 19:58:33.347279 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.347256 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-bundle" (OuterVolumeSpecName: "bundle") pod "31ceb2b8-ee32-43b2-9653-4b7326941e38" (UID: "31ceb2b8-ee32-43b2-9653-4b7326941e38"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:58:33.348950 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.348933 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ceb2b8-ee32-43b2-9653-4b7326941e38-kube-api-access-vtwj8" (OuterVolumeSpecName: "kube-api-access-vtwj8") pod "31ceb2b8-ee32-43b2-9653-4b7326941e38" (UID: "31ceb2b8-ee32-43b2-9653-4b7326941e38"). InnerVolumeSpecName "kube-api-access-vtwj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:58:33.352656 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.352618 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-util" (OuterVolumeSpecName: "util") pod "31ceb2b8-ee32-43b2-9653-4b7326941e38" (UID: "31ceb2b8-ee32-43b2-9653-4b7326941e38"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:58:33.447952 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.447917 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-util\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:33.447952 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.447944 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtwj8\" (UniqueName: \"kubernetes.io/projected/31ceb2b8-ee32-43b2-9653-4b7326941e38-kube-api-access-vtwj8\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:33.447952 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:33.447954 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31ceb2b8-ee32-43b2-9653-4b7326941e38-bundle\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 19:58:34.095975 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:34.095904 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" Jun 10 19:58:34.095975 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:34.095930 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgrk7" event={"ID":"31ceb2b8-ee32-43b2-9653-4b7326941e38","Type":"ContainerDied","Data":"988d76134125bc6921fc79111479a10c3f118966ed710aedfb05111a518586b8"} Jun 10 19:58:34.096176 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:34.095979 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="988d76134125bc6921fc79111479a10c3f118966ed710aedfb05111a518586b8" Jun 10 19:58:51.571737 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.571701 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:58:51.572108 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.572093 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerName="util" Jun 10 19:58:51.572169 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.572118 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerName="util" Jun 10 19:58:51.572169 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.572140 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerName="pull" Jun 10 19:58:51.572169 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.572149 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerName="pull" Jun 10 19:58:51.572169 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.572167 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerName="extract" Jun 10 19:58:51.572331 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.572173 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerName="extract" Jun 10 19:58:51.572331 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.572253 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ceb2b8-ee32-43b2-9653-4b7326941e38" containerName="extract" Jun 10 19:58:51.576885 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.576869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:58:51.579424 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.579395 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 19:58:51.579424 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.579410 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 19:58:51.580536 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.580386 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 19:58:51.581000 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.580980 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p9h69\"" Jun 10 19:58:51.584056 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.584037 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:58:51.615070 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.615031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87mg\" (UniqueName: \"kubernetes.io/projected/0ed0e03f-a828-452d-a482-3dc420c95017-kube-api-access-b87mg\") pod \"maas-keycloak-0\" (UID: \"0ed0e03f-a828-452d-a482-3dc420c95017\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:58:51.715689 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.715649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87mg\" (UniqueName: \"kubernetes.io/projected/0ed0e03f-a828-452d-a482-3dc420c95017-kube-api-access-b87mg\") pod \"maas-keycloak-0\" (UID: \"0ed0e03f-a828-452d-a482-3dc420c95017\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:58:51.723131 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.723103 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87mg\" (UniqueName: \"kubernetes.io/projected/0ed0e03f-a828-452d-a482-3dc420c95017-kube-api-access-b87mg\") pod \"maas-keycloak-0\" (UID: \"0ed0e03f-a828-452d-a482-3dc420c95017\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:58:51.888138 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:51.888054 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:58:52.017608 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:52.017582 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:58:52.019062 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:58:52.019030 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed0e03f_a828_452d_a482_3dc420c95017.slice/crio-f56d4da67ce44ec0f7af549f48f0f53c462acd9d3721a44f4e8085ee5844359c WatchSource:0}: Error finding container f56d4da67ce44ec0f7af549f48f0f53c462acd9d3721a44f4e8085ee5844359c: Status 404 returned error can't find the container with id f56d4da67ce44ec0f7af549f48f0f53c462acd9d3721a44f4e8085ee5844359c Jun 10 19:58:52.208593 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:52.208556 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ed0e03f-a828-452d-a482-3dc420c95017","Type":"ContainerStarted","Data":"f56d4da67ce44ec0f7af549f48f0f53c462acd9d3721a44f4e8085ee5844359c"} Jun 10 19:58:57.249039 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:57.249002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ed0e03f-a828-452d-a482-3dc420c95017","Type":"ContainerStarted","Data":"71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553"} Jun 10 19:58:57.268239 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:57.268169 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.819723528 podStartE2EDuration="6.268147985s" totalImagesPullingTime="4.448424457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:58:57.264903184 +0000 UTC m=+551.364296926" watchObservedRunningTime="2026-06-10 19:58:57.268147985 +0000 UTC m=+551.367541726" Jun 10 19:58:57.888820 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:57.888761 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 19:58:57.890991 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:57.890950 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:58:58.889362 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:58.889316 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:58:59.889629 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:58:59.889578 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:00.888854 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:00.888809 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:01.888933 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:01.888875 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:01.889458 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:01.889402 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 19:59:02.889344 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:02.889279 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:03.888739 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:03.888685 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:04.889370 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:04.889311 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:05.889551 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:05.889507 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:06.889592 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:06.889543 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:07.888928 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:07.888887 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:08.888568 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:08.888524 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 10 19:59:09.997460 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:09.996347 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 19:59:10.011508 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:10.011464 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:59:20.004239 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:20.004185 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 19:59:22.075556 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.075518 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54c97c5589-dn7rr"] Jun 10 19:59:22.080754 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.080737 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.083850 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.083832 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 19:59:22.083976 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.083833 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-84swl\"" Jun 10 19:59:22.088530 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.088504 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c97c5589-dn7rr"] Jun 10 19:59:22.127137 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.127110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-tls-cert\") pod \"authorino-54c97c5589-dn7rr\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.127299 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.127193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qxqr\" (UniqueName: \"kubernetes.io/projected/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-kube-api-access-6qxqr\") pod \"authorino-54c97c5589-dn7rr\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.228659 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.228625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-tls-cert\") pod \"authorino-54c97c5589-dn7rr\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.228837 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.228716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qxqr\" (UniqueName: \"kubernetes.io/projected/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-kube-api-access-6qxqr\") pod \"authorino-54c97c5589-dn7rr\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.231344 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.231320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-tls-cert\") pod \"authorino-54c97c5589-dn7rr\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.239276 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.239242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qxqr\" (UniqueName: \"kubernetes.io/projected/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-kube-api-access-6qxqr\") pod \"authorino-54c97c5589-dn7rr\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.390911 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.390835 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 19:59:22.526093 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:22.526067 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c97c5589-dn7rr"] Jun 10 19:59:22.527850 ip-10-0-129-154 kubenswrapper[2567]: W0610 19:59:22.527824 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9aa3f7a_9d54_41d8_ad19_17d47c065c7d.slice/crio-2f2509be36f093a796ad51b08d34b694e6f29d59e25a5eac5581b57cc0624a35 WatchSource:0}: Error finding container 2f2509be36f093a796ad51b08d34b694e6f29d59e25a5eac5581b57cc0624a35: Status 404 returned error can't find the container with id 2f2509be36f093a796ad51b08d34b694e6f29d59e25a5eac5581b57cc0624a35 Jun 10 19:59:23.449474 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:23.449433 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c97c5589-dn7rr" event={"ID":"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d","Type":"ContainerStarted","Data":"5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad"} Jun 10 19:59:23.449872 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:23.449483 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c97c5589-dn7rr" event={"ID":"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d","Type":"ContainerStarted","Data":"2f2509be36f093a796ad51b08d34b694e6f29d59e25a5eac5581b57cc0624a35"} Jun 10 19:59:23.464730 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:23.464686 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54c97c5589-dn7rr" podStartSLOduration=1.149674303 podStartE2EDuration="1.464671034s" totalImagesPullingTime="314.996731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:23.463155061 +0000 UTC m=+577.562548802" watchObservedRunningTime="2026-06-10 19:59:23.464671034 +0000 UTC m=+577.564064774" Jun 10 19:59:46.283037 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:46.283010 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/0.log" Jun 10 19:59:46.283600 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:46.283291 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/0.log" Jun 10 19:59:46.286693 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:46.286672 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 19:59:46.286982 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:46.286965 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 19:59:46.291267 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:46.291251 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 19:59:46.291630 ip-10-0-129-154 kubenswrapper[2567]: I0610 19:59:46.291614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ncjw_0c569a42-f44d-4507-ac18-9f43b0ece800/ovn-acl-logging/0.log" Jun 10 20:00:01.935511 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.935474 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-grfpc"] Jun 10 20:00:01.938138 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.938114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" Jun 10 20:00:01.940585 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.940563 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ckftb\"" Jun 10 20:00:01.940739 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.940720 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 20:00:01.950980 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.950951 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-grfpc"] Jun 10 20:00:01.957427 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.957404 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-xmrjh"] Jun 10 20:00:01.960881 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.960861 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" Jun 10 20:00:01.971212 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.971191 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-xmrjh"] Jun 10 20:00:01.993527 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.993497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh79j\" (UniqueName: \"kubernetes.io/projected/01cf6791-0f68-4699-a05b-bd09a42e6ee8-kube-api-access-gh79j\") pod \"payload-pre-processing-579785bc64-grfpc\" (UID: \"01cf6791-0f68-4699-a05b-bd09a42e6ee8\") " pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" Jun 10 20:00:01.993674 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:01.993645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whjlq\" (UniqueName: \"kubernetes.io/projected/b7e2a260-f12b-4d43-9efa-52b1528f0db1-kube-api-access-whjlq\") pod \"payload-processing-699b6cd6c-xmrjh\" (UID: \"b7e2a260-f12b-4d43-9efa-52b1528f0db1\") " pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" Jun 10 20:00:02.094480 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.094444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whjlq\" (UniqueName: \"kubernetes.io/projected/b7e2a260-f12b-4d43-9efa-52b1528f0db1-kube-api-access-whjlq\") pod \"payload-processing-699b6cd6c-xmrjh\" (UID: \"b7e2a260-f12b-4d43-9efa-52b1528f0db1\") " pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" Jun 10 20:00:02.094665 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.094547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh79j\" (UniqueName: \"kubernetes.io/projected/01cf6791-0f68-4699-a05b-bd09a42e6ee8-kube-api-access-gh79j\") pod \"payload-pre-processing-579785bc64-grfpc\" (UID: \"01cf6791-0f68-4699-a05b-bd09a42e6ee8\") " pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" Jun 10 20:00:02.102412 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.102388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whjlq\" (UniqueName: \"kubernetes.io/projected/b7e2a260-f12b-4d43-9efa-52b1528f0db1-kube-api-access-whjlq\") pod \"payload-processing-699b6cd6c-xmrjh\" (UID: \"b7e2a260-f12b-4d43-9efa-52b1528f0db1\") " pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" Jun 10 20:00:02.102527 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.102441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh79j\" (UniqueName: \"kubernetes.io/projected/01cf6791-0f68-4699-a05b-bd09a42e6ee8-kube-api-access-gh79j\") pod \"payload-pre-processing-579785bc64-grfpc\" (UID: \"01cf6791-0f68-4699-a05b-bd09a42e6ee8\") " pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" Jun 10 20:00:02.249120 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.249091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" Jun 10 20:00:02.272122 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.272077 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" Jun 10 20:00:02.403977 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.403941 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-grfpc"] Jun 10 20:00:02.405016 ip-10-0-129-154 kubenswrapper[2567]: W0610 20:00:02.404990 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cf6791_0f68_4699_a05b_bd09a42e6ee8.slice/crio-cd2da0db76b14d7483668ee3c70f5e6b699f3e6d2c59c3fa50622c9824e3ccdf WatchSource:0}: Error finding container cd2da0db76b14d7483668ee3c70f5e6b699f3e6d2c59c3fa50622c9824e3ccdf: Status 404 returned error can't find the container with id cd2da0db76b14d7483668ee3c70f5e6b699f3e6d2c59c3fa50622c9824e3ccdf Jun 10 20:00:02.407273 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.407255 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:00:02.436815 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.436786 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-xmrjh"] Jun 10 20:00:02.440201 ip-10-0-129-154 kubenswrapper[2567]: W0610 20:00:02.440172 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e2a260_f12b_4d43_9efa_52b1528f0db1.slice/crio-af4fc397f289ea8b6e5cb424c406dc4ed7d90cb074b73dfddeeed30cd5ffcbea WatchSource:0}: Error finding container af4fc397f289ea8b6e5cb424c406dc4ed7d90cb074b73dfddeeed30cd5ffcbea: Status 404 returned error can't find the container with id af4fc397f289ea8b6e5cb424c406dc4ed7d90cb074b73dfddeeed30cd5ffcbea Jun 10 20:00:02.675058 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.674961 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" event={"ID":"01cf6791-0f68-4699-a05b-bd09a42e6ee8","Type":"ContainerStarted","Data":"cd2da0db76b14d7483668ee3c70f5e6b699f3e6d2c59c3fa50622c9824e3ccdf"} Jun 10 20:00:02.676163 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:02.676137 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" event={"ID":"b7e2a260-f12b-4d43-9efa-52b1528f0db1","Type":"ContainerStarted","Data":"af4fc397f289ea8b6e5cb424c406dc4ed7d90cb074b73dfddeeed30cd5ffcbea"} Jun 10 20:00:05.701287 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:05.701238 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" event={"ID":"01cf6791-0f68-4699-a05b-bd09a42e6ee8","Type":"ContainerStarted","Data":"d5b51c53057eb89c3b66583842ff35b2c45a68e87a6cc531ef142ec41661dedc"} Jun 10 20:00:05.701646 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:05.701306 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" Jun 10 20:00:05.702938 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:05.702915 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" event={"ID":"b7e2a260-f12b-4d43-9efa-52b1528f0db1","Type":"ContainerStarted","Data":"de56b15be01e9c449cb09389120a48334035c4b9722ee1f720129d3db0999e82"} Jun 10 20:00:05.703066 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:05.703047 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" Jun 10 20:00:05.718893 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:05.718843 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" podStartSLOduration=1.6357625040000001 podStartE2EDuration="4.718828662s" totalImagesPullingTime="3.083066158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:05.717757371 +0000 UTC m=+619.817151111" watchObservedRunningTime="2026-06-10 20:00:05.718828662 +0000 UTC m=+619.818222401" Jun 10 20:00:05.735799 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:05.735685 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" podStartSLOduration=1.681275248 podStartE2EDuration="4.735667841s" totalImagesPullingTime="3.054392593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:05.731865758 +0000 UTC m=+619.831259499" watchObservedRunningTime="2026-06-10 20:00:05.735667841 +0000 UTC m=+619.835061585" Jun 10 20:00:09.730058 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:09.730020 2567 generic.go:356] "Generic (PLEG): container finished" podID="fd7d1c20-f473-49ba-843d-bfa93896a439" containerID="f0abc7e1793359961c74fa8d41179322160a349402f828959af1c5d3f6fc271c" exitCode=0 Jun 10 20:00:09.730471 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:09.730103 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" event={"ID":"fd7d1c20-f473-49ba-843d-bfa93896a439","Type":"ContainerDied","Data":"f0abc7e1793359961c74fa8d41179322160a349402f828959af1c5d3f6fc271c"} Jun 10 20:00:09.730593 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:09.730578 2567 scope.go:117] "RemoveContainer" containerID="f0abc7e1793359961c74fa8d41179322160a349402f828959af1c5d3f6fc271c" Jun 10 20:00:09.731639 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:09.731608 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 20:00:09.731704 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:09.731690 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 20:00:09.731748 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:09.731734 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 20:00:10.746988 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:10.746937 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" event={"ID":"fd7d1c20-f473-49ba-843d-bfa93896a439","Type":"ContainerStarted","Data":"d9ffb75fb627142c8e85c41163408b4b5731932e10263125284167a8f702041e"} Jun 10 20:00:11.586647 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:11.586608 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 20:00:11.587698 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:11.587670 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-xzdd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 10 20:00:11.587824 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:11.587721 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" podUID="fd7d1c20-f473-49ba-843d-bfa93896a439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 10 20:00:11.768166 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:11.768137 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:00:11.768604 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:11.768328 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" containerID="cri-o://71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553" gracePeriod=30 Jun 10 20:00:12.586481 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:12.586444 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-xzdd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 10 20:00:12.586643 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:12.586501 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" podUID="fd7d1c20-f473-49ba-843d-bfa93896a439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 10 20:00:13.460442 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.460377 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:13.586436 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.586397 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-xzdd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 10 20:00:13.586605 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.586464 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" podUID="fd7d1c20-f473-49ba-843d-bfa93896a439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 10 20:00:13.647662 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.647617 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b87mg\" (UniqueName: \"kubernetes.io/projected/0ed0e03f-a828-452d-a482-3dc420c95017-kube-api-access-b87mg\") pod \"0ed0e03f-a828-452d-a482-3dc420c95017\" (UID: \"0ed0e03f-a828-452d-a482-3dc420c95017\") " Jun 10 20:00:13.652306 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.650635 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed0e03f-a828-452d-a482-3dc420c95017-kube-api-access-b87mg" (OuterVolumeSpecName: "kube-api-access-b87mg") pod "0ed0e03f-a828-452d-a482-3dc420c95017" (UID: "0ed0e03f-a828-452d-a482-3dc420c95017"). InnerVolumeSpecName "kube-api-access-b87mg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:00:13.748918 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.748803 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b87mg\" (UniqueName: \"kubernetes.io/projected/0ed0e03f-a828-452d-a482-3dc420c95017-kube-api-access-b87mg\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 20:00:13.768717 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.768682 2567 generic.go:356] "Generic (PLEG): container finished" podID="0ed0e03f-a828-452d-a482-3dc420c95017" containerID="71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553" exitCode=143 Jun 10 20:00:13.768868 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.768724 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ed0e03f-a828-452d-a482-3dc420c95017","Type":"ContainerDied","Data":"71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553"} Jun 10 20:00:13.768868 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.768728 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:13.768868 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.768764 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ed0e03f-a828-452d-a482-3dc420c95017","Type":"ContainerDied","Data":"f56d4da67ce44ec0f7af549f48f0f53c462acd9d3721a44f4e8085ee5844359c"} Jun 10 20:00:13.768868 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.768784 2567 scope.go:117] "RemoveContainer" containerID="71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553" Jun 10 20:00:13.779158 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.779139 2567 scope.go:117] "RemoveContainer" containerID="71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553" Jun 10 20:00:13.779436 ip-10-0-129-154 kubenswrapper[2567]: E0610 20:00:13.779417 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553\": container with ID starting with 71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553 not found: ID does not exist" containerID="71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553" Jun 10 20:00:13.779511 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.779451 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553"} err="failed to get container status \"71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553\": rpc error: code = NotFound desc = could not find container \"71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553\": container with ID starting with 71f95cf0b9effffbf11c17a836a75e319b8ec657d0655abb0b4fecbffd033553 not found: ID does not exist" Jun 10 20:00:13.790157 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.790131 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:00:13.790265 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.790168 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 20:00:13.795966 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.795947 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:00:13.817234 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.817199 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:00:13.817652 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.817637 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" Jun 10 20:00:13.817698 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.817654 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" Jun 10 20:00:13.817751 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.817742 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" containerName="keycloak" Jun 10 20:00:13.823036 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.823021 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:13.825671 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.825647 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 20:00:13.825775 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.825681 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p9h69\"" Jun 10 20:00:13.825775 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.825711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 20:00:13.825775 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.825647 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 20:00:13.825940 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.825838 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 20:00:13.830270 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.830244 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:00:13.953574 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.953520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d26pz\" (UniqueName: \"kubernetes.io/projected/5d3f102e-8295-46ec-b6dc-5422d9b0d973-kube-api-access-d26pz\") pod \"maas-keycloak-0\" (UID: \"5d3f102e-8295-46ec-b6dc-5422d9b0d973\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:13.953574 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:13.953575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5d3f102e-8295-46ec-b6dc-5422d9b0d973-test-realms\") pod \"maas-keycloak-0\" (UID: \"5d3f102e-8295-46ec-b6dc-5422d9b0d973\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:14.054875 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.054773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d26pz\" (UniqueName: \"kubernetes.io/projected/5d3f102e-8295-46ec-b6dc-5422d9b0d973-kube-api-access-d26pz\") pod \"maas-keycloak-0\" (UID: \"5d3f102e-8295-46ec-b6dc-5422d9b0d973\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:14.054875 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.054812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5d3f102e-8295-46ec-b6dc-5422d9b0d973-test-realms\") pod \"maas-keycloak-0\" (UID: \"5d3f102e-8295-46ec-b6dc-5422d9b0d973\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:14.055582 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.055559 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5d3f102e-8295-46ec-b6dc-5422d9b0d973-test-realms\") pod \"maas-keycloak-0\" (UID: \"5d3f102e-8295-46ec-b6dc-5422d9b0d973\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:14.063025 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.062999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d26pz\" (UniqueName: \"kubernetes.io/projected/5d3f102e-8295-46ec-b6dc-5422d9b0d973-kube-api-access-d26pz\") pod \"maas-keycloak-0\" (UID: \"5d3f102e-8295-46ec-b6dc-5422d9b0d973\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:14.159244 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.159182 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:14.315152 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.315121 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed0e03f-a828-452d-a482-3dc420c95017" path="/var/lib/kubelet/pods/0ed0e03f-a828-452d-a482-3dc420c95017/volumes" Jun 10 20:00:14.315551 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.315525 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:00:14.315654 ip-10-0-129-154 kubenswrapper[2567]: W0610 20:00:14.315564 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3f102e_8295_46ec_b6dc_5422d9b0d973.slice/crio-9ae219b8be3f8c9239555afc25031b18d49b5fdb50e0e902f433bddb202ee8dc WatchSource:0}: Error finding container 9ae219b8be3f8c9239555afc25031b18d49b5fdb50e0e902f433bddb202ee8dc: Status 404 returned error can't find the container with id 9ae219b8be3f8c9239555afc25031b18d49b5fdb50e0e902f433bddb202ee8dc Jun 10 20:00:14.586424 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.586339 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-xzdd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jun 10 20:00:14.586424 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.586394 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" podUID="fd7d1c20-f473-49ba-843d-bfa93896a439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jun 10 20:00:14.776783 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:14.776754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5d3f102e-8295-46ec-b6dc-5422d9b0d973","Type":"ContainerStarted","Data":"9ae219b8be3f8c9239555afc25031b18d49b5fdb50e0e902f433bddb202ee8dc"} Jun 10 20:00:15.592320 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:15.592276 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 20:00:15.593528 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:15.593507 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-xzdd7" Jun 10 20:00:15.786827 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:15.786784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5d3f102e-8295-46ec-b6dc-5422d9b0d973","Type":"ContainerStarted","Data":"bdde18de776a602d0cd296dc48143f615bf63dc1d1eee3c35e15910cfc300b43"} Jun 10 20:00:15.805945 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:15.805872 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.409731351 podStartE2EDuration="2.805850297s" totalImagesPullingTime="396.118946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:15.80290017 +0000 UTC m=+629.902293911" watchObservedRunningTime="2026-06-10 20:00:15.805850297 +0000 UTC m=+629.905244038" Jun 10 20:00:16.159447 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:16.159385 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:16.161596 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:16.161557 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:16.713877 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:16.713836 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-xmrjh" Jun 10 20:00:16.714610 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:16.714580 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-grfpc" Jun 10 20:00:17.160381 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:17.160293 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:18.160570 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:18.160528 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:19.160047 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:19.160002 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:20.160384 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:20.160335 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:21.160508 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:21.160450 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:22.160591 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:22.160549 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:23.159771 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:23.159717 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:24.159815 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:24.159773 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:24.160211 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:24.160123 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:25.160727 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:25.160677 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:26.160616 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:26.160564 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:27.160491 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:27.160434 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.57:9000/health/started\": dial tcp 10.132.0.57:9000: connect: connection refused" Jun 10 20:00:28.285579 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:28.285548 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 20:00:28.306323 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:28.306274 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:00:38.290777 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:38.290730 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5d3f102e-8295-46ec-b6dc-5422d9b0d973" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:00:48.291915 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:00:48.291878 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 20:01:00.283150 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.283103 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c97c5589-dn7rr"] Jun 10 20:01:00.284032 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.283971 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-54c97c5589-dn7rr" podUID="e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" containerName="authorino" containerID="cri-o://5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad" gracePeriod=30 Jun 10 20:01:00.549802 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.549778 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 20:01:00.608520 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.608472 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qxqr\" (UniqueName: \"kubernetes.io/projected/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-kube-api-access-6qxqr\") pod \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " Jun 10 20:01:00.608696 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.608531 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-tls-cert\") pod \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\" (UID: \"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d\") " Jun 10 20:01:00.610811 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.610778 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-kube-api-access-6qxqr" (OuterVolumeSpecName: "kube-api-access-6qxqr") pod "e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" (UID: "e9aa3f7a-9d54-41d8-ad19-17d47c065c7d"). InnerVolumeSpecName "kube-api-access-6qxqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:01:00.621923 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.621895 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" (UID: "e9aa3f7a-9d54-41d8-ad19-17d47c065c7d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:01:00.710058 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.710023 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qxqr\" (UniqueName: \"kubernetes.io/projected/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-kube-api-access-6qxqr\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 20:01:00.710058 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:00.710054 2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d-tls-cert\") on node \"ip-10-0-129-154.ec2.internal\" DevicePath \"\"" Jun 10 20:01:01.103505 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.103472 2567 generic.go:356] "Generic (PLEG): container finished" podID="e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" containerID="5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad" exitCode=0 Jun 10 20:01:01.103726 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.103524 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c97c5589-dn7rr" Jun 10 20:01:01.103726 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.103526 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c97c5589-dn7rr" event={"ID":"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d","Type":"ContainerDied","Data":"5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad"} Jun 10 20:01:01.103726 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.103647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c97c5589-dn7rr" event={"ID":"e9aa3f7a-9d54-41d8-ad19-17d47c065c7d","Type":"ContainerDied","Data":"2f2509be36f093a796ad51b08d34b694e6f29d59e25a5eac5581b57cc0624a35"} Jun 10 20:01:01.103726 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.103671 2567 scope.go:117] "RemoveContainer" containerID="5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad" Jun 10 20:01:01.116992 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.116926 2567 scope.go:117] "RemoveContainer" containerID="5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad" Jun 10 20:01:01.117403 ip-10-0-129-154 kubenswrapper[2567]: E0610 20:01:01.117377 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad\": container with ID starting with 5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad not found: ID does not exist" containerID="5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad" Jun 10 20:01:01.117518 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.117411 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad"} err="failed to get container status \"5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad\": rpc error: code = NotFound desc = could not find container \"5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad\": container with ID starting with 5534aacb06d144582821a85db36a3d61e6a50e94680e76c7e49b05179f0743ad not found: ID does not exist" Jun 10 20:01:01.127278 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.127252 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c97c5589-dn7rr"] Jun 10 20:01:01.137061 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:01.137038 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54c97c5589-dn7rr"] Jun 10 20:01:02.306590 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:02.306560 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" path="/var/lib/kubelet/pods/e9aa3f7a-9d54-41d8-ad19-17d47c065c7d/volumes" Jun 10 20:01:04.315565 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.315534 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v"] Jun 10 20:01:04.316064 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.316044 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" containerName="authorino" Jun 10 20:01:04.316147 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.316066 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" containerName="authorino" Jun 10 20:01:04.316204 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.316169 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9aa3f7a-9d54-41d8-ad19-17d47c065c7d" containerName="authorino" Jun 10 20:01:04.319633 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.319610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.321043 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.321013 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v"] Jun 10 20:01:04.322267 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.322243 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 20:01:04.322507 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.322322 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 20:01:04.323008 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.322986 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 20:01:04.323124 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.323051 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d487t\"" Jun 10 20:01:04.341540 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.341513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.341696 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.341579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.341696 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.341605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxcjj\" (UniqueName: \"kubernetes.io/projected/da3c13dc-fcd8-49db-9895-9705db746757-kube-api-access-rxcjj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.341820 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.341741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c13dc-fcd8-49db-9895-9705db746757-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.341820 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.341775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.341925 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.341836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.442837 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.442802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.442837 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.442837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxcjj\" (UniqueName: \"kubernetes.io/projected/da3c13dc-fcd8-49db-9895-9705db746757-kube-api-access-rxcjj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.443052 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.442870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c13dc-fcd8-49db-9895-9705db746757-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.443052 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.442928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.443052 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.442990 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.443052 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.443030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.443351 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.443325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.443443 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.443422 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.443506 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.443488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.445950 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.445923 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c13dc-fcd8-49db-9895-9705db746757-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.446186 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.446167 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c13dc-fcd8-49db-9895-9705db746757-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.450763 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.450741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxcjj\" (UniqueName: \"kubernetes.io/projected/da3c13dc-fcd8-49db-9895-9705db746757-kube-api-access-rxcjj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v\" (UID: \"da3c13dc-fcd8-49db-9895-9705db746757\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.631746 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.631642 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:01:04.772902 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:04.772874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v"] Jun 10 20:01:04.774281 ip-10-0-129-154 kubenswrapper[2567]: W0610 20:01:04.774212 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3c13dc_fcd8_49db_9895_9705db746757.slice/crio-6513683afec84ac10557514028ed68d82884aad60f54c8d4d8e6c47d8be00441 WatchSource:0}: Error finding container 6513683afec84ac10557514028ed68d82884aad60f54c8d4d8e6c47d8be00441: Status 404 returned error can't find the container with id 6513683afec84ac10557514028ed68d82884aad60f54c8d4d8e6c47d8be00441 Jun 10 20:01:05.130306 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:05.130269 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" event={"ID":"da3c13dc-fcd8-49db-9895-9705db746757","Type":"ContainerStarted","Data":"6513683afec84ac10557514028ed68d82884aad60f54c8d4d8e6c47d8be00441"} Jun 10 20:01:09.170706 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:09.170660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" event={"ID":"da3c13dc-fcd8-49db-9895-9705db746757","Type":"ContainerStarted","Data":"f9bde3e8c653c52f9f9134e53aafecb2ff947a7511e1848be41b9d6a149fc8ff"} Jun 10 20:01:19.068447 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.068410 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw"] Jun 10 20:01:19.072185 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.072169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.074287 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.074264 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 20:01:19.084567 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.084544 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw"] Jun 10 20:01:19.180928 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.180896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.180928 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.180930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.181173 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.180953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gllls\" (UniqueName: \"kubernetes.io/projected/cfa221e9-b39a-44cc-831e-20c47a617201-kube-api-access-gllls\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.181173 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.181015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.181173 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.181137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.181367 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.181172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa221e9-b39a-44cc-831e-20c47a617201-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282311 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282311 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa221e9-b39a-44cc-831e-20c47a617201-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282571 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282571 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282688 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gllls\" (UniqueName: \"kubernetes.io/projected/cfa221e9-b39a-44cc-831e-20c47a617201-kube-api-access-gllls\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282748 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282748 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282720 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.282891 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.282866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.283048 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.283026 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.284823 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.284793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfa221e9-b39a-44cc-831e-20c47a617201-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.284928 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.284902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa221e9-b39a-44cc-831e-20c47a617201-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.289834 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.289814 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gllls\" (UniqueName: \"kubernetes.io/projected/cfa221e9-b39a-44cc-831e-20c47a617201-kube-api-access-gllls\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw\" (UID: \"cfa221e9-b39a-44cc-831e-20c47a617201\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.385032 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.384939 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:19.528689 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:19.528659 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw"] Jun 10 20:01:19.530391 ip-10-0-129-154 kubenswrapper[2567]: W0610 20:01:19.530350 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa221e9_b39a_44cc_831e_20c47a617201.slice/crio-915fb7bdd1fa551674941a135614ff2cd9bd5e886f59ad70d172cc79b45b00f5 WatchSource:0}: Error finding container 915fb7bdd1fa551674941a135614ff2cd9bd5e886f59ad70d172cc79b45b00f5: Status 404 returned error can't find the container with id 915fb7bdd1fa551674941a135614ff2cd9bd5e886f59ad70d172cc79b45b00f5 Jun 10 20:01:20.238576 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:20.238528 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" event={"ID":"cfa221e9-b39a-44cc-831e-20c47a617201","Type":"ContainerStarted","Data":"d60b956396d78196de4c22f9d4d8e77b34e3dd462f8b82583aa409cd7e303105"} Jun 10 20:01:20.239063 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:20.238599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" event={"ID":"cfa221e9-b39a-44cc-831e-20c47a617201","Type":"ContainerStarted","Data":"915fb7bdd1fa551674941a135614ff2cd9bd5e886f59ad70d172cc79b45b00f5"} Jun 10 20:01:21.246275 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:21.246218 2567 generic.go:356] "Generic (PLEG): container finished" podID="cfa221e9-b39a-44cc-831e-20c47a617201" containerID="d60b956396d78196de4c22f9d4d8e77b34e3dd462f8b82583aa409cd7e303105" exitCode=0 Jun 10 20:01:21.246648 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:21.246322 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" event={"ID":"cfa221e9-b39a-44cc-831e-20c47a617201","Type":"ContainerDied","Data":"d60b956396d78196de4c22f9d4d8e77b34e3dd462f8b82583aa409cd7e303105"} Jun 10 20:01:23.261818 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:23.261772 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" event={"ID":"cfa221e9-b39a-44cc-831e-20c47a617201","Type":"ContainerStarted","Data":"3108930ece430ecf278807232224a02f3f00bebad160acfa60e1185dda942c3e"} Jun 10 20:01:23.279675 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:23.279630 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" podStartSLOduration=1.4488426859999999 podStartE2EDuration="4.279614874s" totalImagesPullingTime="1.555138876s" totalInitContainerRuntime="1.275633312s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:01:23.278857226 +0000 UTC m=+697.378250970" watchObservedRunningTime="2026-06-10 20:01:23.279614874 +0000 UTC m=+697.379008613" Jun 10 20:01:28.389863 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.389831 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv"] Jun 10 20:01:28.405058 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.405024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.406861 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.406830 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv"] Jun 10 20:01:28.407543 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.407520 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 20:01:28.573194 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.573159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.573398 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.573197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.573398 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.573289 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4db1b0c9-5ebe-41b6-a785-13145b0de649-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.573398 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.573330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.573505 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.573434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8ll4\" (UniqueName: \"kubernetes.io/projected/4db1b0c9-5ebe-41b6-a785-13145b0de649-kube-api-access-m8ll4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.573505 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.573478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.674834 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.674746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4db1b0c9-5ebe-41b6-a785-13145b0de649-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.674834 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.674805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.675067 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.674883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8ll4\" (UniqueName: \"kubernetes.io/projected/4db1b0c9-5ebe-41b6-a785-13145b0de649-kube-api-access-m8ll4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.675067 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.674939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.675172 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.675099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.675172 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.675158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.675355 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.675297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.675355 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.675321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.675583 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.675511 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.677345 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.677324 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4db1b0c9-5ebe-41b6-a785-13145b0de649-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.677436 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.677420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4db1b0c9-5ebe-41b6-a785-13145b0de649-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.682349 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.682328 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8ll4\" (UniqueName: \"kubernetes.io/projected/4db1b0c9-5ebe-41b6-a785-13145b0de649-kube-api-access-m8ll4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv\" (UID: \"4db1b0c9-5ebe-41b6-a785-13145b0de649\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.718366 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.718340 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:28.882556 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:28.882524 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv"] Jun 10 20:01:28.883103 ip-10-0-129-154 kubenswrapper[2567]: W0610 20:01:28.883077 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db1b0c9_5ebe_41b6_a785_13145b0de649.slice/crio-ee54655d50cb7571a1b2b2b93caa2ada335b40188380a2c8ec884fe280f541db WatchSource:0}: Error finding container ee54655d50cb7571a1b2b2b93caa2ada335b40188380a2c8ec884fe280f541db: Status 404 returned error can't find the container with id ee54655d50cb7571a1b2b2b93caa2ada335b40188380a2c8ec884fe280f541db Jun 10 20:01:29.298417 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:29.298385 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" event={"ID":"4db1b0c9-5ebe-41b6-a785-13145b0de649","Type":"ContainerStarted","Data":"a356532cc91436de5ecf61bf412b3e5e545d3c86ede97ea06be11468df3b89aa"} Jun 10 20:01:29.298582 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:29.298434 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" event={"ID":"4db1b0c9-5ebe-41b6-a785-13145b0de649","Type":"ContainerStarted","Data":"ee54655d50cb7571a1b2b2b93caa2ada335b40188380a2c8ec884fe280f541db"} Jun 10 20:01:29.385417 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:29.385375 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:29.385590 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:29.385445 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:29.398675 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:29.398648 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:30.305584 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:30.305549 2567 generic.go:356] "Generic (PLEG): container finished" podID="4db1b0c9-5ebe-41b6-a785-13145b0de649" containerID="a356532cc91436de5ecf61bf412b3e5e545d3c86ede97ea06be11468df3b89aa" exitCode=0 Jun 10 20:01:30.305940 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:30.305913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" event={"ID":"4db1b0c9-5ebe-41b6-a785-13145b0de649","Type":"ContainerDied","Data":"a356532cc91436de5ecf61bf412b3e5e545d3c86ede97ea06be11468df3b89aa"} Jun 10 20:01:30.317506 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:30.317488 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw" Jun 10 20:01:31.313578 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:31.313539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" event={"ID":"4db1b0c9-5ebe-41b6-a785-13145b0de649","Type":"ContainerStarted","Data":"cb841114a5c3583aa817fbcbe2f84555cc908d4b7ebf62a42f952484624f92d9"} Jun 10 20:01:31.333604 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:31.333446 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" podStartSLOduration=1.542808376 podStartE2EDuration="3.333402068s" totalImagesPullingTime="511.789954ms" totalInitContainerRuntime="1.278803738s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:01:31.330616796 +0000 UTC m=+705.430010533" watchObservedRunningTime="2026-06-10 20:01:31.333402068 +0000 UTC m=+705.432795845" Jun 10 20:01:38.718748 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:38.718661 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:38.718748 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:38.718726 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:38.732178 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:38.732149 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:01:39.373726 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:01:39.373691 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv" Jun 10 20:02:55.817217 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:02:55.817185 2567 generic.go:356] "Generic (PLEG): container finished" podID="da3c13dc-fcd8-49db-9895-9705db746757" containerID="f9bde3e8c653c52f9f9134e53aafecb2ff947a7511e1848be41b9d6a149fc8ff" exitCode=0 Jun 10 20:02:55.817706 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:02:55.817311 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" event={"ID":"da3c13dc-fcd8-49db-9895-9705db746757","Type":"ContainerDied","Data":"f9bde3e8c653c52f9f9134e53aafecb2ff947a7511e1848be41b9d6a149fc8ff"} Jun 10 20:02:56.825045 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:02:56.825013 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" event={"ID":"da3c13dc-fcd8-49db-9895-9705db746757","Type":"ContainerStarted","Data":"05be184c4649bc7f7bcf29f3d07eeca3752c7fee0d3a5e76c008ab66f926dcd6"} Jun 10 20:02:56.843946 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:02:56.843886 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" podStartSLOduration=2.5662169820000003 podStartE2EDuration="1m52.843867364s" totalImagesPullingTime="4.088581917s" totalInitContainerRuntime="1m46.189068465s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:01:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:02:56.842759411 +0000 UTC m=+790.942153151" watchObservedRunningTime="2026-06-10 20:02:56.843867364 +0000 UTC m=+790.943261106" Jun 10 20:03:04.631993 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:04.631903 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:03:04.631993 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:04.631964 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:03:04.644772 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:04.644738 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:03:04.882992 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:04.882907 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v" Jun 10 20:03:20.656991 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:20.656960 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64cb4df9fb-8w5gt_e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f/nginx/0.log" Jun 10 20:03:21.649998 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:21.649968 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448666b9-fl8g5_613009f5-0197-4b9e-b20c-45b537a90233/copy-manifests/0.log" Jun 10 20:03:21.657042 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:21.657023 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448666b9-fl8g5_613009f5-0197-4b9e-b20c-45b537a90233/manager/0.log" Jun 10 20:03:22.594004 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.593978 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp_ae9b1c5c-f0e2-449e-9758-1f57eefd2c07/util/0.log" Jun 10 20:03:22.599707 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.599679 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp_ae9b1c5c-f0e2-449e-9758-1f57eefd2c07/pull/0.log" Jun 10 20:03:22.604959 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.604936 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp_ae9b1c5c-f0e2-449e-9758-1f57eefd2c07/extract/0.log" Jun 10 20:03:22.706844 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.706817 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq_f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc/util/0.log" Jun 10 20:03:22.713276 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.713249 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq_f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc/pull/0.log" Jun 10 20:03:22.719370 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.719348 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq_f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc/extract/0.log" Jun 10 20:03:22.824195 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.824164 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx_7d41cda5-903d-4019-9348-c31c37b85bc9/util/0.log" Jun 10 20:03:22.837258 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.837189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx_7d41cda5-903d-4019-9348-c31c37b85bc9/pull/0.log" Jun 10 20:03:22.843058 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.843032 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx_7d41cda5-903d-4019-9348-c31c37b85bc9/extract/0.log" Jun 10 20:03:22.943084 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.943006 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l_d7a4b635-1eaa-48d9-ac95-ab0e00eed28e/pull/0.log" Jun 10 20:03:22.949265 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.949238 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l_d7a4b635-1eaa-48d9-ac95-ab0e00eed28e/extract/0.log" Jun 10 20:03:22.954759 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:22.954741 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l_d7a4b635-1eaa-48d9-ac95-ab0e00eed28e/util/0.log" Jun 10 20:03:23.167347 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:23.167314 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q9x6c_3c2b3ac9-ef41-4736-89dd-c998e13ed833/manager/0.log" Jun 10 20:03:23.482401 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:23.482363 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rdvc2_f659082d-f7ee-464e-b4a8-33e7dc41f9c1/registry-server/0.log" Jun 10 20:03:23.601327 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:23.601288 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-52j94_19fde155-19d3-4a73-b1f0-8fa2d4efa1df/manager/0.log" Jun 10 20:03:24.144208 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:24.144176 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hcwbx_dfe65433-0fff-4f0c-8d18-f31d285ee59c/istio-proxy/0.log" Jun 10 20:03:24.566348 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:24.566314 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/1.log" Jun 10 20:03:24.666505 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:24.666466 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-grfpc_01cf6791-0f68-4699-a05b-bd09a42e6ee8/payload-pre-processing/0.log" Jun 10 20:03:24.767904 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:24.767872 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xmrjh_b7e2a260-f12b-4d43-9efa-52b1528f0db1/payload-processing/0.log" Jun 10 20:03:24.869043 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:24.868952 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7868745755-r5db4_bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0/router/0.log" Jun 10 20:03:25.184793 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:25.184716 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v_da3c13dc-fcd8-49db-9895-9705db746757/storage-initializer/0.log" Jun 10 20:03:25.191637 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:25.191612 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qkx4v_da3c13dc-fcd8-49db-9895-9705db746757/main/0.log" Jun 10 20:03:25.426091 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:25.426055 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw_cfa221e9-b39a-44cc-831e-20c47a617201/storage-initializer/0.log" Jun 10 20:03:25.433343 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:25.433321 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-dwszw_cfa221e9-b39a-44cc-831e-20c47a617201/main/0.log" Jun 10 20:03:25.541551 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:25.541523 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv_4db1b0c9-5ebe-41b6-a785-13145b0de649/main/0.log" Jun 10 20:03:25.548403 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:25.548383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cq7lxv_4db1b0c9-5ebe-41b6-a785-13145b0de649/storage-initializer/0.log" Jun 10 20:03:33.177154 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:33.177124 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-65hm9_7cdc7488-1c8f-424b-be1d-fb08e3c7db2a/global-pull-secret-syncer/0.log" Jun 10 20:03:33.364947 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:33.364913 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xzhbm_dc045c30-15e3-416d-9f78-3430ac3a91e4/konnectivity-agent/0.log" Jun 10 20:03:33.386117 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:33.386091 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-154.ec2.internal_51f04f25ec4b2f3c9a26eaebfa71977e/haproxy/0.log" Jun 10 20:03:37.522468 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.522439 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp_ae9b1c5c-f0e2-449e-9758-1f57eefd2c07/extract/0.log" Jun 10 20:03:37.543876 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.543852 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp_ae9b1c5c-f0e2-449e-9758-1f57eefd2c07/util/0.log" Jun 10 20:03:37.565057 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.565011 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q4dxp_ae9b1c5c-f0e2-449e-9758-1f57eefd2c07/pull/0.log" Jun 10 20:03:37.608064 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.608042 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq_f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc/extract/0.log" Jun 10 20:03:37.628672 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.628205 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq_f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc/util/0.log" Jun 10 20:03:37.655978 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.655953 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06lvjq_f2d84c66-3dfc-4f7c-9884-15bcc2bc62bc/pull/0.log" Jun 10 20:03:37.686017 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.685993 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx_7d41cda5-903d-4019-9348-c31c37b85bc9/extract/0.log" Jun 10 20:03:37.719987 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.719967 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx_7d41cda5-903d-4019-9348-c31c37b85bc9/util/0.log" Jun 10 20:03:37.745110 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.745089 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v65cx_7d41cda5-903d-4019-9348-c31c37b85bc9/pull/0.log" Jun 10 20:03:37.777362 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.777290 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l_d7a4b635-1eaa-48d9-ac95-ab0e00eed28e/extract/0.log" Jun 10 20:03:37.806542 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.806517 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l_d7a4b635-1eaa-48d9-ac95-ab0e00eed28e/util/0.log" Jun 10 20:03:37.837581 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.837558 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wkg5l_d7a4b635-1eaa-48d9-ac95-ab0e00eed28e/pull/0.log" Jun 10 20:03:37.918719 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:37.918694 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q9x6c_3c2b3ac9-ef41-4736-89dd-c998e13ed833/manager/0.log" Jun 10 20:03:38.018829 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:38.018800 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rdvc2_f659082d-f7ee-464e-b4a8-33e7dc41f9c1/registry-server/0.log" Jun 10 20:03:38.061400 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:38.061312 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-52j94_19fde155-19d3-4a73-b1f0-8fa2d4efa1df/manager/0.log" Jun 10 20:03:40.068177 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:40.068140 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/1.log" Jun 10 20:03:40.246654 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:40.246601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2bvqw_781b0632-67b4-43cd-92ab-a97088cf8ba2/cluster-monitoring-operator/0.log" Jun 10 20:03:40.350660 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:40.350554 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d7bc7f7f-gv5fr_9caf6641-dce5-4474-9cb5-ca642105a899/metrics-server/0.log" Jun 10 20:03:40.376420 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:40.376392 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-rc99m_3cf535ca-6fc3-4c4f-8201-8cb25c6bfebd/monitoring-plugin/0.log" Jun 10 20:03:40.485995 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:40.485967 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fg8rb_5ac8cfd6-4b64-444a-b2d6-8da45814f8dc/node-exporter/0.log" Jun 10 20:03:40.513459 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:40.513432 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fg8rb_5ac8cfd6-4b64-444a-b2d6-8da45814f8dc/kube-rbac-proxy/0.log" Jun 10 20:03:40.532829 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:40.532805 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fg8rb_5ac8cfd6-4b64-444a-b2d6-8da45814f8dc/init-textfile/0.log" Jun 10 20:03:41.099071 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:41.098991 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54cb49bcbf-n2knf_ab5c9fae-89ae-4565-a662-a28aaef28e27/thanos-query/0.log" Jun 10 20:03:41.118651 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:41.118623 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54cb49bcbf-n2knf_ab5c9fae-89ae-4565-a662-a28aaef28e27/kube-rbac-proxy-web/0.log" Jun 10 20:03:41.142893 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:41.142862 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54cb49bcbf-n2knf_ab5c9fae-89ae-4565-a662-a28aaef28e27/kube-rbac-proxy/0.log" Jun 10 20:03:41.166306 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:41.166286 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54cb49bcbf-n2knf_ab5c9fae-89ae-4565-a662-a28aaef28e27/prom-label-proxy/0.log" Jun 10 20:03:41.190445 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:41.190418 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54cb49bcbf-n2knf_ab5c9fae-89ae-4565-a662-a28aaef28e27/kube-rbac-proxy-rules/0.log" Jun 10 20:03:41.211794 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:41.211768 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54cb49bcbf-n2knf_ab5c9fae-89ae-4565-a662-a28aaef28e27/kube-rbac-proxy-metrics/0.log" Jun 10 20:03:42.649020 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:42.648983 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-zc84s_29afa0d1-1603-4521-961c-46b333e4c7a6/networking-console-plugin/0.log" Jun 10 20:03:43.284313 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:43.284288 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/1.log" Jun 10 20:03:43.292012 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:43.291989 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gtzwp_2c03f74c-3831-4e71-a3a1-458b7e68ff6d/console-operator/2.log" Jun 10 20:03:43.831103 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:43.831070 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76b6849646-n4mhg_a88f31f5-ceff-4030-886f-de13d0d07a05/console/0.log" Jun 10 20:03:44.096324 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.096240 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx"] Jun 10 20:03:44.098881 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.098856 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.101329 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.101263 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4kwhz\"/\"openshift-service-ca.crt\"" Jun 10 20:03:44.101329 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.101282 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4kwhz\"/\"kube-root-ca.crt\"" Jun 10 20:03:44.101637 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.101263 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4kwhz\"/\"default-dockercfg-nl6bw\"" Jun 10 20:03:44.108636 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.108617 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx"] Jun 10 20:03:44.252981 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.252950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgq9d\" (UniqueName: \"kubernetes.io/projected/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-kube-api-access-dgq9d\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.253164 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.252996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-proc\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.253164 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.253023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-sys\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.253164 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.253111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-podres\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.253164 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.253141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-lib-modules\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354665 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgq9d\" (UniqueName: \"kubernetes.io/projected/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-kube-api-access-dgq9d\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354665 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-proc\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354856 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-sys\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354856 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-podres\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354856 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-lib-modules\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354856 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-proc\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354856 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-sys\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.354856 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-podres\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.355085 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.354887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-lib-modules\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.362278 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.362257 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgq9d\" (UniqueName: \"kubernetes.io/projected/d0cfd7c1-cd0c-4441-b15a-2713dfab5889-kube-api-access-dgq9d\") pod \"perf-node-gather-daemonset-24vtx\" (UID: \"d0cfd7c1-cd0c-4441-b15a-2713dfab5889\") " pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.410392 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.410360 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:44.545883 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.545855 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx"] Jun 10 20:03:44.546573 ip-10-0-129-154 kubenswrapper[2567]: W0610 20:03:44.546541 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd0cfd7c1_cd0c_4441_b15a_2713dfab5889.slice/crio-929e010be4ea14bc565ee3be2e1dc713f983ff27b9c043481dae1a8f1355f876 WatchSource:0}: Error finding container 929e010be4ea14bc565ee3be2e1dc713f983ff27b9c043481dae1a8f1355f876: Status 404 returned error can't find the container with id 929e010be4ea14bc565ee3be2e1dc713f983ff27b9c043481dae1a8f1355f876 Jun 10 20:03:44.646239 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:44.646206 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-hksp7_449ec46e-14cc-4981-af6a-dfe3fd38f28e/volume-data-source-validator/0.log" Jun 10 20:03:45.109436 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:45.109396 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" event={"ID":"d0cfd7c1-cd0c-4441-b15a-2713dfab5889","Type":"ContainerStarted","Data":"914cdfef42a679329021e50bf74228fd0ca8a28379035b56c62c5eef83af4e80"} Jun 10 20:03:45.109910 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:45.109456 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:45.109910 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:45.109474 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" event={"ID":"d0cfd7c1-cd0c-4441-b15a-2713dfab5889","Type":"ContainerStarted","Data":"929e010be4ea14bc565ee3be2e1dc713f983ff27b9c043481dae1a8f1355f876"} Jun 10 20:03:45.127513 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:45.127468 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" podStartSLOduration=1.127453043 podStartE2EDuration="1.127453043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:45.124469944 +0000 UTC m=+839.223863685" watchObservedRunningTime="2026-06-10 20:03:45.127453043 +0000 UTC m=+839.226846782" Jun 10 20:03:45.800653 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:45.800626 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95bbc_a2c24cf2-68d3-415f-86dd-1fbcdf68256c/dns/0.log" Jun 10 20:03:45.820529 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:45.820487 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95bbc_a2c24cf2-68d3-415f-86dd-1fbcdf68256c/kube-rbac-proxy/0.log" Jun 10 20:03:45.938765 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:45.938736 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bg6bp_6d209f8d-33a4-4544-9363-3dd0e523d7c7/dns-node-resolver/0.log" Jun 10 20:03:46.596780 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:46.596753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvn5v_9416fb12-c296-4de0-9790-c049a1be95cd/node-ca/0.log" Jun 10 20:03:47.535919 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:47.535884 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hcwbx_dfe65433-0fff-4f0c-8d18-f31d285ee59c/istio-proxy/0.log" Jun 10 20:03:47.652917 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:47.652887 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/0.log" Jun 10 20:03:47.655654 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:47.655623 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/1.log" Jun 10 20:03:47.677519 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:47.677492 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-grfpc_01cf6791-0f68-4699-a05b-bd09a42e6ee8/payload-pre-processing/0.log" Jun 10 20:03:47.702508 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:47.702480 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xmrjh_b7e2a260-f12b-4d43-9efa-52b1528f0db1/payload-processing/0.log" Jun 10 20:03:47.726527 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:47.726500 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7868745755-r5db4_bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0/router/0.log" Jun 10 20:03:48.381731 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:48.381695 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nggcf_9bc3c612-2c52-46de-80b9-2b5be013dd74/serve-healthcheck-canary/0.log" Jun 10 20:03:48.930612 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:48.930578 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5jv8x_edea99ce-d5a4-486f-ac8a-0deb0c726942/insights-operator/1.log" Jun 10 20:03:48.931051 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:48.930789 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5jv8x_edea99ce-d5a4-486f-ac8a-0deb0c726942/insights-operator/0.log" Jun 10 20:03:49.092740 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:49.092703 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfsgp_3c271732-b059-4134-a3da-50f64eadec32/kube-rbac-proxy/0.log" Jun 10 20:03:49.113885 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:49.113858 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfsgp_3c271732-b059-4134-a3da-50f64eadec32/exporter/0.log" Jun 10 20:03:49.134966 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:49.134932 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfsgp_3c271732-b059-4134-a3da-50f64eadec32/extractor/0.log" Jun 10 20:03:51.125160 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:51.125135 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4kwhz/perf-node-gather-daemonset-24vtx" Jun 10 20:03:51.274492 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:51.274463 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64cb4df9fb-8w5gt_e1da5f5c-83aa-41f2-8e0e-ca74151e8a0f/nginx/0.log" Jun 10 20:03:51.546459 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:51.546434 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448666b9-fl8g5_613009f5-0197-4b9e-b20c-45b537a90233/manager/0.log" Jun 10 20:03:51.564848 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:51.564824 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5448666b9-fl8g5_613009f5-0197-4b9e-b20c-45b537a90233/copy-manifests/0.log" Jun 10 20:03:53.310000 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:53.309920 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b55d8c87f-p5d5f_624d546b-3455-4521-b77d-63fb3012669d/manager/0.log" Jun 10 20:03:58.538449 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:58.538414 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hcwbx_dfe65433-0fff-4f0c-8d18-f31d285ee59c/istio-proxy/0.log" Jun 10 20:03:58.617432 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:58.617403 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/1.log" Jun 10 20:03:58.618067 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:58.618039 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/0.log" Jun 10 20:03:58.627187 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:58.627167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-grfpc_01cf6791-0f68-4699-a05b-bd09a42e6ee8/payload-pre-processing/0.log" Jun 10 20:03:58.641940 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:58.641916 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xmrjh_b7e2a260-f12b-4d43-9efa-52b1528f0db1/payload-processing/0.log" Jun 10 20:03:58.661773 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:58.661751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7868745755-r5db4_bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0/router/0.log" Jun 10 20:03:59.122139 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.122099 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-8ktss_48d98caa-fe9f-4009-9a3c-fe17d60ff581/kube-storage-version-migrator-operator/1.log" Jun 10 20:03:59.123774 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.123745 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-8ktss_48d98caa-fe9f-4009-9a3c-fe17d60ff581/kube-storage-version-migrator-operator/0.log" Jun 10 20:03:59.780374 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.780348 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hcwbx_dfe65433-0fff-4f0c-8d18-f31d285ee59c/istio-proxy/0.log" Jun 10 20:03:59.868360 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.868326 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/1.log" Jun 10 20:03:59.868938 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.868908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/0.log" Jun 10 20:03:59.879258 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.879240 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-grfpc_01cf6791-0f68-4699-a05b-bd09a42e6ee8/payload-pre-processing/0.log" Jun 10 20:03:59.897660 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.897628 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xmrjh_b7e2a260-f12b-4d43-9efa-52b1528f0db1/payload-processing/0.log" Jun 10 20:03:59.917274 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:03:59.917252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7868745755-r5db4_bdfc6e4b-28d7-4e87-a4fc-b3d7dfe662d0/router/0.log" Jun 10 20:04:00.693339 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.693311 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkcst_6880c3bf-299e-488a-8c72-b48b14ba4640/kube-multus-additional-cni-plugins/0.log" Jun 10 20:04:00.718232 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.718189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkcst_6880c3bf-299e-488a-8c72-b48b14ba4640/egress-router-binary-copy/0.log" Jun 10 20:04:00.739441 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.739416 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkcst_6880c3bf-299e-488a-8c72-b48b14ba4640/cni-plugins/0.log" Jun 10 20:04:00.759759 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.759732 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkcst_6880c3bf-299e-488a-8c72-b48b14ba4640/bond-cni-plugin/0.log" Jun 10 20:04:00.780062 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.780042 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkcst_6880c3bf-299e-488a-8c72-b48b14ba4640/routeoverride-cni/0.log" Jun 10 20:04:00.801398 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.801369 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkcst_6880c3bf-299e-488a-8c72-b48b14ba4640/whereabouts-cni-bincopy/0.log" Jun 10 20:04:00.824094 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.824072 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkcst_6880c3bf-299e-488a-8c72-b48b14ba4640/whereabouts-cni/0.log" Jun 10 20:04:00.870135 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.870104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tlxbl_26b5b1b4-6e7e-4d59-9330-8b3d18bdaa61/kube-multus/0.log" Jun 10 20:04:00.986371 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:00.986342 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9ctj9_3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83/network-metrics-daemon/0.log" Jun 10 20:04:01.004016 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:01.003993 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9ctj9_3b171ac5-1b3f-46ce-9d3b-8c01bfc67f83/kube-rbac-proxy/0.log" Jun 10 20:04:01.501188 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:01.501158 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hcwbx_dfe65433-0fff-4f0c-8d18-f31d285ee59c/istio-proxy/0.log" Jun 10 20:04:01.596673 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:01.596615 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/0.log" Jun 10 20:04:01.596850 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:01.596776 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-xzdd7_fd7d1c20-f473-49ba-843d-bfa93896a439/istio-proxy/1.log" Jun 10 20:04:01.609274 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:01.609237 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-grfpc_01cf6791-0f68-4699-a05b-bd09a42e6ee8/payload-pre-processing/0.log" Jun 10 20:04:01.629879 ip-10-0-129-154 kubenswrapper[2567]: I0610 20:04:01.629858 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xmrjh_b7e2a260-f12b-4d43-9efa-52b1528f0db1/payload-processing/0.log"