Jun 11 16:38:53.283892 ip-10-0-139-153 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:38:53.684133 ip-10-0-139-153 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:38:53.684133 ip-10-0-139-153 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:38:53.684133 ip-10-0-139-153 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:38:53.684133 ip-10-0-139-153 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:38:53.684133 ip-10-0-139-153 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:38:53.684823 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.684220 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:38:53.689396 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689372 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:38:53.689396 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689392 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:38:53.689396 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689396 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:38:53.689396 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689399 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:38:53.689396 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689402 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:38:53.689396 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689405 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689408 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689411 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689414 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689417 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689420 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689422 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689425 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689428 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689430 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689433 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689435 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689438 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689441 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689443 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689446 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689448 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689451 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689454 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689457 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:38:53.689658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689459 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689462 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689464 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689467 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689470 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689477 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689481 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689484 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689487 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689490 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689493 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689496 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689498 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689501 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689505 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689508 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689510 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689513 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689515 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:38:53.690147 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689518 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689521 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689524 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689527 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689529 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689532 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689541 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689544 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689549 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689567 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689572 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689575 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689578 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689580 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689583 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689585 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689588 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689591 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689593 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:38:53.690682 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689596 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689599 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689601 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689604 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689606 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689609 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689611 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689615 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689618 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689621 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689624 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689627 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689629 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689632 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689635 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689637 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689641 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689643 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689646 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689648 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:38:53.691159 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689652 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689655 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689658 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689661 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689663 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689666 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689669 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689671 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689674 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689677 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689679 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689682 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689684 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689688 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689690 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.689693 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690429 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690436 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690440 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:38:53.691653 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690443 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690447 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690450 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690453 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690456 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690458 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690461 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690464 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690467 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690469 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690472 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690475 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690478 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690480 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690484 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690487 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690490 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690492 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690495 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690497 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:38:53.692163 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690500 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690503 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690506 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690509 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690512 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690516 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690520 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690523 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690525 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690528 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690531 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690534 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690537 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690541 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690544 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690547 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690564 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690567 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690569 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:38:53.692698 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690572 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690574 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690577 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690580 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690582 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690585 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690588 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690591 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690594 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690596 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690599 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690602 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690605 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690607 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690610 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690613 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690615 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690618 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690621 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690625 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:38:53.693196 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690627 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690630 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690633 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690636 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690638 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690641 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690644 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690647 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690649 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690652 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690655 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690657 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690660 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690662 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690665 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690667 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690670 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690672 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690675 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690678 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:38:53.693716 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690681 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690684 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690687 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690690 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690695 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690698 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690702 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690705 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690708 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690711 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690715 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690717 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690720 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690722 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690725 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690728 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.690730 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691201 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691209 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691213 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:38:53.694205 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691218 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691221 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691224 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691227 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691230 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691232 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691235 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691237 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691240 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691242 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691245 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691248 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691251 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691254 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691257 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691260 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691262 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691264 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691267 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691274 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:38:53.694726 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691277 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691279 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691282 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691285 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691287 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691290 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691293 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691295 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691298 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691301 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691303 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691306 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691308 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691311 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691313 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691316 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691318 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691321 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691323 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691326 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:38:53.695219 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691329 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691331 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691334 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691337 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691343 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691346 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691350 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691353 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691356 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691359 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691362 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691366 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691369 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691372 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691374 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691377 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691380 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691382 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691385 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:38:53.695725 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691387 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691390 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691392 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691395 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691397 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691400 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691402 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691405 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691407 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691410 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691413 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691415 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691418 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691420 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691423 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691425 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691428 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691434 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691437 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691439 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:38:53.696181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691442 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691445 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691447 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691450 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691453 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691456 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691458 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691461 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691463 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691468 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691471 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691473 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691476 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691478 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691481 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691485 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.691488 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691585 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691596 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691607 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:38:53.696719 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691613 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691617 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691620 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691625 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691629 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691632 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691635 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691638 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691642 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691647 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691650 2563 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691653 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691656 2563 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691660 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691663 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691668 2563 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691671 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691674 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691677 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691681 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691684 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691687 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691690 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:38:53.697201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691693 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691696 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691699 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691703 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691706 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691709 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691713 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691716 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691719 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691721 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691724 2563 flags.go:64] FLAG: --enable-server="true" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691727 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691739 2563 flags.go:64] FLAG: --event-burst="100" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691742 2563 flags.go:64] FLAG: --event-qps="50" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691745 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691748 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691751 2563 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691760 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691764 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691767 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691770 2563 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691773 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691776 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691779 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691782 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:38:53.697870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691786 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691789 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691792 2563 flags.go:64] FLAG: --feature-gates="" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691795 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691798 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691801 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691804 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691807 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691810 2563 flags.go:64] FLAG: --help="false" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691813 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691816 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691819 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691822 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691826 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691829 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691832 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691835 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691838 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691841 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691843 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691847 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691850 2563 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691852 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691855 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:38:53.698517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691859 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691863 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691866 2563 flags.go:64] FLAG: --lock-file="" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691869 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691872 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691875 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691880 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691884 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691887 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691890 2563 flags.go:64] FLAG: --logging-format="text" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691893 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691896 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691899 2563 flags.go:64] FLAG: --manifest-url="" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691902 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691907 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691910 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691914 2563 flags.go:64] FLAG: --max-pods="110" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691917 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691920 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691923 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691925 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691928 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691931 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691934 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691941 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:38:53.699130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691944 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691947 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691950 2563 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691953 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691959 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691962 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691965 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691968 2563 flags.go:64] FLAG: --port="10250" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691972 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691975 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cfc84022af4807b5" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691978 2563 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691981 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691984 2563 flags.go:64] FLAG: --register-node="true" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691987 2563 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691990 2563 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691994 2563 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691997 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.691999 2563 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692003 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692007 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692009 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692012 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692015 2563 flags.go:64] FLAG: --runonce="false" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692018 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692021 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:38:53.699763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692024 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692026 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692029 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692032 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692035 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692037 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692040 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692043 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692045 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692048 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692051 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692054 2563 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692056 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692061 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692064 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692068 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692072 2563 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692075 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692077 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692080 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692083 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692086 2563 flags.go:64] FLAG: --v="2" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692092 2563 flags.go:64] FLAG: --version="false" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692096 2563 flags.go:64] FLAG: --vmodule="" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692100 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:38:53.700392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.692103 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692238 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692242 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692245 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692248 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692251 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692253 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692256 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692258 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692261 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692263 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692266 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692268 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692271 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692274 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692276 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692279 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692281 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692284 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692286 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:38:53.701039 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692289 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692292 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692296 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692299 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692302 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692304 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692307 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692309 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692312 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692315 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692318 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692321 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692324 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692326 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692329 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692333 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692337 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692340 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692343 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:38:53.701528 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692346 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692349 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692352 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692355 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692357 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692360 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692363 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692365 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692368 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692371 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692373 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692376 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692378 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692381 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692383 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692387 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692389 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692392 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692395 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692397 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:38:53.702097 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692400 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692403 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692407 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692410 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692413 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692417 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692420 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692423 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692425 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692428 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692431 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692434 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692436 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692439 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692441 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692445 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692448 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692451 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692454 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:38:53.702616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692457 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692460 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692462 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692466 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692469 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692471 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692474 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692476 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692481 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692483 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692486 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692488 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692491 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692493 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692496 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692500 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692503 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692506 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692508 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692511 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:38:53.703136 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692514 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.692517 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.693137 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.699791 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.699809 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.699831 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.699838 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699900 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699905 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699908 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699912 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699915 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699918 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699920 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:38:53.703658 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699923 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699926 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699930 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699933 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699935 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699938 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699941 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699944 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699946 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699949 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699951 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699954 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699956 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699959 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699962 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699964 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699967 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699970 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699972 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699975 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:38:53.704015 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699978 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699980 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699984 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699987 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699989 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699992 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.699996 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700000 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700004 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700008 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700011 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700014 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700017 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700020 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700023 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700026 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700029 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700032 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700035 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:38:53.704510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700038 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700042 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700045 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700047 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700050 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700053 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700056 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700059 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700062 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700065 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700067 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700070 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700073 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700075 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700078 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700081 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700092 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700095 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700097 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:38:53.704996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700100 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700104 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700107 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700110 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700113 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700116 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700118 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700121 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700124 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700126 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700129 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700131 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700134 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700137 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700139 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700142 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700145 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700147 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700150 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700152 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:38:53.705456 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700155 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700158 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700160 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700163 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700165 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700168 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700170 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700173 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700177 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700180 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700188 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700191 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700194 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700197 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.700202 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:38:53.706034 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700345 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700351 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700354 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700357 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700360 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700363 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700366 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700369 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700371 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700374 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700377 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700379 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700382 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700384 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700387 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700389 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700392 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700395 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700398 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700401 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:38:53.706451 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700404 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700406 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700409 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700411 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700414 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700417 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700419 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700423 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700434 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700438 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700441 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700444 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700447 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700450 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700452 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700455 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700458 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700460 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:38:53.706999 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700464 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700467 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700470 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700473 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700476 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700479 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700481 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700484 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700487 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700490 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700492 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700495 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700498 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700501 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700504 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700506 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700509 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700511 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700514 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700516 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:38:53.707430 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700519 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700522 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700525 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700533 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700536 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700539 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700541 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700544 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700546 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700549 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700565 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700568 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700571 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700573 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700576 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700578 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700581 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700584 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700586 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700589 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:38:53.707933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700591 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700594 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700596 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700599 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700601 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700604 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700606 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700609 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700612 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700614 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700617 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700619 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700622 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700624 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700627 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700629 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700638 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700640 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700643 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700646 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:38:53.708412 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:53.700648 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:38:53.709104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.700653 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:38:53.709104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.700786 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:38:53.709104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.702889 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:38:53.709104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.704232 2563 server.go:1019] "Starting client certificate rotation" Jun 11 16:38:53.709104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.704338 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:38:53.709104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.704369 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:38:53.709104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.706749 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:38:53.711793 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.711768 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:38:53.722825 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.722804 2563 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:38:53.725417 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.725384 2563 log.go:25] "Validated CRI v1 image API" Jun 11 16:38:53.726302 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.726284 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:38:53.730136 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.730114 2563 fs.go:135] Filesystem UUIDs: map[05e4f371-d4cc-412c-81bf-3378d8b266c1:/dev/nvme0n1p4 1e9762a4-d092-40b1-969b-3d2a73df68da:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 16:38:53.730207 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.730133 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:38:53.731306 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.731290 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:38:53.735834 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.735714 2563 manager.go:216] Machine: {Timestamp:2026-06-11 16:38:53.734394858 +0000 UTC m=+0.335389610 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098462 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c8e0b8eaf4d9e5794474c4d6e5b2f SystemUUID:ec2c8e0b-8eaf-4d9e-5794-474c4d6e5b2f BootID:b4a90752-2348-46ad-8198-2fd7c3f2ea48 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:3f:fd:22:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:3f:fd:22:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:41:c2:e6:25:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:38:53.735834 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.735832 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:38:53.736134 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.735991 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:38:53.739727 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.739696 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:38:53.739898 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.739729 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:38:53.740420 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.740410 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:38:53.740459 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.740423 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:38:53.740459 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.740430 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:38:53.741056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.741044 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:38:53.741844 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.741833 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:38:53.744684 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.744671 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:38:53.744818 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.744808 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:38:53.744864 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.744839 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:38:53.744864 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.744857 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:38:53.744934 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.744872 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:38:53.744934 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.744882 2563 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:38:53.744934 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.744891 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:38:53.745336 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.745324 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:38:53.745368 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.745342 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:38:53.747506 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.747478 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:38:53.748907 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.748892 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:38:53.748959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.748923 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:38:53.749055 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.749039 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jb5rl" Jun 11 16:38:53.750819 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750805 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:38:53.750860 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750826 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:38:53.750860 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750832 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:38:53.750860 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750839 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:38:53.750860 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750847 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:38:53.750860 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750856 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:38:53.751003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750864 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:38:53.751003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750870 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:38:53.751003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750877 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:38:53.751003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750882 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:38:53.751003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750897 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:38:53.751003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.750902 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:38:53.752516 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.752503 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:38:53.752516 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.752514 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:38:53.755936 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.755912 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:38:53.756018 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.755944 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:38:53.756065 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.756009 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:38:53.756577 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.756547 2563 server.go:1268] "Started kubelet" Jun 11 16:38:53.756666 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.756641 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:38:53.756767 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.756719 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:38:53.756807 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.756791 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:38:53.757125 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.757108 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jb5rl" Jun 11 16:38:53.758412 ip-10-0-139-153 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:38:53.758953 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.758838 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:38:53.759673 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.759658 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:38:53.763619 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.762618 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-153.ec2.internal.18b81443baed45b6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-153.ec2.internal,UID:ip-10-0-139-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-153.ec2.internal,},FirstTimestamp:2026-06-11 16:38:53.756507574 +0000 UTC m=+0.357502321,LastTimestamp:2026-06-11 16:38:53.756507574 +0000 UTC m=+0.357502321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-153.ec2.internal,}" Jun 11 16:38:53.764116 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.764094 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:38:53.765690 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.765668 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:38:53.765690 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.765679 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:38:53.765849 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.765783 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:53.766583 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.766564 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:38:53.766583 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.766566 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:38:53.766720 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.766592 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:38:53.766720 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.766667 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:38:53.766720 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.766674 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:38:53.767511 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.767497 2563 factory.go:55] Registering systemd factory Jun 11 16:38:53.767511 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.767512 2563 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:38:53.767738 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.767726 2563 factory.go:153] Registering CRI-O factory Jun 11 16:38:53.767785 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.767741 2563 factory.go:223] Registration of the crio container factory successfully Jun 11 16:38:53.767785 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.767782 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:38:53.767879 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.767810 2563 factory.go:103] Registering Raw factory Jun 11 16:38:53.767879 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.767823 2563 manager.go:1196] Started watching for new ooms in manager Jun 11 16:38:53.768195 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.768184 2563 manager.go:349] Starting recovery of all containers Jun 11 16:38:53.774296 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.774267 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:38:53.777165 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.777129 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-153.ec2.internal\" not found" node="ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.779029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.779005 2563 manager.go:354] Recovery completed Jun 11 16:38:53.781346 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.781326 2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 16:38:53.784386 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.784371 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:38:53.786371 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.786355 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:38:53.786426 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.786389 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:38:53.786426 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.786403 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:38:53.787132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.787115 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:38:53.787132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.787130 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:38:53.787273 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.787130 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:38:53.787273 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.787170 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:38:53.787959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.787942 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:38:53.788022 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.787971 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:38:53.788022 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.787981 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:38:53.788419 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.788406 2563 policy_none.go:49] "None policy: Start" Jun 11 16:38:53.788457 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.788424 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:38:53.788457 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.788434 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:38:53.789333 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.789323 2563 policy_none.go:47] "Start" Jun 11 16:38:53.825321 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.825299 2563 manager.go:337] "Starting Device Plugin manager" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.825410 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.825427 2563 server.go:87] "Starting device plugin registration server" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.825697 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.825708 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.825821 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.825934 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.825957 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.826538 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:38:53.834268 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.826600 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:53.834609 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.834580 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:38:53.835887 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.835871 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:38:53.835949 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.835908 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:38:53.835949 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.835932 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:38:53.836031 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.835966 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:38:53.837676 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.837658 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:38:53.926803 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.926753 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:38:53.942925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.942859 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal"] Jun 11 16:38:53.943022 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.942947 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:38:53.943764 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.943736 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:38:53.943848 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.943784 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:38:53.943848 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.943796 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:38:53.943848 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.943819 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.959650 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.959630 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.959733 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.959654 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-153.ec2.internal\": node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:53.960042 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.960025 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:38:53.960094 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.960054 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:38:53.960094 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.960064 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:38:53.961396 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.961383 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:38:53.961485 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.961472 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.961527 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.961503 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:38:53.962196 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.962179 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:38:53.962259 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.962207 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:38:53.962259 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.962217 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:38:53.962319 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.962180 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:38:53.962319 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.962282 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:38:53.962319 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.962292 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:38:53.963284 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.963272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.963332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.963297 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:38:53.970690 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.970661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fb875483a20c027c41d176967857d76-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"1fb875483a20c027c41d176967857d76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.970812 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.970773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fb875483a20c027c41d176967857d76-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"1fb875483a20c027c41d176967857d76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.970876 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.970813 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fd1671d92e37017c08f53f45fd2b754-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"1fd1671d92e37017c08f53f45fd2b754\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.971393 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.971375 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:38:53.971474 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.971404 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:38:53.971474 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:53.971416 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:38:53.981308 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.981283 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-153.ec2.internal\" not found" node="ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.987685 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.987667 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-153.ec2.internal\" not found" node="ip-10-0-139-153.ec2.internal" Jun 11 16:38:53.989312 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:53.989297 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:54.071931 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.071897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fb875483a20c027c41d176967857d76-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"1fb875483a20c027c41d176967857d76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.071931 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.071931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fb875483a20c027c41d176967857d76-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"1fb875483a20c027c41d176967857d76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.072086 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.071949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fd1671d92e37017c08f53f45fd2b754-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"1fd1671d92e37017c08f53f45fd2b754\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.072086 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.071981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fb875483a20c027c41d176967857d76-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"1fb875483a20c027c41d176967857d76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.072086 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.071982 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fb875483a20c027c41d176967857d76-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"1fb875483a20c027c41d176967857d76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.072086 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.072008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fd1671d92e37017c08f53f45fd2b754-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"1fd1671d92e37017c08f53f45fd2b754\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.089381 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.089349 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:54.190119 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.190073 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:54.284989 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.284919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.290199 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.290173 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:54.292342 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.292328 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.390629 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.390589 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:54.491111 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.491074 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jun 11 16:38:54.577538 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.577461 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:38:54.665892 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.665844 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.676046 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.676024 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:38:54.677626 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.677613 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jun 11 16:38:54.689759 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.689730 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:38:54.703807 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.703771 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:38:54.703957 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.703904 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:38:54.704013 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.703945 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:38:54.704013 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.703964 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:38:54.745054 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.745017 2563 apiserver.go:52] "Watching apiserver" Jun 11 16:38:54.764044 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.763966 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:33:53 +0000 UTC" deadline="2027-12-11 14:04:03.919929466 +0000 UTC" Jun 11 16:38:54.764044 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.764032 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13149h25m9.15590224s" Jun 11 16:38:54.764229 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.764210 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:38:54.764919 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.764680 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-dp98m","kube-system/global-pull-secret-syncer-58rw9","kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc","openshift-cluster-node-tuning-operator/tuned-2tnnf","openshift-image-registry/node-ca-qrnh6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal","openshift-multus/network-metrics-daemon-wzjhm","openshift-ovn-kubernetes/ovnkube-node-rrggx","kube-system/konnectivity-agent-tsm7v","openshift-dns/node-resolver-f5q98","openshift-multus/multus-additional-cni-plugins-ws9fh","openshift-multus/multus-tcwc7","openshift-network-diagnostics/network-check-target-r9skm"] Jun 11 16:38:54.766120 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.766100 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:38:54.766235 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.766218 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.767330 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.767310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.768781 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.768760 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.768893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.768848 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sjcfz\"" Jun 11 16:38:54.768951 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.768937 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:38:54.769071 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.769051 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:38:54.769496 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.769482 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:38:54.769904 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.769887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.770143 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.770125 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6hgqk\"" Jun 11 16:38:54.770214 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.770172 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:38:54.770271 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.770252 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:38:54.770973 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.770953 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:38:54.771108 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.771084 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.771709 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.771690 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:38:54.771797 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.771710 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:38:54.772294 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.772280 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.772696 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.772669 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:38:54.772776 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.772717 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:38:54.772829 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.772791 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:38:54.772829 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.772824 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:38:54.772916 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.772836 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:38:54.772916 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.772897 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vfgqs\"" Jun 11 16:38:54.773052 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.773029 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:38:54.773146 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.773127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sv2pd\"" Jun 11 16:38:54.773317 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.773281 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:38:54.773467 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.773450 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cqwqz\"" Jun 11 16:38:54.773567 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.773543 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:54.773626 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.773608 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:38:54.773861 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.773847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:38:54.774607 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.774593 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:38:54.774811 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.774798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:54.775368 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.775351 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kcrdc\"" Jun 11 16:38:54.775446 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.775355 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:38:54.775536 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.775506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:38:54.776048 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.776032 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.776127 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.776095 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:38:54.776175 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.776136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-hosts-file\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.776175 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.776163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-tmp-dir\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.776244 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.776192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36efabf0-29c3-4759-aada-a562e5a90d2d-iptables-alerter-script\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.776244 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.776215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blpx9\" (UniqueName: \"kubernetes.io/projected/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-kube-api-access-blpx9\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.776309 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.776247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36efabf0-29c3-4759-aada-a562e5a90d2d-host-slash\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.776309 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.776264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf7bd\" (UniqueName: \"kubernetes.io/projected/36efabf0-29c3-4759-aada-a562e5a90d2d-kube-api-access-sf7bd\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.777515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.777499 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.778598 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.778580 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9lqf7\"" Jun 11 16:38:54.778778 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.778741 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:38:54.778958 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.778945 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:38:54.779300 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.779284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.780366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.780353 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:54.780453 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.780413 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:38:54.781187 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.781002 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:38:54.781242 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.781208 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:38:54.781371 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.781356 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:38:54.781485 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.781465 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:38:54.782278 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.782264 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:38:54.782691 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.782675 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nbhxt\"" Jun 11 16:38:54.783132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.783117 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:38:54.783637 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.783623 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:38:54.783706 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.783649 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mfmrm\"" Jun 11 16:38:54.825821 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.825798 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rwf4s" Jun 11 16:38:54.834016 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:54.833939 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd1671d92e37017c08f53f45fd2b754.slice/crio-9f8b70183964a785d0dc49ab41b8a27bc733ac8c31e51b1a4d44eac7ce49b3b5 WatchSource:0}: Error finding container 9f8b70183964a785d0dc49ab41b8a27bc733ac8c31e51b1a4d44eac7ce49b3b5: Status 404 returned error can't find the container with id 9f8b70183964a785d0dc49ab41b8a27bc733ac8c31e51b1a4d44eac7ce49b3b5 Jun 11 16:38:54.834209 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:54.834185 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb875483a20c027c41d176967857d76.slice/crio-41e5a9da59d556d8a97c3de828b49c0081f4b4da75ccb7aa7cdb4eb0d3658df5 WatchSource:0}: Error finding container 41e5a9da59d556d8a97c3de828b49c0081f4b4da75ccb7aa7cdb4eb0d3658df5: Status 404 returned error can't find the container with id 41e5a9da59d556d8a97c3de828b49c0081f4b4da75ccb7aa7cdb4eb0d3658df5 Jun 11 16:38:54.840095 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.840016 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rwf4s" Jun 11 16:38:54.840435 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.840417 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:38:54.867566 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.867398 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:38:54.876899 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.876875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysconfig\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.877015 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.876906 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.877015 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.876924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.877015 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.876952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpx9\" (UniqueName: \"kubernetes.io/projected/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-kube-api-access-blpx9\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.877015 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.876987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rn8c\" (UniqueName: \"kubernetes.io/projected/8f2d97fb-3a1e-4579-b688-c0482c44950e-kube-api-access-8rn8c\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.877015 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cnibin\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.877181 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9pxc\" (UniqueName: \"kubernetes.io/projected/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-kube-api-access-f9pxc\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.877181 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-var-lib-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.877181 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-log-socket\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.877181 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-ovnkube-script-lib\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.877181 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-sys-fs\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.877335 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4251613-305b-4630-9ce2-ebb8da165130-agent-certs\") pod \"konnectivity-agent-tsm7v\" (UID: \"c4251613-305b-4630-9ce2-ebb8da165130\") " pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:54.877335 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-hosts-file\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.877335 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-sys\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.877335 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-kubelet-config\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.877335 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-os-release\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-hosts-file\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-cni-binary-copy\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-tuned\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/264a2815-ab69-40c7-bf06-7df68cd63369-serviceca\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6csd4\" (UniqueName: \"kubernetes.io/projected/264a2815-ab69-40c7-bf06-7df68cd63369-kube-api-access-6csd4\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cni-binary-copy\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.877488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-slash\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5v4p\" (UniqueName: \"kubernetes.io/projected/8448238a-4a3b-415c-b1e4-8cdb614b1edb-kube-api-access-n5v4p\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-hostroot\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-daemon-config\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-ovn\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-node-log\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-socket-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36efabf0-29c3-4759-aada-a562e5a90d2d-iptables-alerter-script\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-kubernetes\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-ovnkube-config\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysctl-d\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-dbus\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/264a2815-ab69-40c7-bf06-7df68cd63369-host\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.877766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-cni-netd\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-etc-selinux\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-cnibin\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-run\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-host\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-socket-dir-parent\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-cni-bin\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xq4\" (UniqueName: \"kubernetes.io/projected/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-kube-api-access-f2xq4\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.877995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-device-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-k8s-cni-cncf-io\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4251613-305b-4630-9ce2-ebb8da165130-konnectivity-ca\") pod \"konnectivity-agent-tsm7v\" (UID: \"c4251613-305b-4630-9ce2-ebb8da165130\") " pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7bd\" (UniqueName: \"kubernetes.io/projected/36efabf0-29c3-4759-aada-a562e5a90d2d-kube-api-access-sf7bd\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-tmp-dir\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-systemd\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36efabf0-29c3-4759-aada-a562e5a90d2d-iptables-alerter-script\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-lib-modules\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.878366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-run-netns\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-cni-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysctl-conf\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878426 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-tmp-dir\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-system-cni-dir\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-kubelet\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-os-release\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-netns\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-var-lib-kubelet\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-cni-bin\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-conf-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-etc-kubernetes\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-modprobe-d\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-systemd\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.878893 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03728cf9-60c2-4c26-836d-95161beae495-ovn-node-metrics-cert\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-cni-multus\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-multus-certs\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36efabf0-29c3-4759-aada-a562e5a90d2d-host-slash\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878868 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-systemd-units\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-etc-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878892 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36efabf0-29c3-4759-aada-a562e5a90d2d-host-slash\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-env-overrides\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-registration-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-kubelet\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f2d97fb-3a1e-4579-b688-c0482c44950e-tmp\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.878979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.879004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh8f6\" (UniqueName: \"kubernetes.io/projected/03728cf9-60c2-4c26-836d-95161beae495-kube-api-access-qh8f6\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.879027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4mvg\" (UniqueName: \"kubernetes.io/projected/30b97202-43bd-411e-b244-7f45861d6056-kube-api-access-s4mvg\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.879043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-system-cni-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.879390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.879057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:54.884584 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.884544 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:38:54.887528 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.887501 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf7bd\" (UniqueName: \"kubernetes.io/projected/36efabf0-29c3-4759-aada-a562e5a90d2d-kube-api-access-sf7bd\") pod \"iptables-alerter-dp98m\" (UID: \"36efabf0-29c3-4759-aada-a562e5a90d2d\") " pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:54.887664 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.887509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpx9\" (UniqueName: \"kubernetes.io/projected/560bde2b-8d7e-4033-b1ec-4b635da8dc3a-kube-api-access-blpx9\") pod \"node-resolver-f5q98\" (UID: \"560bde2b-8d7e-4033-b1ec-4b635da8dc3a\") " pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:54.980337 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-kubelet-config\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.980337 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-os-release\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-cni-binary-copy\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-tuned\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-kubelet-config\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/264a2815-ab69-40c7-bf06-7df68cd63369-serviceca\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6csd4\" (UniqueName: \"kubernetes.io/projected/264a2815-ab69-40c7-bf06-7df68cd63369-kube-api-access-6csd4\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.980521 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cni-binary-copy\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980467 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-os-release\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.980576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-slash\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-slash\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.980613 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:38:55.48059363 +0000 UTC m=+2.081588384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5v4p\" (UniqueName: \"kubernetes.io/projected/8448238a-4a3b-415c-b1e4-8cdb614b1edb-kube-api-access-n5v4p\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-hostroot\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-daemon-config\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-ovn\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-node-log\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-hostroot\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980832 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-node-log\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-ovn\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980925 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-socket-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-kubernetes\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.980979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-ovnkube-config\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysctl-d\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-dbus\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.981056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/264a2815-ab69-40c7-bf06-7df68cd63369-host\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981065 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/264a2815-ab69-40c7-bf06-7df68cd63369-serviceca\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-cni-netd\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-cni-netd\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-etc-selinux\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-cnibin\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-cni-binary-copy\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-run\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-daemon-config\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-host\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-socket-dir-parent\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981221 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cni-binary-copy\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/264a2815-ab69-40c7-bf06-7df68cd63369-host\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysctl-d\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-cni-bin\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-dbus\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-etc-selinux\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981293 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-cni-bin\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.981836 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981303 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-host\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981309 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-socket-dir-parent\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-socket-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xq4\" (UniqueName: \"kubernetes.io/projected/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-kube-api-access-f2xq4\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-cnibin\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-run\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-kubernetes\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-device-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-k8s-cni-cncf-io\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4251613-305b-4630-9ce2-ebb8da165130-konnectivity-ca\") pod \"konnectivity-agent-tsm7v\" (UID: \"c4251613-305b-4630-9ce2-ebb8da165130\") " pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981503 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-k8s-cni-cncf-io\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-device-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-systemd\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-lib-modules\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-run-netns\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.982635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981592 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-systemd\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-cni-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysctl-conf\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-run-netns\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-lib-modules\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-system-cni-dir\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-kubelet\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-os-release\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981757 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-kubelet\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-netns\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981757 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-system-cni-dir\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-cni-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981787 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysctl-conf\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-netns\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-os-release\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-var-lib-kubelet\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983401 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981829 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-var-lib-kubelet\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-cni-bin\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-conf-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-cni-bin\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-etc-kubernetes\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-multus-conf-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-modprobe-d\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981962 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-etc-kubernetes\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.981994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-systemd\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-modprobe-d\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03728cf9-60c2-4c26-836d-95161beae495-ovn-node-metrics-cert\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4251613-305b-4630-9ce2-ebb8da165130-konnectivity-ca\") pod \"konnectivity-agent-tsm7v\" (UID: \"c4251613-305b-4630-9ce2-ebb8da165130\") " pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-systemd\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982084 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-run-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982124 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-cni-multus\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-multus-certs\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.983992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-cni-multus\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-systemd-units\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-etc-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-env-overrides\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-ovnkube-config\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982252 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-systemd-units\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-registration-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982221 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-run-multus-certs\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-kubelet\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-etc-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f2d97fb-3a1e-4579-b688-c0482c44950e-tmp\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982389 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-registration-dir\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982426 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-host-var-lib-kubelet\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh8f6\" (UniqueName: \"kubernetes.io/projected/03728cf9-60c2-4c26-836d-95161beae495-kube-api-access-qh8f6\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4mvg\" (UniqueName: \"kubernetes.io/projected/30b97202-43bd-411e-b244-7f45861d6056-kube-api-access-s4mvg\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:54.984611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-system-cni-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysconfig\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-host-run-ovn-kubernetes\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rn8c\" (UniqueName: \"kubernetes.io/projected/8f2d97fb-3a1e-4579-b688-c0482c44950e-kube-api-access-8rn8c\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cnibin\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9pxc\" (UniqueName: \"kubernetes.io/projected/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-kube-api-access-f9pxc\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982804 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-var-lib-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982847 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-log-socket\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-ovnkube-script-lib\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-sys-fs\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4251613-305b-4630-9ce2-ebb8da165130-agent-certs\") pod \"konnectivity-agent-tsm7v\" (UID: \"c4251613-305b-4630-9ce2-ebb8da165130\") " pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-sys\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.985430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-sysconfig\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983052 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cnibin\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-log-socket\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983223 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f2d97fb-3a1e-4579-b688-c0482c44950e-etc-tuned\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983233 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2d97fb-3a1e-4579-b688-c0482c44950e-sys\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.983279 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.983330 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret podName:c7aea5eb-069b-4c6c-9d7e-8dd28a249c35 nodeName:}" failed. No retries permitted until 2026-06-11 16:38:55.483311264 +0000 UTC m=+2.084306001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret") pod "global-pull-secret-syncer-58rw9" (UID: "c7aea5eb-069b-4c6c-9d7e-8dd28a249c35") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8448238a-4a3b-415c-b1e4-8cdb614b1edb-sys-fs\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03728cf9-60c2-4c26-836d-95161beae495-var-lib-openvswitch\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.982633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-env-overrides\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983445 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-system-cni-dir\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.983580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03728cf9-60c2-4c26-836d-95161beae495-ovnkube-script-lib\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.984635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03728cf9-60c2-4c26-836d-95161beae495-ovn-node-metrics-cert\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.985348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4251613-305b-4630-9ce2-ebb8da165130-agent-certs\") pod \"konnectivity-agent-tsm7v\" (UID: \"c4251613-305b-4630-9ce2-ebb8da165130\") " pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:54.985927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.985387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f2d97fb-3a1e-4579-b688-c0482c44950e-tmp\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.995455 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.995430 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:38:54.995993 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.995744 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:38:54.995993 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.995766 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zlqz6 for pod openshift-network-diagnostics/network-check-target-r9skm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:54.995993 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:54.995832 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6 podName:4b89f495-93bd-4c66-9ae8-4199c9bfa39f nodeName:}" failed. No retries permitted until 2026-06-11 16:38:55.495813441 +0000 UTC m=+2.096808194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zlqz6" (UniqueName: "kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6") pod "network-check-target-r9skm" (UID: "4b89f495-93bd-4c66-9ae8-4199c9bfa39f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:54.996853 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.996826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5v4p\" (UniqueName: \"kubernetes.io/projected/8448238a-4a3b-415c-b1e4-8cdb614b1edb-kube-api-access-n5v4p\") pod \"aws-ebs-csi-driver-node-ndjdc\" (UID: \"8448238a-4a3b-415c-b1e4-8cdb614b1edb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:54.997484 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.997456 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9pxc\" (UniqueName: \"kubernetes.io/projected/c9bd5f50-097b-4bc7-8ffd-d316c446e37b-kube-api-access-f9pxc\") pod \"multus-additional-cni-plugins-ws9fh\" (UID: \"c9bd5f50-097b-4bc7-8ffd-d316c446e37b\") " pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:54.997484 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.997473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh8f6\" (UniqueName: \"kubernetes.io/projected/03728cf9-60c2-4c26-836d-95161beae495-kube-api-access-qh8f6\") pod \"ovnkube-node-rrggx\" (UID: \"03728cf9-60c2-4c26-836d-95161beae495\") " pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:54.997642 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.997544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6csd4\" (UniqueName: \"kubernetes.io/projected/264a2815-ab69-40c7-bf06-7df68cd63369-kube-api-access-6csd4\") pod \"node-ca-qrnh6\" (UID: \"264a2815-ab69-40c7-bf06-7df68cd63369\") " pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:54.997642 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.997586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4mvg\" (UniqueName: \"kubernetes.io/projected/30b97202-43bd-411e-b244-7f45861d6056-kube-api-access-s4mvg\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:54.997971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.997953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rn8c\" (UniqueName: \"kubernetes.io/projected/8f2d97fb-3a1e-4579-b688-c0482c44950e-kube-api-access-8rn8c\") pod \"tuned-2tnnf\" (UID: \"8f2d97fb-3a1e-4579-b688-c0482c44950e\") " pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:54.998027 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:54.997975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xq4\" (UniqueName: \"kubernetes.io/projected/fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7-kube-api-access-f2xq4\") pod \"multus-tcwc7\" (UID: \"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7\") " pod="openshift-multus/multus-tcwc7" Jun 11 16:38:55.016099 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.016063 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:38:55.095763 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.095675 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dp98m" Jun 11 16:38:55.101156 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.101137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5q98" Jun 11 16:38:55.104095 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.104068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36efabf0_29c3_4759_aada_a562e5a90d2d.slice/crio-855c09afb7476ef7795b5be75a127802253327453f98e1789e87b15f4ca31c49 WatchSource:0}: Error finding container 855c09afb7476ef7795b5be75a127802253327453f98e1789e87b15f4ca31c49: Status 404 returned error can't find the container with id 855c09afb7476ef7795b5be75a127802253327453f98e1789e87b15f4ca31c49 Jun 11 16:38:55.108295 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.108267 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560bde2b_8d7e_4033_b1ec_4b635da8dc3a.slice/crio-9647fd866db54dff30a6abf473df43b3e6382c38f85c56532ecfd017b07f2a77 WatchSource:0}: Error finding container 9647fd866db54dff30a6abf473df43b3e6382c38f85c56532ecfd017b07f2a77: Status 404 returned error can't find the container with id 9647fd866db54dff30a6abf473df43b3e6382c38f85c56532ecfd017b07f2a77 Jun 11 16:38:55.136707 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.136674 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:38:55.141300 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.141270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" Jun 11 16:38:55.147520 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.147495 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" Jun 11 16:38:55.148616 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.148590 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03728cf9_60c2_4c26_836d_95161beae495.slice/crio-eda9fae89f767454c0a8f3f6a6488a724a032920b8dcd82a7386528044c9c989 WatchSource:0}: Error finding container eda9fae89f767454c0a8f3f6a6488a724a032920b8dcd82a7386528044c9c989: Status 404 returned error can't find the container with id eda9fae89f767454c0a8f3f6a6488a724a032920b8dcd82a7386528044c9c989 Jun 11 16:38:55.151405 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.151384 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8448238a_4a3b_415c_b1e4_8cdb614b1edb.slice/crio-10a0e9f18abcc2b62ec5f9da5792a0aa8ed6a0da531b10be9e0fd3d2af3224d5 WatchSource:0}: Error finding container 10a0e9f18abcc2b62ec5f9da5792a0aa8ed6a0da531b10be9e0fd3d2af3224d5: Status 404 returned error can't find the container with id 10a0e9f18abcc2b62ec5f9da5792a0aa8ed6a0da531b10be9e0fd3d2af3224d5 Jun 11 16:38:55.153322 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.153299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrnh6" Jun 11 16:38:55.155434 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.155405 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2d97fb_3a1e_4579_b688_c0482c44950e.slice/crio-625fe8213db8df619e5dff56dc22c2bc6b684eb939fe8de38e039162fedc9b9c WatchSource:0}: Error finding container 625fe8213db8df619e5dff56dc22c2bc6b684eb939fe8de38e039162fedc9b9c: Status 404 returned error can't find the container with id 625fe8213db8df619e5dff56dc22c2bc6b684eb939fe8de38e039162fedc9b9c Jun 11 16:38:55.160055 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.160028 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:38:55.160678 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.160656 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264a2815_ab69_40c7_bf06_7df68cd63369.slice/crio-d6955ed33510c41ec0fa01a28d89e812cd55c30ee391ec980b9cf8f77503c71e WatchSource:0}: Error finding container d6955ed33510c41ec0fa01a28d89e812cd55c30ee391ec980b9cf8f77503c71e: Status 404 returned error can't find the container with id d6955ed33510c41ec0fa01a28d89e812cd55c30ee391ec980b9cf8f77503c71e Jun 11 16:38:55.164648 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.164631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" Jun 11 16:38:55.168022 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.168000 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4251613_305b_4630_9ce2_ebb8da165130.slice/crio-b19a6e66a9880b0b75eb2956cf3a317a08cc045811a6f782e795728b6912175d WatchSource:0}: Error finding container b19a6e66a9880b0b75eb2956cf3a317a08cc045811a6f782e795728b6912175d: Status 404 returned error can't find the container with id b19a6e66a9880b0b75eb2956cf3a317a08cc045811a6f782e795728b6912175d Jun 11 16:38:55.168820 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.168801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tcwc7" Jun 11 16:38:55.172781 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.172757 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9bd5f50_097b_4bc7_8ffd_d316c446e37b.slice/crio-f1dfbc7f76ff0359c7105c4a36d8542b66b0e635e7200d7963a06cc69aecdb23 WatchSource:0}: Error finding container f1dfbc7f76ff0359c7105c4a36d8542b66b0e635e7200d7963a06cc69aecdb23: Status 404 returned error can't find the container with id f1dfbc7f76ff0359c7105c4a36d8542b66b0e635e7200d7963a06cc69aecdb23 Jun 11 16:38:55.177810 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:38:55.177787 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd1775b_2f6e_42a9_aa73_1e99b6a6a7f7.slice/crio-588a858ce0c87669f42a5a78d44c90e591f7d319a3ad258642515ec66b20dae1 WatchSource:0}: Error finding container 588a858ce0c87669f42a5a78d44c90e591f7d319a3ad258642515ec66b20dae1: Status 404 returned error can't find the container with id 588a858ce0c87669f42a5a78d44c90e591f7d319a3ad258642515ec66b20dae1 Jun 11 16:38:55.487337 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.487235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:55.487337 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.487289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:55.487574 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.487421 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:55.487574 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.487488 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:38:56.487469257 +0000 UTC m=+3.088464014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:55.487574 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.487421 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:55.487742 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.487602 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret podName:c7aea5eb-069b-4c6c-9d7e-8dd28a249c35 nodeName:}" failed. No retries permitted until 2026-06-11 16:38:56.487532998 +0000 UTC m=+3.088527736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret") pod "global-pull-secret-syncer-58rw9" (UID: "c7aea5eb-069b-4c6c-9d7e-8dd28a249c35") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:55.588504 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.588464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:55.588700 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.588680 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:38:55.588796 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.588702 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:38:55.588796 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.588715 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zlqz6 for pod openshift-network-diagnostics/network-check-target-r9skm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:55.588796 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:55.588776 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6 podName:4b89f495-93bd-4c66-9ae8-4199c9bfa39f nodeName:}" failed. No retries permitted until 2026-06-11 16:38:56.588755771 +0000 UTC m=+3.189750506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zlqz6" (UniqueName: "kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6") pod "network-check-target-r9skm" (UID: "4b89f495-93bd-4c66-9ae8-4199c9bfa39f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:55.809988 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.809897 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:38:55.843126 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.843087 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:33:54 +0000 UTC" deadline="2028-01-11 03:51:40.882023277 +0000 UTC" Jun 11 16:38:55.843126 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.843123 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13883h12m45.038904395s" Jun 11 16:38:55.861830 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.861772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsm7v" event={"ID":"c4251613-305b-4630-9ce2-ebb8da165130","Type":"ContainerStarted","Data":"b19a6e66a9880b0b75eb2956cf3a317a08cc045811a6f782e795728b6912175d"} Jun 11 16:38:55.870713 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.870359 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrnh6" event={"ID":"264a2815-ab69-40c7-bf06-7df68cd63369","Type":"ContainerStarted","Data":"d6955ed33510c41ec0fa01a28d89e812cd55c30ee391ec980b9cf8f77503c71e"} Jun 11 16:38:55.878249 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.877880 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" event={"ID":"8f2d97fb-3a1e-4579-b688-c0482c44950e","Type":"ContainerStarted","Data":"625fe8213db8df619e5dff56dc22c2bc6b684eb939fe8de38e039162fedc9b9c"} Jun 11 16:38:55.894598 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.894512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" event={"ID":"8448238a-4a3b-415c-b1e4-8cdb614b1edb","Type":"ContainerStarted","Data":"10a0e9f18abcc2b62ec5f9da5792a0aa8ed6a0da531b10be9e0fd3d2af3224d5"} Jun 11 16:38:55.899325 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.899178 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"eda9fae89f767454c0a8f3f6a6488a724a032920b8dcd82a7386528044c9c989"} Jun 11 16:38:55.901216 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.901165 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" event={"ID":"1fd1671d92e37017c08f53f45fd2b754","Type":"ContainerStarted","Data":"9f8b70183964a785d0dc49ab41b8a27bc733ac8c31e51b1a4d44eac7ce49b3b5"} Jun 11 16:38:55.916684 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.914463 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tcwc7" event={"ID":"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7","Type":"ContainerStarted","Data":"588a858ce0c87669f42a5a78d44c90e591f7d319a3ad258642515ec66b20dae1"} Jun 11 16:38:55.926357 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.926256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerStarted","Data":"f1dfbc7f76ff0359c7105c4a36d8542b66b0e635e7200d7963a06cc69aecdb23"} Jun 11 16:38:55.939986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.939931 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5q98" event={"ID":"560bde2b-8d7e-4033-b1ec-4b635da8dc3a","Type":"ContainerStarted","Data":"9647fd866db54dff30a6abf473df43b3e6382c38f85c56532ecfd017b07f2a77"} Jun 11 16:38:55.961047 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.961003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dp98m" event={"ID":"36efabf0-29c3-4759-aada-a562e5a90d2d","Type":"ContainerStarted","Data":"855c09afb7476ef7795b5be75a127802253327453f98e1789e87b15f4ca31c49"} Jun 11 16:38:55.980058 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:55.980008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"1fb875483a20c027c41d176967857d76","Type":"ContainerStarted","Data":"41e5a9da59d556d8a97c3de828b49c0081f4b4da75ccb7aa7cdb4eb0d3658df5"} Jun 11 16:38:56.279913 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.279823 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:38:56.495998 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.495888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:56.495998 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.495944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:56.496238 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.496083 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:56.496238 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.496146 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:38:58.496126757 +0000 UTC m=+5.097121497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:56.496685 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.496587 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:56.496685 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.496642 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret podName:c7aea5eb-069b-4c6c-9d7e-8dd28a249c35 nodeName:}" failed. No retries permitted until 2026-06-11 16:38:58.496626543 +0000 UTC m=+5.097621277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret") pod "global-pull-secret-syncer-58rw9" (UID: "c7aea5eb-069b-4c6c-9d7e-8dd28a249c35") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:56.597268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.597180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:56.597440 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.597400 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:38:56.597440 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.597423 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:38:56.597440 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.597437 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zlqz6 for pod openshift-network-diagnostics/network-check-target-r9skm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:56.597680 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.597500 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6 podName:4b89f495-93bd-4c66-9ae8-4199c9bfa39f nodeName:}" failed. No retries permitted until 2026-06-11 16:38:58.597480233 +0000 UTC m=+5.198474991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zlqz6" (UniqueName: "kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6") pod "network-check-target-r9skm" (UID: "4b89f495-93bd-4c66-9ae8-4199c9bfa39f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:56.837044 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.836987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:56.837499 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.837207 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:38:56.837640 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.837622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:56.837752 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.837718 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:38:56.837847 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.837833 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:56.837985 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:56.837931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:38:56.844238 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.844169 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:33:54 +0000 UTC" deadline="2028-02-10 20:05:58.313809849 +0000 UTC" Jun 11 16:38:56.844238 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:56.844221 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14619h27m1.469593307s" Jun 11 16:38:57.749898 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:57.749487 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:38:58.515215 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:58.514364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:58.515215 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:58.514422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:58.515215 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.514583 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:58.515215 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.514646 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:02.514626127 +0000 UTC m=+9.115620866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:38:58.515215 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.515029 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:58.515215 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.515081 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret podName:c7aea5eb-069b-4c6c-9d7e-8dd28a249c35 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:02.515064756 +0000 UTC m=+9.116059490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret") pod "global-pull-secret-syncer-58rw9" (UID: "c7aea5eb-069b-4c6c-9d7e-8dd28a249c35") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:38:58.615600 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:58.615545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:58.615823 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.615805 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:38:58.615892 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.615834 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:38:58.615892 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.615847 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zlqz6 for pod openshift-network-diagnostics/network-check-target-r9skm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:58.615993 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.615905 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6 podName:4b89f495-93bd-4c66-9ae8-4199c9bfa39f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:02.615887201 +0000 UTC m=+9.216881957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zlqz6" (UniqueName: "kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6") pod "network-check-target-r9skm" (UID: "4b89f495-93bd-4c66-9ae8-4199c9bfa39f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:38:58.836486 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:58.836408 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:38:58.836663 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.836546 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:38:58.837018 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:58.836995 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:38:58.837160 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.837124 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:38:58.837225 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:38:58.837175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:38:58.837275 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:38:58.837253 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:00.837196 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:00.836995 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:00.837196 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:00.837041 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:00.837196 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:00.837139 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:00.837813 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:00.837200 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:00.837813 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:00.837255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:00.837813 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:00.837438 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:02.548768 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:02.548647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:02.548768 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:02.548711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:02.549282 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.548821 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:39:02.549282 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.548848 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:39:02.549282 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.548899 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret podName:c7aea5eb-069b-4c6c-9d7e-8dd28a249c35 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:10.548876602 +0000 UTC m=+17.149871639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret") pod "global-pull-secret-syncer-58rw9" (UID: "c7aea5eb-069b-4c6c-9d7e-8dd28a249c35") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:39:02.549282 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.548921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:10.548910196 +0000 UTC m=+17.149904933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:39:02.649437 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:02.649326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:02.649637 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.649481 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:39:02.649637 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.649497 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:39:02.649637 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.649510 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zlqz6 for pod openshift-network-diagnostics/network-check-target-r9skm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:39:02.649637 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.649586 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6 podName:4b89f495-93bd-4c66-9ae8-4199c9bfa39f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:10.649568168 +0000 UTC m=+17.250562916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zlqz6" (UniqueName: "kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6") pod "network-check-target-r9skm" (UID: "4b89f495-93bd-4c66-9ae8-4199c9bfa39f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:39:02.836818 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:02.836730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:02.836984 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.836878 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:02.837326 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:02.837307 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:02.837589 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.837418 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:02.837589 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:02.837475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:02.837589 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:02.837539 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:04.837061 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:04.837003 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:04.837520 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:04.837133 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:04.837520 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:04.837150 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:04.837520 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:04.837170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:04.837520 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:04.837325 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:04.837520 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:04.837412 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:06.836133 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:06.836097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:06.836497 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:06.836140 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:06.836497 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:06.836219 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:06.836497 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:06.836262 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:06.836497 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:06.836297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:06.836497 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:06.836383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:08.836324 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:08.836290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:08.836762 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:08.836418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:08.836762 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:08.836426 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:08.836762 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:08.836437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:08.836762 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:08.836535 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:08.836762 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:08.836639 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:10.610643 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:10.610603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:10.611186 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:10.610660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:10.611186 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.610775 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:39:10.611186 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.610776 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:39:10.611186 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.610847 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:26.610827271 +0000 UTC m=+33.211822006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:39:10.611186 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.610866 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret podName:c7aea5eb-069b-4c6c-9d7e-8dd28a249c35 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:26.610857176 +0000 UTC m=+33.211851910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret") pod "global-pull-secret-syncer-58rw9" (UID: "c7aea5eb-069b-4c6c-9d7e-8dd28a249c35") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:39:10.711162 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:10.711110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:10.711349 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.711307 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:39:10.711349 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.711332 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:39:10.711450 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.711370 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zlqz6 for pod openshift-network-diagnostics/network-check-target-r9skm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:39:10.711495 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.711456 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6 podName:4b89f495-93bd-4c66-9ae8-4199c9bfa39f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:26.711434638 +0000 UTC m=+33.312429386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zlqz6" (UniqueName: "kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6") pod "network-check-target-r9skm" (UID: "4b89f495-93bd-4c66-9ae8-4199c9bfa39f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:39:10.836526 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:10.836489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:10.836728 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:10.836534 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:10.836728 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:10.836603 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:10.836728 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.836621 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:10.836728 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.836706 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:10.836925 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:10.836793 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:12.836383 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:12.836346 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:12.836383 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:12.836373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:12.837030 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:12.836491 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:12.837030 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:12.836549 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:12.837030 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:12.836685 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:12.837030 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:12.836782 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:14.836776 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:14.836707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:14.836776 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:14.836741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:14.837271 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:14.836835 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:14.837271 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:14.836898 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:14.837271 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:14.837032 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:14.837271 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:14.837131 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:16.022068 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.021727 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" event={"ID":"8f2d97fb-3a1e-4579-b688-c0482c44950e","Type":"ContainerStarted","Data":"e2959b78bb6dd73c522fd436949a89906fb1ed67d9049652b69ddf02dc2a4080"} Jun 11 16:39:16.025099 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:39:16.025441 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025416 2563 generic.go:356] "Generic (PLEG): container finished" podID="03728cf9-60c2-4c26-836d-95161beae495" containerID="c6cdaedd14862062bdaeffc72076b104f6c029aaeecf36cc6a9257e3ff738748" exitCode=1 Jun 11 16:39:16.025533 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"bdf6e9b04b62a73a3fb69539a582ba17fb377715bd7bafa7ccc516d949f0da45"} Jun 11 16:39:16.025612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"d5c5978ad65c99508f79b02850f9f5be1d4b06cbf4c1aeda1743b9c565bacfd6"} Jun 11 16:39:16.025612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"1c50dbd3a68d68d60faa7b107174e9c487e6f1162b2c1430fa0990bf90b7a785"} Jun 11 16:39:16.025718 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"ac41694f6824ef0a0f44013bc3cdc329df1fde69295e3f936a985a41eaacdddd"} Jun 11 16:39:16.025718 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025665 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerDied","Data":"c6cdaedd14862062bdaeffc72076b104f6c029aaeecf36cc6a9257e3ff738748"} Jun 11 16:39:16.025718 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.025695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"752be971decb15bbada544dc69f93232b64623f74aa0d10e131765b1a3911054"} Jun 11 16:39:16.027296 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.026952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" event={"ID":"1fd1671d92e37017c08f53f45fd2b754","Type":"ContainerStarted","Data":"229326ff5e725e3b4325bd7681de12d385c026952a3ab820e2d476ae27cae98a"} Jun 11 16:39:16.028808 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.028787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tcwc7" event={"ID":"fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7","Type":"ContainerStarted","Data":"627a2c91e36074f097a17f89887d079d395428d0aef558ed5d838e400fd8b16b"} Jun 11 16:39:16.038027 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.037940 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2tnnf" podStartSLOduration=2.854395371 podStartE2EDuration="23.037925635s" totalImagesPullingTime="20.183530264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:16.037812025 +0000 UTC m=+22.638806782" watchObservedRunningTime="2026-06-11 16:39:16.037925635 +0000 UTC m=+22.638920391" Jun 11 16:39:16.070254 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.070210 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tcwc7" podStartSLOduration=1.7083748010000002 podStartE2EDuration="22.070191462s" totalImagesPullingTime="20.361816661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:16.057154021 +0000 UTC m=+22.658148774" watchObservedRunningTime="2026-06-11 16:39:16.070191462 +0000 UTC m=+22.671186199" Jun 11 16:39:16.070521 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.070498 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" podStartSLOduration=22.07049073 podStartE2EDuration="22.07049073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:16.070478636 +0000 UTC m=+22.671473393" watchObservedRunningTime="2026-06-11 16:39:16.07049073 +0000 UTC m=+22.671485521" Jun 11 16:39:16.837114 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.837076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:16.837306 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.837076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:16.837306 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:16.837216 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:16.837306 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:16.837077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:16.837441 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:16.837307 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:16.837441 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:16.837378 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:17.033133 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.033048 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dp98m" event={"ID":"36efabf0-29c3-4759-aada-a562e5a90d2d","Type":"ContainerStarted","Data":"5323ef01554fd11911ea07d41d6b93c41c19c03f67b944cc02e9108bb3f80194"} Jun 11 16:39:17.034855 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.034829 2563 generic.go:356] "Generic (PLEG): container finished" podID="1fb875483a20c027c41d176967857d76" containerID="246b20e023a812a62a00ebf6cf79ca1ec46e68047eacc69e0130f8047730c39f" exitCode=0 Jun 11 16:39:17.034993 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.034921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"1fb875483a20c027c41d176967857d76","Type":"ContainerDied","Data":"246b20e023a812a62a00ebf6cf79ca1ec46e68047eacc69e0130f8047730c39f"} Jun 11 16:39:17.036599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.036538 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsm7v" event={"ID":"c4251613-305b-4630-9ce2-ebb8da165130","Type":"ContainerStarted","Data":"127d4a1fefb7d35b4edddf29c637214e20683407b04c22402600e999fb851bfd"} Jun 11 16:39:17.038107 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.038088 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrnh6" event={"ID":"264a2815-ab69-40c7-bf06-7df68cd63369","Type":"ContainerStarted","Data":"ef8cf1b51aad06467853230c513dd043909220a2cdef7da1e91143cddccbc2ba"} Jun 11 16:39:17.039684 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.039660 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" event={"ID":"8448238a-4a3b-415c-b1e4-8cdb614b1edb","Type":"ContainerStarted","Data":"3ba42e2b96b54a10e657553bb4be24a28d3704e696d211fb50f31f4c6ea7cc3d"} Jun 11 16:39:17.041182 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.041158 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9bd5f50-097b-4bc7-8ffd-d316c446e37b" containerID="66e860fe46997ff2284372acbf29eadbec05e4b2da46c9c14a999d22ec50e19d" exitCode=0 Jun 11 16:39:17.041296 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.041241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerDied","Data":"66e860fe46997ff2284372acbf29eadbec05e4b2da46c9c14a999d22ec50e19d"} Jun 11 16:39:17.045625 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.045599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5q98" event={"ID":"560bde2b-8d7e-4033-b1ec-4b635da8dc3a","Type":"ContainerStarted","Data":"a7b6da65ccaa294ddf2dc94bce988ed99a394f71e8f44ee461981a23d11b19ac"} Jun 11 16:39:17.048634 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.048595 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dp98m" podStartSLOduration=3.8282657159999998 podStartE2EDuration="24.048582645s" totalImagesPullingTime="20.220316929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:17.04808752 +0000 UTC m=+23.649082276" watchObservedRunningTime="2026-06-11 16:39:17.048582645 +0000 UTC m=+23.649577400" Jun 11 16:39:17.062994 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.062940 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qrnh6" podStartSLOduration=2.899095496 podStartE2EDuration="23.062925097s" totalImagesPullingTime="20.163829601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:17.06274902 +0000 UTC m=+23.663743787" watchObservedRunningTime="2026-06-11 16:39:17.062925097 +0000 UTC m=+23.663919852" Jun 11 16:39:17.078837 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.078777 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tsm7v" podStartSLOduration=11.922135485 podStartE2EDuration="23.078761804s" totalImagesPullingTime="11.156626319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:17.077863659 +0000 UTC m=+23.678858444" watchObservedRunningTime="2026-06-11 16:39:17.078761804 +0000 UTC m=+23.679756560" Jun 11 16:39:17.133847 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.133798 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f5q98" podStartSLOduration=3.91785203 podStartE2EDuration="24.133783003s" totalImagesPullingTime="20.215930973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:17.133521618 +0000 UTC m=+23.734516373" watchObservedRunningTime="2026-06-11 16:39:17.133783003 +0000 UTC m=+23.734777758" Jun 11 16:39:17.487496 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.487287 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:39:17.838085 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.837933 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:39:17.487492479Z","UUID":"946612f9-0d6a-4bdb-bc6a-b8375a7fb1d7","Handler":null,"Name":"","Endpoint":""} Jun 11 16:39:17.839764 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.839739 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:39:17.839904 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:17.839791 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:39:18.050444 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:18.050408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"1fb875483a20c027c41d176967857d76","Type":"ContainerStarted","Data":"009bf8161ff9fc2359cba537dd4ebb182049ff0f68c4c783f5c92e72c62ddcda"} Jun 11 16:39:18.052821 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:18.052764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" event={"ID":"8448238a-4a3b-415c-b1e4-8cdb614b1edb","Type":"ContainerStarted","Data":"cbca0a7308423402f53438671798af419efad4528a1729b3e89067f0bdfcacbe"} Jun 11 16:39:18.065136 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:18.065078 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" podStartSLOduration=24.065056878 podStartE2EDuration="24.065056878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:18.064938595 +0000 UTC m=+24.665933349" watchObservedRunningTime="2026-06-11 16:39:18.065056878 +0000 UTC m=+24.666051638" Jun 11 16:39:18.836718 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:18.836673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:18.836718 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:18.836707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:18.836990 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:18.836675 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:18.836990 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:18.836801 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:18.836990 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:18.836859 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:18.836990 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:18.836944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:19.057630 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:19.057416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" event={"ID":"8448238a-4a3b-415c-b1e4-8cdb614b1edb","Type":"ContainerStarted","Data":"26cc349e6e6e8008f91b574985be365df76322c7384e99f14eaa2ee44e41f0d5"} Jun 11 16:39:19.061231 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:19.061195 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:39:19.061687 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:19.061656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"4d15b2aa24333a041a086d56a2150518759cddf1dcb799435bee9ff8be36908d"} Jun 11 16:39:19.203267 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:19.203232 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:39:19.203941 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:19.203915 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:39:19.219408 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:19.219352 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ndjdc" podStartSLOduration=3.794135436 podStartE2EDuration="26.21933724s" totalImagesPullingTime="22.425201804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:19.077674428 +0000 UTC m=+25.678669208" watchObservedRunningTime="2026-06-11 16:39:19.21933724 +0000 UTC m=+25.820331996" Jun 11 16:39:20.064244 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:20.064104 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:39:20.064969 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:20.064881 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tsm7v" Jun 11 16:39:20.836434 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:20.836355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:20.836608 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:20.836374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:20.836608 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:20.836485 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:20.836608 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:20.836489 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:20.836608 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:20.836574 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:20.836824 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:20.836675 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:22.072798 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.072642 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:39:22.073203 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.073166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"f8ea77fb29624bf33bc3c59f6cbb1f8d06ec495c335812c7972e2f64337eeeec"} Jun 11 16:39:22.073481 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.073452 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:39:22.073748 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.073726 2563 scope.go:117] "RemoveContainer" containerID="c6cdaedd14862062bdaeffc72076b104f6c029aaeecf36cc6a9257e3ff738748" Jun 11 16:39:22.075286 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.075259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerStarted","Data":"9417c8ada350787692383a1b45e68b36efa52b9f5bc2ae9476f21968c6c1acd3"} Jun 11 16:39:22.089941 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.089919 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:39:22.836683 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.836647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:22.836853 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.836647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:22.836853 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:22.836655 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:22.836853 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:22.836753 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:22.836853 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:22.836826 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:22.837023 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:22.836896 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:23.083635 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.083602 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:39:23.084128 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.084101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" event={"ID":"03728cf9-60c2-4c26-836d-95161beae495","Type":"ContainerStarted","Data":"6f5a506d3c86eb97df3d8ca9920079a67bddf6d33940705693772ab1441bad17"} Jun 11 16:39:23.084484 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.084287 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:39:23.084484 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.084371 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:39:23.086349 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.086311 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9bd5f50-097b-4bc7-8ffd-d316c446e37b" containerID="9417c8ada350787692383a1b45e68b36efa52b9f5bc2ae9476f21968c6c1acd3" exitCode=0 Jun 11 16:39:23.086439 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.086365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerDied","Data":"9417c8ada350787692383a1b45e68b36efa52b9f5bc2ae9476f21968c6c1acd3"} Jun 11 16:39:23.100325 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.100296 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:39:23.111467 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.111422 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" podStartSLOduration=9.877987679 podStartE2EDuration="30.111406928s" totalImagesPullingTime="20.233419249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:23.11108642 +0000 UTC m=+29.712081175" watchObservedRunningTime="2026-06-11 16:39:23.111406928 +0000 UTC m=+29.712401683" Jun 11 16:39:23.920597 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.920566 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzjhm"] Jun 11 16:39:23.920783 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.920688 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:23.920830 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:23.920774 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:23.923716 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.923685 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r9skm"] Jun 11 16:39:23.923873 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.923794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:23.923947 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:23.923886 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:23.924232 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.924213 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58rw9"] Jun 11 16:39:23.924315 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:23.924300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:23.924397 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:23.924377 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:25.092928 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:25.092896 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9bd5f50-097b-4bc7-8ffd-d316c446e37b" containerID="ed250ef823ed3ef659ef5db1eaf03d984c9dcedcf71ac6571b0f4116bdb160d4" exitCode=0 Jun 11 16:39:25.093839 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:25.092976 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerDied","Data":"ed250ef823ed3ef659ef5db1eaf03d984c9dcedcf71ac6571b0f4116bdb160d4"} Jun 11 16:39:25.840029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:25.840005 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:25.840029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:25.840023 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:25.840198 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:25.840028 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:25.840198 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:25.840097 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:25.840273 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:25.840209 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:25.840340 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:25.840319 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:26.622783 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:26.622595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:26.623160 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:26.622827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:26.623160 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.622742 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:39:26.623160 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.622900 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:58.622885861 +0000 UTC m=+65.223880595 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:39:26.623160 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.622901 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:39:26.623160 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.622941 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret podName:c7aea5eb-069b-4c6c-9d7e-8dd28a249c35 nodeName:}" failed. No retries permitted until 2026-06-11 16:39:58.622929719 +0000 UTC m=+65.223924453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret") pod "global-pull-secret-syncer-58rw9" (UID: "c7aea5eb-069b-4c6c-9d7e-8dd28a249c35") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:39:26.723121 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:26.723086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:26.723298 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.723227 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:39:26.723298 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.723243 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:39:26.723298 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.723252 2563 projected.go:196] Error preparing data for projected volume kube-api-access-zlqz6 for pod openshift-network-diagnostics/network-check-target-r9skm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:39:26.723406 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:26.723302 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6 podName:4b89f495-93bd-4c66-9ae8-4199c9bfa39f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:58.723288132 +0000 UTC m=+65.324282865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zlqz6" (UniqueName: "kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6") pod "network-check-target-r9skm" (UID: "4b89f495-93bd-4c66-9ae8-4199c9bfa39f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:39:27.100593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:27.100539 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9bd5f50-097b-4bc7-8ffd-d316c446e37b" containerID="d74c8d4a26f567effb31c7a073ffc96b4673c187de09ed83c6960f8df2f5cbe7" exitCode=0 Jun 11 16:39:27.100746 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:27.100624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerDied","Data":"d74c8d4a26f567effb31c7a073ffc96b4673c187de09ed83c6960f8df2f5cbe7"} Jun 11 16:39:27.839690 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:27.839660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:27.840152 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:27.839700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:27.840152 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:27.839700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:27.840152 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:27.839772 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9skm" podUID="4b89f495-93bd-4c66-9ae8-4199c9bfa39f" Jun 11 16:39:27.840152 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:27.839875 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58rw9" podUID="c7aea5eb-069b-4c6c-9d7e-8dd28a249c35" Jun 11 16:39:27.840152 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:27.839966 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:39:29.198094 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.198051 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeReady" Jun 11 16:39:29.198500 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.198243 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:39:29.240065 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.239976 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gbgfv"] Jun 11 16:39:29.242357 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.242335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.244501 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.244453 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5nx2m"] Jun 11 16:39:29.245605 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.245408 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:39:29.245605 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.245464 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:39:29.245605 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.245494 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-klqh8\"" Jun 11 16:39:29.246339 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.246311 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.248803 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.248779 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:39:29.249395 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.249342 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zq2g6\"" Jun 11 16:39:29.249591 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.249370 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:39:29.249830 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.249786 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:39:29.253331 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.253308 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbgfv"] Jun 11 16:39:29.256452 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.256417 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nx2m"] Jun 11 16:39:29.340292 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.340204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4b0558d-7453-4124-8799-4e62a4780501-cert\") pod \"ingress-canary-5nx2m\" (UID: \"b4b0558d-7453-4124-8799-4e62a4780501\") " pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.340569 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.340298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glj7t\" (UniqueName: \"kubernetes.io/projected/b4b0558d-7453-4124-8799-4e62a4780501-kube-api-access-glj7t\") pod \"ingress-canary-5nx2m\" (UID: \"b4b0558d-7453-4124-8799-4e62a4780501\") " pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.340569 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.340319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/687074fa-ed83-4c4d-97ba-12c35360082f-tmp-dir\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.340569 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.340339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nz9\" (UniqueName: \"kubernetes.io/projected/687074fa-ed83-4c4d-97ba-12c35360082f-kube-api-access-x7nz9\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.340569 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.340368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.340569 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.340479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/687074fa-ed83-4c4d-97ba-12c35360082f-config-volume\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.441522 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.441483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.441522 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.441529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/687074fa-ed83-4c4d-97ba-12c35360082f-config-volume\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.441774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.441613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4b0558d-7453-4124-8799-4e62a4780501-cert\") pod \"ingress-canary-5nx2m\" (UID: \"b4b0558d-7453-4124-8799-4e62a4780501\") " pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.441774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.441646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glj7t\" (UniqueName: \"kubernetes.io/projected/b4b0558d-7453-4124-8799-4e62a4780501-kube-api-access-glj7t\") pod \"ingress-canary-5nx2m\" (UID: \"b4b0558d-7453-4124-8799-4e62a4780501\") " pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.441774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.441669 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/687074fa-ed83-4c4d-97ba-12c35360082f-tmp-dir\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.441774 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:29.441667 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:39:29.441774 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:29.441738 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:29.941719083 +0000 UTC m=+36.542713820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:39:29.442007 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.441850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nz9\" (UniqueName: \"kubernetes.io/projected/687074fa-ed83-4c4d-97ba-12c35360082f-kube-api-access-x7nz9\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.442052 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.442026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/687074fa-ed83-4c4d-97ba-12c35360082f-tmp-dir\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.442263 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.442239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/687074fa-ed83-4c4d-97ba-12c35360082f-config-volume\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.446595 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.446574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4b0558d-7453-4124-8799-4e62a4780501-cert\") pod \"ingress-canary-5nx2m\" (UID: \"b4b0558d-7453-4124-8799-4e62a4780501\") " pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.452588 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.452547 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glj7t\" (UniqueName: \"kubernetes.io/projected/b4b0558d-7453-4124-8799-4e62a4780501-kube-api-access-glj7t\") pod \"ingress-canary-5nx2m\" (UID: \"b4b0558d-7453-4124-8799-4e62a4780501\") " pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.452679 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.452657 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nz9\" (UniqueName: \"kubernetes.io/projected/687074fa-ed83-4c4d-97ba-12c35360082f-kube-api-access-x7nz9\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.563380 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.563344 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nx2m" Jun 11 16:39:29.840476 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.840394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:29.840476 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.840435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:29.840723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.840506 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:29.843688 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.843664 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kq8m8\"" Jun 11 16:39:29.843826 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.843665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xtkt\"" Jun 11 16:39:29.843826 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.843665 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:39:29.844730 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.844699 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:39:29.844949 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.844930 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:39:29.844949 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.844942 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:39:29.946440 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:29.946397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:29.946624 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:29.946531 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:39:29.946674 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:29.946636 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:30.946611821 +0000 UTC m=+37.547606575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:39:30.954858 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:30.954648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:30.955285 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:30.954790 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:39:30.955285 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:30.954953 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:32.95493056 +0000 UTC m=+39.555925311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:39:30.963376 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:30.963347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nx2m"] Jun 11 16:39:30.966612 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:39:30.966586 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b0558d_7453_4124_8799_4e62a4780501.slice/crio-fb6e85d97f1ae990fb47f177e6d8584ecb1fbd63395892024fe0a3762392b2e1 WatchSource:0}: Error finding container fb6e85d97f1ae990fb47f177e6d8584ecb1fbd63395892024fe0a3762392b2e1: Status 404 returned error can't find the container with id fb6e85d97f1ae990fb47f177e6d8584ecb1fbd63395892024fe0a3762392b2e1 Jun 11 16:39:31.113429 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:31.113394 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9bd5f50-097b-4bc7-8ffd-d316c446e37b" containerID="2ef4e63820631f1db65f47ff3a6655a1ff74a0aa9c2dec8f9d81314bf090ba78" exitCode=0 Jun 11 16:39:31.113615 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:31.113474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerDied","Data":"2ef4e63820631f1db65f47ff3a6655a1ff74a0aa9c2dec8f9d81314bf090ba78"} Jun 11 16:39:31.114653 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:31.114626 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nx2m" event={"ID":"b4b0558d-7453-4124-8799-4e62a4780501","Type":"ContainerStarted","Data":"fb6e85d97f1ae990fb47f177e6d8584ecb1fbd63395892024fe0a3762392b2e1"} Jun 11 16:39:32.120472 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:32.120438 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9bd5f50-097b-4bc7-8ffd-d316c446e37b" containerID="b3ff0da3752e8da47c61f6aecbbdec737542048711a012527c095cbce3e5b9ec" exitCode=0 Jun 11 16:39:32.121065 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:32.120488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerDied","Data":"b3ff0da3752e8da47c61f6aecbbdec737542048711a012527c095cbce3e5b9ec"} Jun 11 16:39:32.971245 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:32.971213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:32.971408 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:32.971376 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:39:32.971445 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:32.971441 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:36.97142552 +0000 UTC m=+43.572420258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:39:33.126122 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:33.126028 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" event={"ID":"c9bd5f50-097b-4bc7-8ffd-d316c446e37b","Type":"ContainerStarted","Data":"3022555b73d924e2cc473a129550f95e00e868c73086644e514a1c311fb77161"} Jun 11 16:39:33.127338 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:33.127314 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nx2m" event={"ID":"b4b0558d-7453-4124-8799-4e62a4780501","Type":"ContainerStarted","Data":"407b5d8cf7ab3bf049326cb76b6acfaa96f67da7079a07ad3e5533be61654227"} Jun 11 16:39:33.152566 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:33.152506 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ws9fh" podStartSLOduration=8.147943692 podStartE2EDuration="39.152488419s" totalImagesPullingTime="31.004544727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:33.150756262 +0000 UTC m=+39.751751018" watchObservedRunningTime="2026-06-11 16:39:33.152488419 +0000 UTC m=+39.753483174" Jun 11 16:39:33.166055 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:33.166001 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5nx2m" podStartSLOduration=2.276787123 podStartE2EDuration="4.165984047s" totalImagesPullingTime="1.889196924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:33.165336163 +0000 UTC m=+39.766330920" watchObservedRunningTime="2026-06-11 16:39:33.165984047 +0000 UTC m=+39.766978802" Jun 11 16:39:36.996771 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:36.996729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:36.997171 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:36.996886 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:39:36.997171 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:36.996967 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:39:44.99695035 +0000 UTC m=+51.597945084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:39:45.050792 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:45.050741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:39:45.051349 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:45.050897 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:39:45.051349 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:45.050973 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:40:01.050954111 +0000 UTC m=+67.651948857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:39:55.105547 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:55.105519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rrggx" Jun 11 16:39:58.642441 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.642393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:58.642441 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.642444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:39:58.645083 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.645060 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:39:58.645153 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.645063 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:39:58.653457 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:58.653424 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:39:58.653617 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:39:58.653509 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:02.653486264 +0000 UTC m=+129.254481019 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : secret "metrics-daemon-secret" not found Jun 11 16:39:58.656703 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.656679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7aea5eb-069b-4c6c-9d7e-8dd28a249c35-original-pull-secret\") pod \"global-pull-secret-syncer-58rw9\" (UID: \"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35\") " pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:58.743460 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.743421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:58.746398 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.746376 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:39:58.757071 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.757048 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:39:58.767416 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.767391 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlqz6\" (UniqueName: \"kubernetes.io/projected/4b89f495-93bd-4c66-9ae8-4199c9bfa39f-kube-api-access-zlqz6\") pod \"network-check-target-r9skm\" (UID: \"4b89f495-93bd-4c66-9ae8-4199c9bfa39f\") " pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:58.953723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.953625 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58rw9" Jun 11 16:39:58.970229 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.970207 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kq8m8\"" Jun 11 16:39:58.978360 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:58.978326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:39:59.090614 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:59.090490 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58rw9"] Jun 11 16:39:59.093178 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:39:59.093140 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7aea5eb_069b_4c6c_9d7e_8dd28a249c35.slice/crio-c4e991e8e0401ff0704c7d6cae914b54cf5901cd2f084ce36219b273dd6892e0 WatchSource:0}: Error finding container c4e991e8e0401ff0704c7d6cae914b54cf5901cd2f084ce36219b273dd6892e0: Status 404 returned error can't find the container with id c4e991e8e0401ff0704c7d6cae914b54cf5901cd2f084ce36219b273dd6892e0 Jun 11 16:39:59.106597 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:59.106567 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r9skm"] Jun 11 16:39:59.109181 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:39:59.109159 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b89f495_93bd_4c66_9ae8_4199c9bfa39f.slice/crio-73a3cefdfbc4ea18ccc3deaca8651ee4b69672fa2e29f45f2c6104abd1087d6b WatchSource:0}: Error finding container 73a3cefdfbc4ea18ccc3deaca8651ee4b69672fa2e29f45f2c6104abd1087d6b: Status 404 returned error can't find the container with id 73a3cefdfbc4ea18ccc3deaca8651ee4b69672fa2e29f45f2c6104abd1087d6b Jun 11 16:39:59.187185 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:59.187145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r9skm" event={"ID":"4b89f495-93bd-4c66-9ae8-4199c9bfa39f","Type":"ContainerStarted","Data":"73a3cefdfbc4ea18ccc3deaca8651ee4b69672fa2e29f45f2c6104abd1087d6b"} Jun 11 16:39:59.188238 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:39:59.188208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58rw9" event={"ID":"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35","Type":"ContainerStarted","Data":"c4e991e8e0401ff0704c7d6cae914b54cf5901cd2f084ce36219b273dd6892e0"} Jun 11 16:40:01.059447 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:01.059404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:40:01.059907 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:40:01.059545 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:40:01.059907 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:40:01.059622 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:40:33.059604906 +0000 UTC m=+99.660599640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:40:04.204917 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:04.204871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r9skm" event={"ID":"4b89f495-93bd-4c66-9ae8-4199c9bfa39f","Type":"ContainerStarted","Data":"f3da58d276024253fc22276ff6eeb0766d755e7f276f6af1054d0810d273f112"} Jun 11 16:40:04.205356 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:04.204995 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:40:04.206359 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:04.206326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58rw9" event={"ID":"c7aea5eb-069b-4c6c-9d7e-8dd28a249c35","Type":"ContainerStarted","Data":"164dd66e66e82dc9898d7972ec914aa383302aa360ec7c1ffc5bea6d1b859c6a"} Jun 11 16:40:04.220965 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:04.220912 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r9skm" podStartSLOduration=65.598542306 podStartE2EDuration="1m10.220897898s" totalImagesPullingTime="4.622355592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:04.220118085 +0000 UTC m=+70.821112840" watchObservedRunningTime="2026-06-11 16:40:04.220897898 +0000 UTC m=+70.821892653" Jun 11 16:40:04.234533 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:04.234488 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-58rw9" podStartSLOduration=65.585598577 podStartE2EDuration="1m10.234468404s" totalImagesPullingTime="4.648869827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:04.234324526 +0000 UTC m=+70.835319283" watchObservedRunningTime="2026-06-11 16:40:04.234468404 +0000 UTC m=+70.835463195" Jun 11 16:40:33.062952 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:33.062908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:40:33.063467 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:40:33.063061 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:40:33.063467 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:40:33.063138 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:41:37.063122503 +0000 UTC m=+163.664117237 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:40:35.211482 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:40:35.211450 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r9skm" Jun 11 16:41:02.661682 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:02.661638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:41:02.662149 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:02.661813 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:41:02.662149 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:02.661886 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs podName:30b97202-43bd-411e-b244-7f45861d6056 nodeName:}" failed. No retries permitted until 2026-06-11 16:43:04.661868634 +0000 UTC m=+251.262863368 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs") pod "network-metrics-daemon-wzjhm" (UID: "30b97202-43bd-411e-b244-7f45861d6056") : secret "metrics-daemon-secret" not found Jun 11 16:41:32.256081 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:32.256023 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gbgfv" podUID="687074fa-ed83-4c4d-97ba-12c35360082f" Jun 11 16:41:32.418992 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:32.418962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbgfv" Jun 11 16:41:32.861180 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:32.861137 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wzjhm" podUID="30b97202-43bd-411e-b244-7f45861d6056" Jun 11 16:41:37.096023 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:37.095983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:41:37.096440 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:37.096139 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:41:37.096440 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:37.096217 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls podName:687074fa-ed83-4c4d-97ba-12c35360082f nodeName:}" failed. No retries permitted until 2026-06-11 16:43:39.096198665 +0000 UTC m=+285.697193402 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls") pod "dns-default-gbgfv" (UID: "687074fa-ed83-4c4d-97ba-12c35360082f") : secret "dns-default-metrics-tls" not found Jun 11 16:41:44.501728 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.501630 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9"] Jun 11 16:41:44.503467 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.503446 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-m4b6n"] Jun 11 16:41:44.503621 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.503588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" Jun 11 16:41:44.505310 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.505292 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.508283 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.508260 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-pnzc6"] Jun 11 16:41:44.508407 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.508302 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:41:44.508407 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.508316 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nln6z\"" Jun 11 16:41:44.508407 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.508349 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 16:41:44.509384 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.509366 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wcdvl\"" Jun 11 16:41:44.509534 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.509510 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 16:41:44.509534 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.509526 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:41:44.509709 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.509379 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 16:41:44.509709 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.509376 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 16:41:44.509930 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.509914 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74fb4b67bf-txkdz"] Jun 11 16:41:44.510122 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.510105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.511538 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.511520 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bd4f98957-m2dcx"] Jun 11 16:41:44.511736 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.511719 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.513133 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.513114 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.514702 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.514680 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:41:44.514702 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.514694 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 16:41:44.514914 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.514687 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 16:41:44.517693 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.517670 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d57wv\"" Jun 11 16:41:44.518200 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.518177 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 16:41:44.518812 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.518795 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 16:41:44.518932 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.518897 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:41:44.519481 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.519242 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 16:41:44.519957 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.519935 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:41:44.520074 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.520056 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:41:44.520201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.520186 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:41:44.520386 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.520347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9"] Jun 11 16:41:44.520516 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.520378 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4blb4\"" Jun 11 16:41:44.520641 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.520530 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p65xz\"" Jun 11 16:41:44.520641 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.520298 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:41:44.520803 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.520782 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 16:41:44.521242 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.521198 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 16:41:44.522780 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.521978 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:41:44.522780 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.522748 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-m4b6n"] Jun 11 16:41:44.523734 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.523701 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 16:41:44.526363 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.526302 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:41:44.527417 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.527368 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd4f98957-m2dcx"] Jun 11 16:41:44.530267 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.530238 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pnzc6"] Jun 11 16:41:44.539026 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.538942 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74fb4b67bf-txkdz"] Jun 11 16:41:44.599767 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.599731 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2"] Jun 11 16:41:44.601728 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.601711 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.603660 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.603635 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4"] Jun 11 16:41:44.605097 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.605073 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 16:41:44.605332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.605317 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:41:44.605387 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.605335 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 16:41:44.605429 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.605317 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qsg26\"" Jun 11 16:41:44.605492 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.605474 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.606221 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.606204 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:41:44.608013 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.607988 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 16:41:44.608115 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.608023 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 16:41:44.608184 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.608154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 16:41:44.608273 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.608250 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dv4n5\"" Jun 11 16:41:44.608390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.608373 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:41:44.617514 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.617486 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2"] Jun 11 16:41:44.618297 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.618276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4"] Jun 11 16:41:44.650492 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71aec425-a97e-43a2-a8a1-018d659f1a5c-service-ca-bundle\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.650698 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-installation-pull-secrets\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.650698 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ff6d341-6054-4478-a54e-e11705d7d80e-serving-cert\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.650698 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qpdc\" (UniqueName: \"kubernetes.io/projected/216e6bf6-c786-4975-8c52-b05af7f42ff3-kube-api-access-2qpdc\") pod \"volume-data-source-validator-78dd696465-ch2j9\" (UID: \"216e6bf6-c786-4975-8c52-b05af7f42ff3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" Jun 11 16:41:44.650834 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-default-certificate\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.650834 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-bound-sa-token\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.650834 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71aec425-a97e-43a2-a8a1-018d659f1a5c-snapshots\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.650834 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650789 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-certificates\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.651029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650860 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp867\" (UniqueName: \"kubernetes.io/projected/3ff6d341-6054-4478-a54e-e11705d7d80e-kube-api-access-cp867\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.651029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.651029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ff6d341-6054-4478-a54e-e11705d7d80e-trusted-ca\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.651029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-trusted-ca\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.651029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-stats-auth\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.651029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.650992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-image-registry-private-configuration\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.651029 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca05fd7-987f-4dac-be35-06106b35ff67-ca-trust-extracted\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ff6d341-6054-4478-a54e-e11705d7d80e-config\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71aec425-a97e-43a2-a8a1-018d659f1a5c-serving-cert\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7nn7\" (UniqueName: \"kubernetes.io/projected/71aec425-a97e-43a2-a8a1-018d659f1a5c-kube-api-access-z7nn7\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq8g8\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-kube-api-access-cq8g8\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71aec425-a97e-43a2-a8a1-018d659f1a5c-tmp\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.651332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651306 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71aec425-a97e-43a2-a8a1-018d659f1a5c-trusted-ca-bundle\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.651613 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.651363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cq4d\" (UniqueName: \"kubernetes.io/projected/be962de3-8e94-4e1c-9e12-ec26d6be919a-kube-api-access-5cq4d\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.695939 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.695906 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n"] Jun 11 16:41:44.697780 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.697764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" Jun 11 16:41:44.700206 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.700185 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pzq8f\"" Jun 11 16:41:44.705740 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.705717 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n"] Jun 11 16:41:44.752676 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-certificates\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.752676 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp867\" (UniqueName: \"kubernetes.io/projected/3ff6d341-6054-4478-a54e-e11705d7d80e-kube-api-access-cp867\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.752676 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.752765 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:45.252744393 +0000 UTC m=+171.853739128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : configmap references non-existent config key: service-ca.crt Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc2pm\" (UniqueName: \"kubernetes.io/projected/0112852f-29c3-45c1-8627-d49a7a60a5a0-kube-api-access-vc2pm\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ff6d341-6054-4478-a54e-e11705d7d80e-trusted-ca\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-trusted-ca\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-stats-auth\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-image-registry-private-configuration\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca05fd7-987f-4dac-be35-06106b35ff67-ca-trust-extracted\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.752942 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ff6d341-6054-4478-a54e-e11705d7d80e-config\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0112852f-29c3-45c1-8627-d49a7a60a5a0-config\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.752993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71aec425-a97e-43a2-a8a1-018d659f1a5c-serving-cert\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7nn7\" (UniqueName: \"kubernetes.io/projected/71aec425-a97e-43a2-a8a1-018d659f1a5c-kube-api-access-z7nn7\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753057 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8g8\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-kube-api-access-cq8g8\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bff96e85-e3e3-4afc-af8b-283db4f74654-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71aec425-a97e-43a2-a8a1-018d659f1a5c-tmp\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71aec425-a97e-43a2-a8a1-018d659f1a5c-trusted-ca-bundle\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqd4\" (UniqueName: \"kubernetes.io/projected/bff96e85-e3e3-4afc-af8b-283db4f74654-kube-api-access-7qqd4\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cq4d\" (UniqueName: \"kubernetes.io/projected/be962de3-8e94-4e1c-9e12-ec26d6be919a-kube-api-access-5cq4d\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71aec425-a97e-43a2-a8a1-018d659f1a5c-service-ca-bundle\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.753341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-installation-pull-secrets\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ff6d341-6054-4478-a54e-e11705d7d80e-serving-cert\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-certificates\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qpdc\" (UniqueName: \"kubernetes.io/projected/216e6bf6-c786-4975-8c52-b05af7f42ff3-kube-api-access-2qpdc\") pod \"volume-data-source-validator-78dd696465-ch2j9\" (UID: \"216e6bf6-c786-4975-8c52-b05af7f42ff3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753419 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca05fd7-987f-4dac-be35-06106b35ff67-ca-trust-extracted\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0112852f-29c3-45c1-8627-d49a7a60a5a0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71aec425-a97e-43a2-a8a1-018d659f1a5c-tmp\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-default-certificate\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753818 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-trusted-ca\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753892 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-bound-sa-token\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.754033 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.753931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ff6d341-6054-4478-a54e-e11705d7d80e-trusted-ca\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.754527 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.754180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71aec425-a97e-43a2-a8a1-018d659f1a5c-snapshots\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.754527 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.754361 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ff6d341-6054-4478-a54e-e11705d7d80e-config\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.754527 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.754373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71aec425-a97e-43a2-a8a1-018d659f1a5c-service-ca-bundle\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.754829 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.754811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71aec425-a97e-43a2-a8a1-018d659f1a5c-snapshots\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.755252 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.755226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71aec425-a97e-43a2-a8a1-018d659f1a5c-trusted-ca-bundle\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.755518 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.755498 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:41:44.755652 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.755639 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bd4f98957-m2dcx: secret "image-registry-tls" not found Jun 11 16:41:44.755786 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.755587 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:41:44.755850 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.755776 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls podName:5ca05fd7-987f-4dac-be35-06106b35ff67 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:45.255756402 +0000 UTC m=+171.856751137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls") pod "image-registry-7bd4f98957-m2dcx" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67") : secret "image-registry-tls" not found Jun 11 16:41:44.755910 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.755854 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:45.255832559 +0000 UTC m=+171.856827302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : secret "router-metrics-certs-default" not found Jun 11 16:41:44.756093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.756067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-image-registry-private-configuration\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.756170 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.756130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ff6d341-6054-4478-a54e-e11705d7d80e-serving-cert\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.756412 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.756392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-stats-auth\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.756814 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.756794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-default-certificate\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.757012 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.756986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-installation-pull-secrets\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.757108 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.757090 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71aec425-a97e-43a2-a8a1-018d659f1a5c-serving-cert\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.764707 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.764653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-bound-sa-token\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.765067 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.765042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp867\" (UniqueName: \"kubernetes.io/projected/3ff6d341-6054-4478-a54e-e11705d7d80e-kube-api-access-cp867\") pod \"console-operator-668fdbf85c-m4b6n\" (UID: \"3ff6d341-6054-4478-a54e-e11705d7d80e\") " pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.765205 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.765130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7nn7\" (UniqueName: \"kubernetes.io/projected/71aec425-a97e-43a2-a8a1-018d659f1a5c-kube-api-access-z7nn7\") pod \"insights-operator-896549976-pnzc6\" (UID: \"71aec425-a97e-43a2-a8a1-018d659f1a5c\") " pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.765953 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.765930 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8g8\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-kube-api-access-cq8g8\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:44.766037 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.765970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qpdc\" (UniqueName: \"kubernetes.io/projected/216e6bf6-c786-4975-8c52-b05af7f42ff3-kube-api-access-2qpdc\") pod \"volume-data-source-validator-78dd696465-ch2j9\" (UID: \"216e6bf6-c786-4975-8c52-b05af7f42ff3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" Jun 11 16:41:44.766657 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.766636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cq4d\" (UniqueName: \"kubernetes.io/projected/be962de3-8e94-4e1c-9e12-ec26d6be919a-kube-api-access-5cq4d\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:44.815438 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.815400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" Jun 11 16:41:44.823395 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.823370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:44.832241 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.832219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pnzc6" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.854972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bff96e85-e3e3-4afc-af8b-283db4f74654-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.855048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqd4\" (UniqueName: \"kubernetes.io/projected/bff96e85-e3e3-4afc-af8b-283db4f74654-kube-api-access-7qqd4\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.855082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.855116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0112852f-29c3-45c1-8627-d49a7a60a5a0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.855188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc2pm\" (UniqueName: \"kubernetes.io/projected/0112852f-29c3-45c1-8627-d49a7a60a5a0-kube-api-access-vc2pm\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.855222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0112852f-29c3-45c1-8627-d49a7a60a5a0-config\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.855251 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.855263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmt6v\" (UniqueName: \"kubernetes.io/projected/039c0e58-2560-41c1-b205-a5f2c35a9d0f-kube-api-access-tmt6v\") pod \"network-check-source-dbd9cf844-bf74n\" (UID: \"039c0e58-2560-41c1-b205-a5f2c35a9d0f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" Jun 11 16:41:44.855515 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:44.855327 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls podName:bff96e85-e3e3-4afc-af8b-283db4f74654 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:45.355304974 +0000 UTC m=+171.956299713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-czml2" (UID: "bff96e85-e3e3-4afc-af8b-283db4f74654") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:44.856081 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.855966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bff96e85-e3e3-4afc-af8b-283db4f74654-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.856081 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.856040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0112852f-29c3-45c1-8627-d49a7a60a5a0-config\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.858274 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.858236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0112852f-29c3-45c1-8627-d49a7a60a5a0-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.866806 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.866743 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqd4\" (UniqueName: \"kubernetes.io/projected/bff96e85-e3e3-4afc-af8b-283db4f74654-kube-api-access-7qqd4\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:44.870332 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.870277 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc2pm\" (UniqueName: \"kubernetes.io/projected/0112852f-29c3-45c1-8627-d49a7a60a5a0-kube-api-access-vc2pm\") pod \"service-ca-operator-6bc5ff68f5-84fq4\" (UID: \"0112852f-29c3-45c1-8627-d49a7a60a5a0\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.918122 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.918088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" Jun 11 16:41:44.955928 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.955885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmt6v\" (UniqueName: \"kubernetes.io/projected/039c0e58-2560-41c1-b205-a5f2c35a9d0f-kube-api-access-tmt6v\") pod \"network-check-source-dbd9cf844-bf74n\" (UID: \"039c0e58-2560-41c1-b205-a5f2c35a9d0f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" Jun 11 16:41:44.960472 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.960399 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9"] Jun 11 16:41:44.965297 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:41:44.965200 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216e6bf6_c786_4975_8c52_b05af7f42ff3.slice/crio-fce433fac98e94169effdeaf44eb921640b152d6ec36744f91ec06cb366c33a2 WatchSource:0}: Error finding container fce433fac98e94169effdeaf44eb921640b152d6ec36744f91ec06cb366c33a2: Status 404 returned error can't find the container with id fce433fac98e94169effdeaf44eb921640b152d6ec36744f91ec06cb366c33a2 Jun 11 16:41:44.966890 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:44.965838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmt6v\" (UniqueName: \"kubernetes.io/projected/039c0e58-2560-41c1-b205-a5f2c35a9d0f-kube-api-access-tmt6v\") pod \"network-check-source-dbd9cf844-bf74n\" (UID: \"039c0e58-2560-41c1-b205-a5f2c35a9d0f\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" Jun 11 16:41:45.006839 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.006797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" Jun 11 16:41:45.053307 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.053269 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4"] Jun 11 16:41:45.057275 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:41:45.056688 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0112852f_29c3_45c1_8627_d49a7a60a5a0.slice/crio-eb91071681a7d44e552f1a110a252aafa548caf88247c97439f799404f46a1dc WatchSource:0}: Error finding container eb91071681a7d44e552f1a110a252aafa548caf88247c97439f799404f46a1dc: Status 404 returned error can't find the container with id eb91071681a7d44e552f1a110a252aafa548caf88247c97439f799404f46a1dc Jun 11 16:41:45.136233 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.136200 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n"] Jun 11 16:41:45.139407 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:41:45.139381 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039c0e58_2560_41c1_b205_a5f2c35a9d0f.slice/crio-73a3256f9d6195b8648ba73ea056803e2830dad98cbbcfbea1119446e750a699 WatchSource:0}: Error finding container 73a3256f9d6195b8648ba73ea056803e2830dad98cbbcfbea1119446e750a699: Status 404 returned error can't find the container with id 73a3256f9d6195b8648ba73ea056803e2830dad98cbbcfbea1119446e750a699 Jun 11 16:41:45.193634 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.193604 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-m4b6n"] Jun 11 16:41:45.194885 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.194862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pnzc6"] Jun 11 16:41:45.196876 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:41:45.196836 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71aec425_a97e_43a2_a8a1_018d659f1a5c.slice/crio-25e73a6a97796441217598fc34f9af253603ce753948489bed231cea4eef69fd WatchSource:0}: Error finding container 25e73a6a97796441217598fc34f9af253603ce753948489bed231cea4eef69fd: Status 404 returned error can't find the container with id 25e73a6a97796441217598fc34f9af253603ce753948489bed231cea4eef69fd Jun 11 16:41:45.197549 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:41:45.197522 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff6d341_6054_4478_a54e_e11705d7d80e.slice/crio-b6faf3439a69946aa287d06e3a114cbce35d0066af33c698684667559693511f WatchSource:0}: Error finding container b6faf3439a69946aa287d06e3a114cbce35d0066af33c698684667559693511f: Status 404 returned error can't find the container with id b6faf3439a69946aa287d06e3a114cbce35d0066af33c698684667559693511f Jun 11 16:41:45.259317 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.259205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:45.259317 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.259275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:45.259586 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.259360 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:41:45.259586 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.259371 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bd4f98957-m2dcx: secret "image-registry-tls" not found Jun 11 16:41:45.259586 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.259405 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:46.259382702 +0000 UTC m=+172.860377438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : configmap references non-existent config key: service-ca.crt Jun 11 16:41:45.259586 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.259436 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls podName:5ca05fd7-987f-4dac-be35-06106b35ff67 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:46.259427444 +0000 UTC m=+172.860422178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls") pod "image-registry-7bd4f98957-m2dcx" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67") : secret "image-registry-tls" not found Jun 11 16:41:45.259586 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.259457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:45.259586 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.259579 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:41:45.259816 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.259611 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:46.259600355 +0000 UTC m=+172.860595090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : secret "router-metrics-certs-default" not found Jun 11 16:41:45.360621 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.360572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:45.360821 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.360701 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:45.360821 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:45.360767 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls podName:bff96e85-e3e3-4afc-af8b-283db4f74654 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:46.360752029 +0000 UTC m=+172.961746766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-czml2" (UID: "bff96e85-e3e3-4afc-af8b-283db4f74654") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:45.450891 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.450852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" event={"ID":"216e6bf6-c786-4975-8c52-b05af7f42ff3","Type":"ContainerStarted","Data":"fce433fac98e94169effdeaf44eb921640b152d6ec36744f91ec06cb366c33a2"} Jun 11 16:41:45.452549 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.452512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" event={"ID":"039c0e58-2560-41c1-b205-a5f2c35a9d0f","Type":"ContainerStarted","Data":"2fbae52ddccd089a6b9e2dc69c76d25ee45e4079fdf429d2c3a6306e38968e0b"} Jun 11 16:41:45.452698 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.452584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" event={"ID":"039c0e58-2560-41c1-b205-a5f2c35a9d0f","Type":"ContainerStarted","Data":"73a3256f9d6195b8648ba73ea056803e2830dad98cbbcfbea1119446e750a699"} Jun 11 16:41:45.453988 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.453957 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" event={"ID":"0112852f-29c3-45c1-8627-d49a7a60a5a0","Type":"ContainerStarted","Data":"eb91071681a7d44e552f1a110a252aafa548caf88247c97439f799404f46a1dc"} Jun 11 16:41:45.455017 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.454994 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pnzc6" event={"ID":"71aec425-a97e-43a2-a8a1-018d659f1a5c","Type":"ContainerStarted","Data":"25e73a6a97796441217598fc34f9af253603ce753948489bed231cea4eef69fd"} Jun 11 16:41:45.459971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.456342 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" event={"ID":"3ff6d341-6054-4478-a54e-e11705d7d80e","Type":"ContainerStarted","Data":"b6faf3439a69946aa287d06e3a114cbce35d0066af33c698684667559693511f"} Jun 11 16:41:45.468239 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.468169 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bf74n" podStartSLOduration=1.468150987 podStartE2EDuration="1.468150987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:45.467579123 +0000 UTC m=+172.068573880" watchObservedRunningTime="2026-06-11 16:41:45.468150987 +0000 UTC m=+172.069145747" Jun 11 16:41:45.837871 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:45.837835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:41:46.270548 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:46.270391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:46.270548 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:46.270508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:46.270548 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:46.270537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:46.270852 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.270681 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:48.270657365 +0000 UTC m=+174.871652100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : configmap references non-existent config key: service-ca.crt Jun 11 16:41:46.270852 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.270722 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:41:46.270852 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.270776 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:48.270759755 +0000 UTC m=+174.871754504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : secret "router-metrics-certs-default" not found Jun 11 16:41:46.270852 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.270840 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:41:46.270852 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.270853 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bd4f98957-m2dcx: secret "image-registry-tls" not found Jun 11 16:41:46.271129 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.270904 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls podName:5ca05fd7-987f-4dac-be35-06106b35ff67 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:48.270880686 +0000 UTC m=+174.871875435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls") pod "image-registry-7bd4f98957-m2dcx" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67") : secret "image-registry-tls" not found Jun 11 16:41:46.372472 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:46.371739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:46.372472 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.371959 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:46.372472 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:46.372025 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls podName:bff96e85-e3e3-4afc-af8b-283db4f74654 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:48.372007454 +0000 UTC m=+174.973002200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-czml2" (UID: "bff96e85-e3e3-4afc-af8b-283db4f74654") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:47.465232 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:47.465156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" event={"ID":"216e6bf6-c786-4975-8c52-b05af7f42ff3","Type":"ContainerStarted","Data":"88f43e9703ea5d0a9a19ff3fb22093d11d9d37a6f784b89c8b0bdc781811a002"} Jun 11 16:41:47.482531 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:47.482472 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ch2j9" podStartSLOduration=1.972200537 podStartE2EDuration="3.482455586s" totalImagesPullingTime="1.510255049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:47.48099328 +0000 UTC m=+174.081988036" watchObservedRunningTime="2026-06-11 16:41:47.482455586 +0000 UTC m=+174.083450345" Jun 11 16:41:48.286527 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:48.286486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:48.286748 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:48.286598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:48.286748 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:48.286626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:48.286748 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.286648 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:52.286628246 +0000 UTC m=+178.887622995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : configmap references non-existent config key: service-ca.crt Jun 11 16:41:48.286748 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.286704 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:41:48.286748 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.286742 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:41:52.286732153 +0000 UTC m=+178.887726902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : secret "router-metrics-certs-default" not found Jun 11 16:41:48.287046 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.286777 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:41:48.287046 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.286800 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bd4f98957-m2dcx: secret "image-registry-tls" not found Jun 11 16:41:48.287046 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.286851 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls podName:5ca05fd7-987f-4dac-be35-06106b35ff67 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:52.286839363 +0000 UTC m=+178.887834097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls") pod "image-registry-7bd4f98957-m2dcx" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67") : secret "image-registry-tls" not found Jun 11 16:41:48.387768 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:48.387723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:48.387960 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.387896 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:48.388024 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:48.387968 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls podName:bff96e85-e3e3-4afc-af8b-283db4f74654 nodeName:}" failed. No retries permitted until 2026-06-11 16:41:52.387948012 +0000 UTC m=+178.988942747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-czml2" (UID: "bff96e85-e3e3-4afc-af8b-283db4f74654") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:49.473511 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.473470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" event={"ID":"0112852f-29c3-45c1-8627-d49a7a60a5a0","Type":"ContainerStarted","Data":"5f2e7962c644590105f5e704241d7e5c7a6b38c81012b5a09b335aa04169c9cb"} Jun 11 16:41:49.475107 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.475074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pnzc6" event={"ID":"71aec425-a97e-43a2-a8a1-018d659f1a5c","Type":"ContainerStarted","Data":"2008d78e8cae2bb015b46a08361a94266e03f0a6bfa83df20e1a238aaa4b9ebe"} Jun 11 16:41:49.476925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.476903 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/0.log" Jun 11 16:41:49.477046 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.476947 2563 generic.go:356] "Generic (PLEG): container finished" podID="3ff6d341-6054-4478-a54e-e11705d7d80e" containerID="669152df2ba6bf1603998e4b90010d46739aa16ea1672ae8d637e87224c13932" exitCode=255 Jun 11 16:41:49.477046 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.476979 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" event={"ID":"3ff6d341-6054-4478-a54e-e11705d7d80e","Type":"ContainerDied","Data":"669152df2ba6bf1603998e4b90010d46739aa16ea1672ae8d637e87224c13932"} Jun 11 16:41:49.477226 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.477210 2563 scope.go:117] "RemoveContainer" containerID="669152df2ba6bf1603998e4b90010d46739aa16ea1672ae8d637e87224c13932" Jun 11 16:41:49.489202 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.489118 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" podStartSLOduration=1.808732542 podStartE2EDuration="5.48909742s" totalImagesPullingTime="3.680364878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:49.487359914 +0000 UTC m=+176.088354671" watchObservedRunningTime="2026-06-11 16:41:49.48909742 +0000 UTC m=+176.090092176" Jun 11 16:41:49.545750 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:49.545693 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-pnzc6" podStartSLOduration=2.009205783 podStartE2EDuration="5.545670275s" totalImagesPullingTime="3.536464492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:49.544800279 +0000 UTC m=+176.145795036" watchObservedRunningTime="2026-06-11 16:41:49.545670275 +0000 UTC m=+176.146665033" Jun 11 16:41:50.481980 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:50.481948 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:41:50.482582 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:50.482454 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/0.log" Jun 11 16:41:50.482582 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:50.482498 2563 generic.go:356] "Generic (PLEG): container finished" podID="3ff6d341-6054-4478-a54e-e11705d7d80e" containerID="a7f78ffeba073ab3256b9e773658ca8de1503285abe15f0c3068a16d95c85202" exitCode=255 Jun 11 16:41:50.482693 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:50.482590 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" event={"ID":"3ff6d341-6054-4478-a54e-e11705d7d80e","Type":"ContainerDied","Data":"a7f78ffeba073ab3256b9e773658ca8de1503285abe15f0c3068a16d95c85202"} Jun 11 16:41:50.482693 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:50.482669 2563 scope.go:117] "RemoveContainer" containerID="669152df2ba6bf1603998e4b90010d46739aa16ea1672ae8d637e87224c13932" Jun 11 16:41:50.482871 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:50.482854 2563 scope.go:117] "RemoveContainer" containerID="a7f78ffeba073ab3256b9e773658ca8de1503285abe15f0c3068a16d95c85202" Jun 11 16:41:50.483068 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:50.483047 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-m4b6n_openshift-console-operator(3ff6d341-6054-4478-a54e-e11705d7d80e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" podUID="3ff6d341-6054-4478-a54e-e11705d7d80e" Jun 11 16:41:51.486792 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:51.486760 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:41:51.487183 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:51.487079 2563 scope.go:117] "RemoveContainer" containerID="a7f78ffeba073ab3256b9e773658ca8de1503285abe15f0c3068a16d95c85202" Jun 11 16:41:51.487253 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:51.487232 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-m4b6n_openshift-console-operator(3ff6d341-6054-4478-a54e-e11705d7d80e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" podUID="3ff6d341-6054-4478-a54e-e11705d7d80e" Jun 11 16:41:52.319393 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.319349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:52.319616 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.319424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:41:52.319616 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.319450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:41:52.319616 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.319538 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:42:00.319513609 +0000 UTC m=+186.920508361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : configmap references non-existent config key: service-ca.crt Jun 11 16:41:52.319616 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.319595 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:41:52.319616 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.319604 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:41:52.319866 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.319669 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs podName:be962de3-8e94-4e1c-9e12-ec26d6be919a nodeName:}" failed. No retries permitted until 2026-06-11 16:42:00.31965177 +0000 UTC m=+186.920646506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs") pod "router-default-74fb4b67bf-txkdz" (UID: "be962de3-8e94-4e1c-9e12-ec26d6be919a") : secret "router-metrics-certs-default" not found Jun 11 16:41:52.319866 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.319608 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bd4f98957-m2dcx: secret "image-registry-tls" not found Jun 11 16:41:52.319866 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.319721 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls podName:5ca05fd7-987f-4dac-be35-06106b35ff67 nodeName:}" failed. No retries permitted until 2026-06-11 16:42:00.319711503 +0000 UTC m=+186.920706255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls") pod "image-registry-7bd4f98957-m2dcx" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67") : secret "image-registry-tls" not found Jun 11 16:41:52.342739 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.342703 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-7lszb"] Jun 11 16:41:52.345633 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.345613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.348313 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.348288 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 16:41:52.349424 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.349404 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 16:41:52.349546 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.349427 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pz6rt\"" Jun 11 16:41:52.349546 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.349438 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 16:41:52.349546 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.349523 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 16:41:52.354253 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.354233 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-7lszb"] Jun 11 16:41:52.420266 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.420223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1da0f47-2f9b-4e49-8174-f991a135cfec-signing-key\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.420444 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.420323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1da0f47-2f9b-4e49-8174-f991a135cfec-signing-cabundle\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.420444 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.420375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttxnh\" (UniqueName: \"kubernetes.io/projected/f1da0f47-2f9b-4e49-8174-f991a135cfec-kube-api-access-ttxnh\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.420514 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.420485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:41:52.420626 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.420611 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:52.420690 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:52.420680 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls podName:bff96e85-e3e3-4afc-af8b-283db4f74654 nodeName:}" failed. No retries permitted until 2026-06-11 16:42:00.420660942 +0000 UTC m=+187.021655680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-czml2" (UID: "bff96e85-e3e3-4afc-af8b-283db4f74654") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:41:52.520984 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.520937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1da0f47-2f9b-4e49-8174-f991a135cfec-signing-cabundle\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.520984 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.520984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttxnh\" (UniqueName: \"kubernetes.io/projected/f1da0f47-2f9b-4e49-8174-f991a135cfec-kube-api-access-ttxnh\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.521430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.521080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1da0f47-2f9b-4e49-8174-f991a135cfec-signing-key\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.521644 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.521620 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1da0f47-2f9b-4e49-8174-f991a135cfec-signing-cabundle\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.523495 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.523468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1da0f47-2f9b-4e49-8174-f991a135cfec-signing-key\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.529816 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.529793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttxnh\" (UniqueName: \"kubernetes.io/projected/f1da0f47-2f9b-4e49-8174-f991a135cfec-kube-api-access-ttxnh\") pod \"service-ca-7d74d578b8-7lszb\" (UID: \"f1da0f47-2f9b-4e49-8174-f991a135cfec\") " pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.655922 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.655833 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" Jun 11 16:41:52.781327 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:52.781301 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-7lszb"] Jun 11 16:41:52.783852 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:41:52.783827 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1da0f47_2f9b_4e49_8174_f991a135cfec.slice/crio-fe38dd7fecc94c21bdb74d816daaba43439e8e067effb1fbadc6f1b5a6ac8034 WatchSource:0}: Error finding container fe38dd7fecc94c21bdb74d816daaba43439e8e067effb1fbadc6f1b5a6ac8034: Status 404 returned error can't find the container with id fe38dd7fecc94c21bdb74d816daaba43439e8e067effb1fbadc6f1b5a6ac8034 Jun 11 16:41:53.494621 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:53.494580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" event={"ID":"f1da0f47-2f9b-4e49-8174-f991a135cfec","Type":"ContainerStarted","Data":"3c7fa4912b26aefbd45f7942d147433e1cb6fabee624faa6a317a80e2ea30fe6"} Jun 11 16:41:53.494824 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:53.494663 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" event={"ID":"f1da0f47-2f9b-4e49-8174-f991a135cfec","Type":"ContainerStarted","Data":"fe38dd7fecc94c21bdb74d816daaba43439e8e067effb1fbadc6f1b5a6ac8034"} Jun 11 16:41:53.512897 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:53.512834 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-7lszb" podStartSLOduration=1.512818622 podStartE2EDuration="1.512818622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:53.510998879 +0000 UTC m=+180.111993637" watchObservedRunningTime="2026-06-11 16:41:53.512818622 +0000 UTC m=+180.113813408" Jun 11 16:41:53.535788 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:53.535758 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5q98_560bde2b-8d7e-4033-b1ec-4b635da8dc3a/dns-node-resolver/0.log" Jun 11 16:41:54.824323 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:54.824282 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:54.824758 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:54.824349 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:41:54.824758 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:54.824736 2563 scope.go:117] "RemoveContainer" containerID="a7f78ffeba073ab3256b9e773658ca8de1503285abe15f0c3068a16d95c85202" Jun 11 16:41:54.824907 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:41:54.824886 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-m4b6n_openshift-console-operator(3ff6d341-6054-4478-a54e-e11705d7d80e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" podUID="3ff6d341-6054-4478-a54e-e11705d7d80e" Jun 11 16:41:54.940780 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:54.940750 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrnh6_264a2815-ab69-40c7-bf06-7df68cd63369/node-ca/0.log" Jun 11 16:41:55.342053 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:41:55.342027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nx2m_b4b0558d-7453-4124-8799-4e62a4780501/serve-healthcheck-canary/0.log" Jun 11 16:42:00.386919 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.386881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:00.387327 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.386946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:42:00.387327 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.386966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:00.387522 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.387497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be962de3-8e94-4e1c-9e12-ec26d6be919a-service-ca-bundle\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:00.389427 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.389400 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be962de3-8e94-4e1c-9e12-ec26d6be919a-metrics-certs\") pod \"router-default-74fb4b67bf-txkdz\" (UID: \"be962de3-8e94-4e1c-9e12-ec26d6be919a\") " pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:00.389535 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.389453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"image-registry-7bd4f98957-m2dcx\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:42:00.445057 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.445026 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4blb4\"" Jun 11 16:42:00.450490 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.450465 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p65xz\"" Jun 11 16:42:00.452468 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.452450 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:00.459170 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.459149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:42:00.487719 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.487677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:42:00.487873 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:42:00.487855 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:42:00.487972 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:42:00.487958 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls podName:bff96e85-e3e3-4afc-af8b-283db4f74654 nodeName:}" failed. No retries permitted until 2026-06-11 16:42:16.487933192 +0000 UTC m=+203.088928032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-czml2" (UID: "bff96e85-e3e3-4afc-af8b-283db4f74654") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:42:00.610927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.610894 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74fb4b67bf-txkdz"] Jun 11 16:42:00.613839 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:00.613813 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe962de3_8e94_4e1c_9e12_ec26d6be919a.slice/crio-629bea8ec6eacec8c6c588948b324b3a7cb42f5e21fac95a02e1039d1eff08b4 WatchSource:0}: Error finding container 629bea8ec6eacec8c6c588948b324b3a7cb42f5e21fac95a02e1039d1eff08b4: Status 404 returned error can't find the container with id 629bea8ec6eacec8c6c588948b324b3a7cb42f5e21fac95a02e1039d1eff08b4 Jun 11 16:42:00.624667 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:00.624642 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd4f98957-m2dcx"] Jun 11 16:42:00.627882 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:00.627850 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca05fd7_987f_4dac_be35_06106b35ff67.slice/crio-e88d0596a06c5ae6c81f41546c6ce8cdec06ea14c9616b42c08a585ffee08ae2 WatchSource:0}: Error finding container e88d0596a06c5ae6c81f41546c6ce8cdec06ea14c9616b42c08a585ffee08ae2: Status 404 returned error can't find the container with id e88d0596a06c5ae6c81f41546c6ce8cdec06ea14c9616b42c08a585ffee08ae2 Jun 11 16:42:01.523880 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:01.523845 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" event={"ID":"5ca05fd7-987f-4dac-be35-06106b35ff67","Type":"ContainerStarted","Data":"6067499fd9f1cc2e36d6f8808a62c121adc92fdde1ef955813b4c2ad7087a7c1"} Jun 11 16:42:01.524336 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:01.523894 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" event={"ID":"5ca05fd7-987f-4dac-be35-06106b35ff67","Type":"ContainerStarted","Data":"e88d0596a06c5ae6c81f41546c6ce8cdec06ea14c9616b42c08a585ffee08ae2"} Jun 11 16:42:01.524336 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:01.523946 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:42:01.525322 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:01.525298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" event={"ID":"be962de3-8e94-4e1c-9e12-ec26d6be919a","Type":"ContainerStarted","Data":"4f878a27490fa16b4692dce72f4d285f2655b0c96468ead8612cb120556551a0"} Jun 11 16:42:01.525437 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:01.525337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" event={"ID":"be962de3-8e94-4e1c-9e12-ec26d6be919a","Type":"ContainerStarted","Data":"629bea8ec6eacec8c6c588948b324b3a7cb42f5e21fac95a02e1039d1eff08b4"} Jun 11 16:42:01.543199 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:01.543146 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" podStartSLOduration=17.543129273 podStartE2EDuration="17.543129273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:01.54274547 +0000 UTC m=+188.143740228" watchObservedRunningTime="2026-06-11 16:42:01.543129273 +0000 UTC m=+188.144124028" Jun 11 16:42:01.563824 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:01.563765 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" podStartSLOduration=17.563749255 podStartE2EDuration="17.563749255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:01.562529792 +0000 UTC m=+188.163524551" watchObservedRunningTime="2026-06-11 16:42:01.563749255 +0000 UTC m=+188.164744011" Jun 11 16:42:02.453392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:02.453348 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:02.455998 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:02.455972 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:02.529310 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:02.529279 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:02.530622 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:02.530596 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74fb4b67bf-txkdz" Jun 11 16:42:06.837020 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:06.836989 2563 scope.go:117] "RemoveContainer" containerID="a7f78ffeba073ab3256b9e773658ca8de1503285abe15f0c3068a16d95c85202" Jun 11 16:42:07.549565 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:07.549537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:42:07.549756 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:07.549616 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" event={"ID":"3ff6d341-6054-4478-a54e-e11705d7d80e","Type":"ContainerStarted","Data":"caf466430d714c46e03a330a865d011f16665182a0ee7e8c910e74521079b670"} Jun 11 16:42:07.549986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:07.549967 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:42:07.567474 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:07.567421 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" podStartSLOduration=20.024758166 podStartE2EDuration="23.567403681s" totalImagesPullingTime="3.542645515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:07.565840044 +0000 UTC m=+194.166834800" watchObservedRunningTime="2026-06-11 16:42:07.567403681 +0000 UTC m=+194.168398485" Jun 11 16:42:07.888465 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:07.888388 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-m4b6n" Jun 11 16:42:12.704997 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.704959 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bd4f98957-m2dcx"] Jun 11 16:42:12.711778 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.711749 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-nv9k6"] Jun 11 16:42:12.714771 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.714748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nv9k6" Jun 11 16:42:12.717484 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.717459 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:42:12.717484 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.717480 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bxlgs\"" Jun 11 16:42:12.717662 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.717484 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:42:12.724779 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.724754 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nv9k6"] Jun 11 16:42:12.787191 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.787157 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rvhh9"] Jun 11 16:42:12.790847 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.790818 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.793749 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.793722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knndw\" (UniqueName: \"kubernetes.io/projected/cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a-kube-api-access-knndw\") pod \"downloads-6657875f97-nv9k6\" (UID: \"cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a\") " pod="openshift-console/downloads-6657875f97-nv9k6" Jun 11 16:42:12.795180 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.795049 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6jghc\"" Jun 11 16:42:12.795545 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.795523 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:42:12.798321 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.798300 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:42:12.805534 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.805510 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvhh9"] Jun 11 16:42:12.894668 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.894633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d801cab-e9c2-4f5e-842e-042ab13068c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.894668 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.894677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d801cab-e9c2-4f5e-842e-042ab13068c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.894930 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.894705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knndw\" (UniqueName: \"kubernetes.io/projected/cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a-kube-api-access-knndw\") pod \"downloads-6657875f97-nv9k6\" (UID: \"cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a\") " pod="openshift-console/downloads-6657875f97-nv9k6" Jun 11 16:42:12.894930 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.894737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d801cab-e9c2-4f5e-842e-042ab13068c6-data-volume\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.894930 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.894859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmbx\" (UniqueName: \"kubernetes.io/projected/7d801cab-e9c2-4f5e-842e-042ab13068c6-kube-api-access-cjmbx\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.895084 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.895062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d801cab-e9c2-4f5e-842e-042ab13068c6-crio-socket\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.905358 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.905322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knndw\" (UniqueName: \"kubernetes.io/projected/cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a-kube-api-access-knndw\") pod \"downloads-6657875f97-nv9k6\" (UID: \"cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a\") " pod="openshift-console/downloads-6657875f97-nv9k6" Jun 11 16:42:12.996307 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.996212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d801cab-e9c2-4f5e-842e-042ab13068c6-data-volume\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.996307 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.996257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmbx\" (UniqueName: \"kubernetes.io/projected/7d801cab-e9c2-4f5e-842e-042ab13068c6-kube-api-access-cjmbx\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.996307 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.996295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d801cab-e9c2-4f5e-842e-042ab13068c6-crio-socket\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.996696 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.996350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d801cab-e9c2-4f5e-842e-042ab13068c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.996696 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.996368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d801cab-e9c2-4f5e-842e-042ab13068c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.996696 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.996431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d801cab-e9c2-4f5e-842e-042ab13068c6-crio-socket\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.996696 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.996663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d801cab-e9c2-4f5e-842e-042ab13068c6-data-volume\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.997688 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.997671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d801cab-e9c2-4f5e-842e-042ab13068c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:12.998752 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:12.998729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d801cab-e9c2-4f5e-842e-042ab13068c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:13.007493 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.007471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmbx\" (UniqueName: \"kubernetes.io/projected/7d801cab-e9c2-4f5e-842e-042ab13068c6-kube-api-access-cjmbx\") pod \"insights-runtime-extractor-rvhh9\" (UID: \"7d801cab-e9c2-4f5e-842e-042ab13068c6\") " pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:13.026045 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.026003 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nv9k6" Jun 11 16:42:13.101713 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.101685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvhh9" Jun 11 16:42:13.163940 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.163908 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nv9k6"] Jun 11 16:42:13.166935 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:13.166899 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbb80ec_a0a5_41f2_9d6e_58f0c10a731a.slice/crio-27ca58ed5bf9f00baffb4debd65c701c01fc7fc6a6f52a72c6469dba83908e3c WatchSource:0}: Error finding container 27ca58ed5bf9f00baffb4debd65c701c01fc7fc6a6f52a72c6469dba83908e3c: Status 404 returned error can't find the container with id 27ca58ed5bf9f00baffb4debd65c701c01fc7fc6a6f52a72c6469dba83908e3c Jun 11 16:42:13.235636 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.235611 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvhh9"] Jun 11 16:42:13.237778 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:13.237751 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d801cab_e9c2_4f5e_842e_042ab13068c6.slice/crio-c91b66b7dfe6509851b87e0eafe2a9166be10df3700d00dd137b8cbdb6912afc WatchSource:0}: Error finding container c91b66b7dfe6509851b87e0eafe2a9166be10df3700d00dd137b8cbdb6912afc: Status 404 returned error can't find the container with id c91b66b7dfe6509851b87e0eafe2a9166be10df3700d00dd137b8cbdb6912afc Jun 11 16:42:13.574673 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.574639 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvhh9" event={"ID":"7d801cab-e9c2-4f5e-842e-042ab13068c6","Type":"ContainerStarted","Data":"19e8e37ca4e0f15eea872186c0eaa099d8ab96e9b7f7569f79177b66bb4f00eb"} Jun 11 16:42:13.574866 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.574742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvhh9" event={"ID":"7d801cab-e9c2-4f5e-842e-042ab13068c6","Type":"ContainerStarted","Data":"c91b66b7dfe6509851b87e0eafe2a9166be10df3700d00dd137b8cbdb6912afc"} Jun 11 16:42:13.575773 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:13.575749 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nv9k6" event={"ID":"cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a","Type":"ContainerStarted","Data":"27ca58ed5bf9f00baffb4debd65c701c01fc7fc6a6f52a72c6469dba83908e3c"} Jun 11 16:42:14.581334 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:14.581288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvhh9" event={"ID":"7d801cab-e9c2-4f5e-842e-042ab13068c6","Type":"ContainerStarted","Data":"dad17690a35dcd5b9b7bbf262d86b36d93a1af2523489a8a4f3a19050dcdfd49"} Jun 11 16:42:16.527842 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:16.527800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:42:16.530590 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:16.530547 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bff96e85-e3e3-4afc-af8b-283db4f74654-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-czml2\" (UID: \"bff96e85-e3e3-4afc-af8b-283db4f74654\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:42:16.590562 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:16.590522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvhh9" event={"ID":"7d801cab-e9c2-4f5e-842e-042ab13068c6","Type":"ContainerStarted","Data":"41bec8b87cd06a85d989d93eb7ca4dfd85fce44f6e124b89e4f3750f17f531c9"} Jun 11 16:42:16.611595 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:16.611519 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rvhh9" podStartSLOduration=2.153077806 podStartE2EDuration="4.611504759s" totalImagesPullingTime="2.458426953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:42:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:16.611138344 +0000 UTC m=+203.212133108" watchObservedRunningTime="2026-06-11 16:42:16.611504759 +0000 UTC m=+203.212499492" Jun 11 16:42:16.715698 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:16.715657 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qsg26\"" Jun 11 16:42:16.723868 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:16.723836 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" Jun 11 16:42:16.857653 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:16.857618 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2"] Jun 11 16:42:16.860979 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:16.860951 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff96e85_e3e3_4afc_af8b_283db4f74654.slice/crio-1f68474bc6d02e7630a94d305aa49536290c9a8b7ff9503b241d7e694b278279 WatchSource:0}: Error finding container 1f68474bc6d02e7630a94d305aa49536290c9a8b7ff9503b241d7e694b278279: Status 404 returned error can't find the container with id 1f68474bc6d02e7630a94d305aa49536290c9a8b7ff9503b241d7e694b278279 Jun 11 16:42:17.595352 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:17.595305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" event={"ID":"bff96e85-e3e3-4afc-af8b-283db4f74654","Type":"ContainerStarted","Data":"1f68474bc6d02e7630a94d305aa49536290c9a8b7ff9503b241d7e694b278279"} Jun 11 16:42:19.284859 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.284828 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq"] Jun 11 16:42:19.288133 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.288109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" Jun 11 16:42:19.290899 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.290774 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q9pvt\"" Jun 11 16:42:19.290899 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.290814 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 16:42:19.297328 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.297192 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq"] Jun 11 16:42:19.355027 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.354992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c9da8a90-8f83-46c5-b97b-601fb60dbd83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-dgcjq\" (UID: \"c9da8a90-8f83-46c5-b97b-601fb60dbd83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" Jun 11 16:42:19.455773 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.455726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c9da8a90-8f83-46c5-b97b-601fb60dbd83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-dgcjq\" (UID: \"c9da8a90-8f83-46c5-b97b-601fb60dbd83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" Jun 11 16:42:19.458258 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.458229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c9da8a90-8f83-46c5-b97b-601fb60dbd83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-dgcjq\" (UID: \"c9da8a90-8f83-46c5-b97b-601fb60dbd83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" Jun 11 16:42:19.600025 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.599932 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" Jun 11 16:42:19.606136 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.606027 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" event={"ID":"bff96e85-e3e3-4afc-af8b-283db4f74654","Type":"ContainerStarted","Data":"98f7a45df8c39d5d3783a7d07a78e25dcdf9b9656b6e3bcf399fcd2219fdde60"} Jun 11 16:42:19.733895 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.733840 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-czml2" podStartSLOduration=33.800212994 podStartE2EDuration="35.733820669s" totalImagesPullingTime="1.933607675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:19.622736115 +0000 UTC m=+206.223730872" watchObservedRunningTime="2026-06-11 16:42:19.733820669 +0000 UTC m=+206.334815482" Jun 11 16:42:19.734140 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:19.734125 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq"] Jun 11 16:42:19.737291 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:19.737252 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9da8a90_8f83_46c5_b97b_601fb60dbd83.slice/crio-c13025d3db99a66d7c3913c0dc5f35c86e7645ab66da7cc7c4753cc92c7adae4 WatchSource:0}: Error finding container c13025d3db99a66d7c3913c0dc5f35c86e7645ab66da7cc7c4753cc92c7adae4: Status 404 returned error can't find the container with id c13025d3db99a66d7c3913c0dc5f35c86e7645ab66da7cc7c4753cc92c7adae4 Jun 11 16:42:20.611340 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:20.611268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" event={"ID":"c9da8a90-8f83-46c5-b97b-601fb60dbd83","Type":"ContainerStarted","Data":"c13025d3db99a66d7c3913c0dc5f35c86e7645ab66da7cc7c4753cc92c7adae4"} Jun 11 16:42:21.616686 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:21.616642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" event={"ID":"c9da8a90-8f83-46c5-b97b-601fb60dbd83","Type":"ContainerStarted","Data":"8a10f27464901d876b3a91b4cfc03940647652798d948e537e3e58b312d17272"} Jun 11 16:42:21.617134 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:21.616949 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" Jun 11 16:42:21.622004 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:21.621978 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" Jun 11 16:42:21.634157 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:21.634104 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-dgcjq" podStartSLOduration=1.506502588 podStartE2EDuration="2.634086353s" totalImagesPullingTime="1.127583765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:21.632489406 +0000 UTC m=+208.233484163" watchObservedRunningTime="2026-06-11 16:42:21.634086353 +0000 UTC m=+208.235081109" Jun 11 16:42:22.711102 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:22.711061 2563 patch_prober.go:28] interesting pod/image-registry-7bd4f98957-m2dcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:42:22.711518 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:22.711120 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" podUID="5ca05fd7-987f-4dac-be35-06106b35ff67" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:42:27.673358 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.673313 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc"] Jun 11 16:42:27.677588 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.677322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.681883 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.681474 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:42:27.681883 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.681729 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 16:42:27.684122 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.684100 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:42:27.685878 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.684329 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pqzjg\"" Jun 11 16:42:27.692133 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.692054 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc"] Jun 11 16:42:27.698988 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.695591 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-67wxg"] Jun 11 16:42:27.699894 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.699872 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.703249 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.703117 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:42:27.703691 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.703409 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hg65h\"" Jun 11 16:42:27.703691 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.703535 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:42:27.703691 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.703639 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:42:27.831338 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21c9348b-fcbc-429a-9377-46db78ca526f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.831513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwf6c\" (UniqueName: \"kubernetes.io/projected/21c9348b-fcbc-429a-9377-46db78ca526f-kube-api-access-lwf6c\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.831513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-wtmp\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aab7579-3ee8-4779-812a-d6ce28489413-metrics-client-ca\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.831754 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-accelerators-collector-config\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831754 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-247vj\" (UniqueName: \"kubernetes.io/projected/7aab7579-3ee8-4779-812a-d6ce28489413-kube-api-access-247vj\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831754 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831600 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-root\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831902 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831902 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-sys\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831902 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-textfile\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.831902 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-tls\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.832100 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.831902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.933268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.933268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-accelerators-collector-config\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247vj\" (UniqueName: \"kubernetes.io/projected/7aab7579-3ee8-4779-812a-d6ce28489413-kube-api-access-247vj\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933298 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-root\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-sys\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-textfile\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-tls\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21c9348b-fcbc-429a-9377-46db78ca526f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.933593 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwf6c\" (UniqueName: \"kubernetes.io/projected/21c9348b-fcbc-429a-9377-46db78ca526f-kube-api-access-lwf6c\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.933959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-wtmp\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aab7579-3ee8-4779-812a-d6ce28489413-metrics-client-ca\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-sys\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.933959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.933751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-root\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.934173 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.934018 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-wtmp\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.934173 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:42:27.934097 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 16:42:27.934173 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:42:27.934158 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-tls podName:21c9348b-fcbc-429a-9377-46db78ca526f nodeName:}" failed. No retries permitted until 2026-06-11 16:42:28.43413697 +0000 UTC m=+215.035131719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-4dcdc" (UID: "21c9348b-fcbc-429a-9377-46db78ca526f") : secret "openshift-state-metrics-tls" not found Jun 11 16:42:27.934173 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.934159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-textfile\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.934379 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:42:27.934262 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 16:42:27.934379 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:42:27.934317 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-tls podName:7aab7579-3ee8-4779-812a-d6ce28489413 nodeName:}" failed. No retries permitted until 2026-06-11 16:42:28.434300585 +0000 UTC m=+215.035295327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-tls") pod "node-exporter-67wxg" (UID: "7aab7579-3ee8-4779-812a-d6ce28489413") : secret "node-exporter-tls" not found Jun 11 16:42:27.934590 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.934549 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aab7579-3ee8-4779-812a-d6ce28489413-metrics-client-ca\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.934907 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.934860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-accelerators-collector-config\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.935018 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.934980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21c9348b-fcbc-429a-9377-46db78ca526f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.937521 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.937478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.938100 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.938078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:27.943417 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.943365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwf6c\" (UniqueName: \"kubernetes.io/projected/21c9348b-fcbc-429a-9377-46db78ca526f-kube-api-access-lwf6c\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:27.948647 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:27.948595 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-247vj\" (UniqueName: \"kubernetes.io/projected/7aab7579-3ee8-4779-812a-d6ce28489413-kube-api-access-247vj\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:28.437730 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.437693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:28.437915 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.437775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-tls\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:28.440537 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.440507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21c9348b-fcbc-429a-9377-46db78ca526f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4dcdc\" (UID: \"21c9348b-fcbc-429a-9377-46db78ca526f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:28.440537 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.440520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aab7579-3ee8-4779-812a-d6ce28489413-node-exporter-tls\") pod \"node-exporter-67wxg\" (UID: \"7aab7579-3ee8-4779-812a-d6ce28489413\") " pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:28.592964 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.592922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" Jun 11 16:42:28.615345 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.615302 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67wxg" Jun 11 16:42:28.629188 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:28.629151 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aab7579_3ee8_4779_812a_d6ce28489413.slice/crio-863dd98ba1d3c356def10c136b49275d6ee73521c037602f4ba35617a26b9308 WatchSource:0}: Error finding container 863dd98ba1d3c356def10c136b49275d6ee73521c037602f4ba35617a26b9308: Status 404 returned error can't find the container with id 863dd98ba1d3c356def10c136b49275d6ee73521c037602f4ba35617a26b9308 Jun 11 16:42:28.642404 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.642369 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67wxg" event={"ID":"7aab7579-3ee8-4779-812a-d6ce28489413","Type":"ContainerStarted","Data":"863dd98ba1d3c356def10c136b49275d6ee73521c037602f4ba35617a26b9308"} Jun 11 16:42:28.750051 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:28.750013 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc"] Jun 11 16:42:28.753459 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:28.753401 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c9348b_fcbc_429a_9377_46db78ca526f.slice/crio-f11d31129e6256d2d8150062889969fcc01a5c38683d7116bc940191d4ab0f8c WatchSource:0}: Error finding container f11d31129e6256d2d8150062889969fcc01a5c38683d7116bc940191d4ab0f8c: Status 404 returned error can't find the container with id f11d31129e6256d2d8150062889969fcc01a5c38683d7116bc940191d4ab0f8c Jun 11 16:42:29.647989 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.647946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" event={"ID":"21c9348b-fcbc-429a-9377-46db78ca526f","Type":"ContainerStarted","Data":"3628de58730f3a694a1731be98be96c40c5ac5c7dcd5fafa7e19896966aa88fd"} Jun 11 16:42:29.648177 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.648058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" event={"ID":"21c9348b-fcbc-429a-9377-46db78ca526f","Type":"ContainerStarted","Data":"f11d31129e6256d2d8150062889969fcc01a5c38683d7116bc940191d4ab0f8c"} Jun 11 16:42:29.970917 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.970836 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c845dc685-dhb8f"] Jun 11 16:42:29.980086 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.980056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:29.984365 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.984184 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:42:29.984365 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.984207 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:42:29.984365 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.984256 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x9qr7\"" Jun 11 16:42:29.984365 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.984299 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:42:29.984365 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.984347 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:42:29.984800 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.984395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:42:29.987303 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.987242 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c845dc685-dhb8f"] Jun 11 16:42:29.991397 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:29.991374 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:42:30.158268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.158228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6hz\" (UniqueName: \"kubernetes.io/projected/79985ee1-15ba-45b7-b178-90618ce6f9a2-kube-api-access-ql6hz\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.158413 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.158292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-oauth-config\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.158413 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.158341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-service-ca\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.158413 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.158383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-config\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.158586 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.158506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-serving-cert\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.158586 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.158538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-oauth-serving-cert\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.158666 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.158612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-trusted-ca-bundle\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260026 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.259934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-trusted-ca-bundle\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260026 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.259996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6hz\" (UniqueName: \"kubernetes.io/projected/79985ee1-15ba-45b7-b178-90618ce6f9a2-kube-api-access-ql6hz\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260249 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-oauth-config\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260249 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-service-ca\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260249 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260090 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-config\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260249 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-serving-cert\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260249 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-oauth-serving-cert\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.260931 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-service-ca\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.261052 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-trusted-ca-bundle\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.261052 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.260963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-oauth-serving-cert\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.261162 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.261096 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-config\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.263204 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.263180 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-oauth-config\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.263358 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.263337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-serving-cert\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.268854 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.268830 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6hz\" (UniqueName: \"kubernetes.io/projected/79985ee1-15ba-45b7-b178-90618ce6f9a2-kube-api-access-ql6hz\") pod \"console-c845dc685-dhb8f\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.292911 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.292870 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:30.663822 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.663783 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55f4698498-j826g"] Jun 11 16:42:30.667877 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.667849 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.671073 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.671044 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 16:42:30.671073 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.671060 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 16:42:30.671273 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.671053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-92gcd\"" Jun 11 16:42:30.671273 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.671185 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 16:42:30.671513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.671391 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ff8p5ag72fl7s\"" Jun 11 16:42:30.671513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.671444 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 16:42:30.672039 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.672016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 16:42:30.680729 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.680634 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55f4698498-j826g"] Jun 11 16:42:30.765003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.764961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.765187 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.765017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-grpc-tls\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.765187 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.765157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.765303 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.765215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.765303 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.765259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b60878c-06e1-4c17-a3e6-0487bf412c2d-metrics-client-ca\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.765303 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.765298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vfvv\" (UniqueName: \"kubernetes.io/projected/8b60878c-06e1-4c17-a3e6-0487bf412c2d-kube-api-access-8vfvv\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.765453 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.765327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-tls\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.765453 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.765357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.865947 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.865897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.866148 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.865972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.866148 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.866010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b60878c-06e1-4c17-a3e6-0487bf412c2d-metrics-client-ca\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.866148 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.866046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vfvv\" (UniqueName: \"kubernetes.io/projected/8b60878c-06e1-4c17-a3e6-0487bf412c2d-kube-api-access-8vfvv\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.866148 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.866070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-tls\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.866148 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.866098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.866395 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.866164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.866395 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.866193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-grpc-tls\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.867037 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.866981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b60878c-06e1-4c17-a3e6-0487bf412c2d-metrics-client-ca\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.870109 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.870080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.870677 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.870654 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-tls\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.871257 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.871227 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.871350 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.871269 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-grpc-tls\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.871812 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.871789 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.873232 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.873172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b60878c-06e1-4c17-a3e6-0487bf412c2d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.875409 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.875365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vfvv\" (UniqueName: \"kubernetes.io/projected/8b60878c-06e1-4c17-a3e6-0487bf412c2d-kube-api-access-8vfvv\") pod \"thanos-querier-55f4698498-j826g\" (UID: \"8b60878c-06e1-4c17-a3e6-0487bf412c2d\") " pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:30.981192 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:30.981108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:32.456793 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.456754 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv"] Jun 11 16:42:32.460336 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.460294 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:32.462872 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.462843 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 16:42:32.463009 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.462904 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tvpr8\"" Jun 11 16:42:32.468138 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.468109 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv"] Jun 11 16:42:32.582182 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.582143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6bedfbdc-ca9b-4551-9c86-02b36aa4bacb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7vmpv\" (UID: \"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:32.582356 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.582185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r6c6\" (UniqueName: \"kubernetes.io/projected/6bedfbdc-ca9b-4551-9c86-02b36aa4bacb-kube-api-access-8r6c6\") pod \"monitoring-plugin-76b68cc874-7vmpv\" (UID: \"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:32.683282 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.683246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6bedfbdc-ca9b-4551-9c86-02b36aa4bacb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7vmpv\" (UID: \"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:32.683282 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.683288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r6c6\" (UniqueName: \"kubernetes.io/projected/6bedfbdc-ca9b-4551-9c86-02b36aa4bacb-kube-api-access-8r6c6\") pod \"monitoring-plugin-76b68cc874-7vmpv\" (UID: \"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:32.686236 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.686206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6bedfbdc-ca9b-4551-9c86-02b36aa4bacb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7vmpv\" (UID: \"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:32.694722 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.694671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r6c6\" (UniqueName: \"kubernetes.io/projected/6bedfbdc-ca9b-4551-9c86-02b36aa4bacb-kube-api-access-8r6c6\") pod \"monitoring-plugin-76b68cc874-7vmpv\" (UID: \"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:32.710563 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.710473 2563 patch_prober.go:28] interesting pod/image-registry-7bd4f98957-m2dcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:42:32.710706 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.710540 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" podUID="5ca05fd7-987f-4dac-be35-06106b35ff67" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:42:32.774121 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:32.774079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:36.113276 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.113246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55f4698498-j826g"] Jun 11 16:42:36.118687 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:36.118655 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b60878c_06e1_4c17_a3e6_0487bf412c2d.slice/crio-3762da770d842b1030a6d19993d9df44cfc4711f1fdc809b79d8d547040e2322 WatchSource:0}: Error finding container 3762da770d842b1030a6d19993d9df44cfc4711f1fdc809b79d8d547040e2322: Status 404 returned error can't find the container with id 3762da770d842b1030a6d19993d9df44cfc4711f1fdc809b79d8d547040e2322 Jun 11 16:42:36.125059 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.125032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c845dc685-dhb8f"] Jun 11 16:42:36.128759 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:36.128731 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79985ee1_15ba_45b7_b178_90618ce6f9a2.slice/crio-6fdb1fe66848a73a1f3fa2ce880ac9d209c6009f1be4e656b30876a783eb0556 WatchSource:0}: Error finding container 6fdb1fe66848a73a1f3fa2ce880ac9d209c6009f1be4e656b30876a783eb0556: Status 404 returned error can't find the container with id 6fdb1fe66848a73a1f3fa2ce880ac9d209c6009f1be4e656b30876a783eb0556 Jun 11 16:42:36.330092 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.330054 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv"] Jun 11 16:42:36.574118 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:36.574078 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bedfbdc_ca9b_4551_9c86_02b36aa4bacb.slice/crio-fcad14dc345dd960cdeeb83745f9a4d2fb475c14febb0f5b033283f097b9daa9 WatchSource:0}: Error finding container fcad14dc345dd960cdeeb83745f9a4d2fb475c14febb0f5b033283f097b9daa9: Status 404 returned error can't find the container with id fcad14dc345dd960cdeeb83745f9a4d2fb475c14febb0f5b033283f097b9daa9 Jun 11 16:42:36.679511 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.679474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" event={"ID":"21c9348b-fcbc-429a-9377-46db78ca526f","Type":"ContainerStarted","Data":"34928533479e9e26575c416d98b169aea4dc69990e974b92ba64b49ef0bfb07d"} Jun 11 16:42:36.681250 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.681220 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nv9k6" event={"ID":"cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a","Type":"ContainerStarted","Data":"af3b8790e1529a9e899a79e62693f34028a16c932c5e8a44f68dbab123be7218"} Jun 11 16:42:36.681537 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.681475 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-nv9k6" Jun 11 16:42:36.683061 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.682895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" event={"ID":"8b60878c-06e1-4c17-a3e6-0487bf412c2d","Type":"ContainerStarted","Data":"3762da770d842b1030a6d19993d9df44cfc4711f1fdc809b79d8d547040e2322"} Jun 11 16:42:36.684277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.684225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c845dc685-dhb8f" event={"ID":"79985ee1-15ba-45b7-b178-90618ce6f9a2","Type":"ContainerStarted","Data":"6fdb1fe66848a73a1f3fa2ce880ac9d209c6009f1be4e656b30876a783eb0556"} Jun 11 16:42:36.685542 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.685520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" event={"ID":"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb","Type":"ContainerStarted","Data":"fcad14dc345dd960cdeeb83745f9a4d2fb475c14febb0f5b033283f097b9daa9"} Jun 11 16:42:36.689128 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.689102 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-nv9k6" Jun 11 16:42:36.699348 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:36.699290 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-nv9k6" podStartSLOduration=1.817990757 podStartE2EDuration="24.699271751s" totalImagesPullingTime="22.881280994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:36.698869836 +0000 UTC m=+223.299864587" watchObservedRunningTime="2026-06-11 16:42:36.699271751 +0000 UTC m=+223.300266507" Jun 11 16:42:37.701579 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:37.700912 2563 generic.go:356] "Generic (PLEG): container finished" podID="7aab7579-3ee8-4779-812a-d6ce28489413" containerID="28f551294b73dc137822f84f779e52393df41101ed8cd60c8fd535b46f8e02e4" exitCode=0 Jun 11 16:42:37.703110 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:37.703003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67wxg" event={"ID":"7aab7579-3ee8-4779-812a-d6ce28489413","Type":"ContainerDied","Data":"28f551294b73dc137822f84f779e52393df41101ed8cd60c8fd535b46f8e02e4"} Jun 11 16:42:37.730156 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:37.729912 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" podUID="5ca05fd7-987f-4dac-be35-06106b35ff67" containerName="registry" containerID="cri-o://6067499fd9f1cc2e36d6f8808a62c121adc92fdde1ef955813b4c2ad7087a7c1" gracePeriod=30 Jun 11 16:42:38.709584 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.709204 2563 generic.go:356] "Generic (PLEG): container finished" podID="5ca05fd7-987f-4dac-be35-06106b35ff67" containerID="6067499fd9f1cc2e36d6f8808a62c121adc92fdde1ef955813b4c2ad7087a7c1" exitCode=0 Jun 11 16:42:38.710135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.709700 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" event={"ID":"5ca05fd7-987f-4dac-be35-06106b35ff67","Type":"ContainerDied","Data":"6067499fd9f1cc2e36d6f8808a62c121adc92fdde1ef955813b4c2ad7087a7c1"} Jun 11 16:42:38.847093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.845683 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75979c6d85-5jxp2"] Jun 11 16:42:38.884778 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.884736 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75979c6d85-5jxp2"] Jun 11 16:42:38.884966 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.884944 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:38.955774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.955437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-oauth-config\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:38.955774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.955548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6t8j\" (UniqueName: \"kubernetes.io/projected/94494081-2fbd-4516-a8ea-ca914ac23943-kube-api-access-d6t8j\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:38.955774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.955610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-console-config\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:38.955774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.955677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-serving-cert\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:38.955774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.955704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-oauth-serving-cert\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:38.955774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.955741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-trusted-ca-bundle\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:38.956216 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:38.955820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-service-ca\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.056784 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.056746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-oauth-config\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.056971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.056809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6t8j\" (UniqueName: \"kubernetes.io/projected/94494081-2fbd-4516-a8ea-ca914ac23943-kube-api-access-d6t8j\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.056971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.056837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-console-config\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.056971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.056876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-serving-cert\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.056971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.056917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-oauth-serving-cert\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.056971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.056954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-trusted-ca-bundle\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.057228 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.056990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-service-ca\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.057733 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.057707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-console-config\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.057733 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.057723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-service-ca\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.058097 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.058066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-trusted-ca-bundle\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.058457 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.058420 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-oauth-serving-cert\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.060139 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.060117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-oauth-config\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.060457 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.060436 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-serving-cert\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.069056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.069032 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6t8j\" (UniqueName: \"kubernetes.io/projected/94494081-2fbd-4516-a8ea-ca914ac23943-kube-api-access-d6t8j\") pod \"console-75979c6d85-5jxp2\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.167246 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.167210 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:42:39.197843 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.197798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:39.259087 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259044 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-installation-pull-secrets\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259139 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-certificates\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259187 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq8g8\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-kube-api-access-cq8g8\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259210 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-bound-sa-token\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259244 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-trusted-ca\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259274 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259321 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-image-registry-private-configuration\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259364 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca05fd7-987f-4dac-be35-06106b35ff67-ca-trust-extracted\") pod \"5ca05fd7-987f-4dac-be35-06106b35ff67\" (UID: \"5ca05fd7-987f-4dac-be35-06106b35ff67\") " Jun 11 16:42:39.259936 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.259893 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:42:39.260217 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.260168 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:42:39.262285 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.262235 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-kube-api-access-cq8g8" (OuterVolumeSpecName: "kube-api-access-cq8g8") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "kube-api-access-cq8g8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:39.262579 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.262489 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:42:39.262579 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.262508 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:42:39.262579 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.262494 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:39.262579 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.262547 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:39.271432 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.271401 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ca05fd7-987f-4dac-be35-06106b35ff67-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5ca05fd7-987f-4dac-be35-06106b35ff67" (UID: "5ca05fd7-987f-4dac-be35-06106b35ff67"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:39.360505 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360417 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-installation-pull-secrets\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.360505 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360454 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-certificates\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.360505 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360470 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq8g8\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-kube-api-access-cq8g8\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.360505 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360508 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-bound-sa-token\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.360841 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360518 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05fd7-987f-4dac-be35-06106b35ff67-trusted-ca\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.360841 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360526 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca05fd7-987f-4dac-be35-06106b35ff67-registry-tls\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.360841 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360535 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca05fd7-987f-4dac-be35-06106b35ff67-image-registry-private-configuration\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.360841 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.360543 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca05fd7-987f-4dac-be35-06106b35ff67-ca-trust-extracted\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:42:39.716580 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.716462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" event={"ID":"5ca05fd7-987f-4dac-be35-06106b35ff67","Type":"ContainerDied","Data":"e88d0596a06c5ae6c81f41546c6ce8cdec06ea14c9616b42c08a585ffee08ae2"} Jun 11 16:42:39.716580 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.716534 2563 scope.go:117] "RemoveContainer" containerID="6067499fd9f1cc2e36d6f8808a62c121adc92fdde1ef955813b4c2ad7087a7c1" Jun 11 16:42:39.717077 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.716725 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd4f98957-m2dcx" Jun 11 16:42:39.744574 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.744524 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bd4f98957-m2dcx"] Jun 11 16:42:39.748031 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.747994 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bd4f98957-m2dcx"] Jun 11 16:42:39.846298 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:39.845953 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ca05fd7-987f-4dac-be35-06106b35ff67" path="/var/lib/kubelet/pods/5ca05fd7-987f-4dac-be35-06106b35ff67/volumes" Jun 11 16:42:42.041913 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.041876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75979c6d85-5jxp2"] Jun 11 16:42:42.046234 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:42:42.046201 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94494081_2fbd_4516_a8ea_ca914ac23943.slice/crio-8fd269a828fd285af3746ff02a673b52c2d2fcfd98146f06d149420bd4f5da87 WatchSource:0}: Error finding container 8fd269a828fd285af3746ff02a673b52c2d2fcfd98146f06d149420bd4f5da87: Status 404 returned error can't find the container with id 8fd269a828fd285af3746ff02a673b52c2d2fcfd98146f06d149420bd4f5da87 Jun 11 16:42:42.732408 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.732324 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67wxg" event={"ID":"7aab7579-3ee8-4779-812a-d6ce28489413","Type":"ContainerStarted","Data":"067fc7f05f18dd88cdd9645fb5dd358c61ff8db8bdc500b756f5f458de4e32d1"} Jun 11 16:42:42.732408 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.732385 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67wxg" event={"ID":"7aab7579-3ee8-4779-812a-d6ce28489413","Type":"ContainerStarted","Data":"fda6b3b85a4a9e27d7ae6eed6915c1ba68b908f072e7e94f752e2c379dc52b45"} Jun 11 16:42:42.734261 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.734225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c845dc685-dhb8f" event={"ID":"79985ee1-15ba-45b7-b178-90618ce6f9a2","Type":"ContainerStarted","Data":"3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5"} Jun 11 16:42:42.736149 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.735988 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75979c6d85-5jxp2" event={"ID":"94494081-2fbd-4516-a8ea-ca914ac23943","Type":"ContainerStarted","Data":"eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5"} Jun 11 16:42:42.736149 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.736032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75979c6d85-5jxp2" event={"ID":"94494081-2fbd-4516-a8ea-ca914ac23943","Type":"ContainerStarted","Data":"8fd269a828fd285af3746ff02a673b52c2d2fcfd98146f06d149420bd4f5da87"} Jun 11 16:42:42.737707 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.737681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" event={"ID":"6bedfbdc-ca9b-4551-9c86-02b36aa4bacb","Type":"ContainerStarted","Data":"8615faa7016639c72f2ffb45e5164b3d2d24d4b7174f6484436fb22c353c85ad"} Jun 11 16:42:42.737813 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.737800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:42.740427 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.740400 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" event={"ID":"21c9348b-fcbc-429a-9377-46db78ca526f","Type":"ContainerStarted","Data":"6babfc9a27fcf190678e9ae79d531f9a4797648bb79aedb841e126d4420b92ac"} Jun 11 16:42:42.744260 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.744208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" Jun 11 16:42:42.744260 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.744249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" event={"ID":"8b60878c-06e1-4c17-a3e6-0487bf412c2d","Type":"ContainerStarted","Data":"eb0b7e0f859dab98ae0ad06bd25bb3bd0c2ce90e46ab0b1d4a776159e26fd940"} Jun 11 16:42:42.744385 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.744290 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" event={"ID":"8b60878c-06e1-4c17-a3e6-0487bf412c2d","Type":"ContainerStarted","Data":"0a3d49ba426115381b44d82ee59b7ca8acba7e05a4e90d8673d11503a004c84d"} Jun 11 16:42:42.744385 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.744317 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" event={"ID":"8b60878c-06e1-4c17-a3e6-0487bf412c2d","Type":"ContainerStarted","Data":"278835585e8d6848011575ebcc08a97127869dd43e653ef6b575c4c73068b0fb"} Jun 11 16:42:42.755175 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.755129 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-67wxg" podStartSLOduration=7.646464381 podStartE2EDuration="15.755114399s" totalImagesPullingTime="7.990494564s" totalInitContainerRuntime="118.155454ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:42.754862287 +0000 UTC m=+229.355857034" watchObservedRunningTime="2026-06-11 16:42:42.755114399 +0000 UTC m=+229.356109157" Jun 11 16:42:42.774138 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.774074 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c845dc685-dhb8f" podStartSLOduration=8.031538522 podStartE2EDuration="13.774055176s" totalImagesPullingTime="5.742516654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:42.773351768 +0000 UTC m=+229.374346525" watchObservedRunningTime="2026-06-11 16:42:42.774055176 +0000 UTC m=+229.375049934" Jun 11 16:42:42.791997 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.791931 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7vmpv" podStartSLOduration=5.50697154 podStartE2EDuration="10.79190863s" totalImagesPullingTime="5.28493709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:42.790790966 +0000 UTC m=+229.391785722" watchObservedRunningTime="2026-06-11 16:42:42.79190863 +0000 UTC m=+229.392903387" Jun 11 16:42:42.811488 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.811414 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75979c6d85-5jxp2" podStartSLOduration=4.811393398 podStartE2EDuration="4.811393398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:42.810038793 +0000 UTC m=+229.411033551" watchObservedRunningTime="2026-06-11 16:42:42.811393398 +0000 UTC m=+229.412388154" Jun 11 16:42:42.828289 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:42.828231 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4dcdc" podStartSLOduration=10.074003335 podStartE2EDuration="15.828209477s" totalImagesPullingTime="5.754206142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:42.82743069 +0000 UTC m=+229.428425459" watchObservedRunningTime="2026-06-11 16:42:42.828209477 +0000 UTC m=+229.429204214" Jun 11 16:42:43.753355 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:43.752747 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" event={"ID":"8b60878c-06e1-4c17-a3e6-0487bf412c2d","Type":"ContainerStarted","Data":"99738c301ddde53104cb1c550d86c9465a9c07ce234be0186d1791ca70a23378"} Jun 11 16:42:44.761718 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:44.761681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" event={"ID":"8b60878c-06e1-4c17-a3e6-0487bf412c2d","Type":"ContainerStarted","Data":"a58f7a67f88941bec24545363d6e69c1a7b5f1aa6ceafe643349aacde1defb1e"} Jun 11 16:42:44.762207 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:44.761768 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" event={"ID":"8b60878c-06e1-4c17-a3e6-0487bf412c2d","Type":"ContainerStarted","Data":"52ea7d52334a8d10fb3f11a35f4f355629f3af5c1cf35c0997db86135bd68a25"} Jun 11 16:42:44.762207 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:44.761954 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:44.786960 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:44.786901 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" podStartSLOduration=7.758042842 podStartE2EDuration="14.78688373s" totalImagesPullingTime="7.028840888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:44.784747826 +0000 UTC m=+231.385742611" watchObservedRunningTime="2026-06-11 16:42:44.78688373 +0000 UTC m=+231.387878508" Jun 11 16:42:49.198293 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:49.198247 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:49.198756 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:49.198335 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:42:49.199702 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:49.199678 2563 patch_prober.go:28] interesting pod/console-75979c6d85-5jxp2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 11 16:42:49.199789 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:49.199725 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75979c6d85-5jxp2" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 11 16:42:50.293748 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:50.293704 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:50.294210 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:50.293935 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:42:50.295263 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:50.295240 2563 patch_prober.go:28] interesting pod/console-c845dc685-dhb8f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 11 16:42:50.295355 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:50.295326 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c845dc685-dhb8f" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 11 16:42:50.773709 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:50.773631 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55f4698498-j826g" Jun 11 16:42:59.198958 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:59.198917 2563 patch_prober.go:28] interesting pod/console-75979c6d85-5jxp2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 11 16:42:59.199513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:42:59.198979 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75979c6d85-5jxp2" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 11 16:43:00.293633 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:00.293594 2563 patch_prober.go:28] interesting pod/console-c845dc685-dhb8f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 11 16:43:00.294009 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:00.293653 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c845dc685-dhb8f" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 11 16:43:04.711590 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:04.711527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:43:04.713916 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:04.713894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30b97202-43bd-411e-b244-7f45861d6056-metrics-certs\") pod \"network-metrics-daemon-wzjhm\" (UID: \"30b97202-43bd-411e-b244-7f45861d6056\") " pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:43:04.741208 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:04.741176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xtkt\"" Jun 11 16:43:04.749474 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:04.749447 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzjhm" Jun 11 16:43:04.958818 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:04.958791 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzjhm"] Jun 11 16:43:04.960914 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:43:04.960879 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b97202_43bd_411e_b244_7f45861d6056.slice/crio-031b617a2470f0981820cde39ee1307e035dfdc3ac8275d1bb133221000bf29b WatchSource:0}: Error finding container 031b617a2470f0981820cde39ee1307e035dfdc3ac8275d1bb133221000bf29b: Status 404 returned error can't find the container with id 031b617a2470f0981820cde39ee1307e035dfdc3ac8275d1bb133221000bf29b Jun 11 16:43:05.853283 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:05.853246 2563 generic.go:356] "Generic (PLEG): container finished" podID="71aec425-a97e-43a2-a8a1-018d659f1a5c" containerID="2008d78e8cae2bb015b46a08361a94266e03f0a6bfa83df20e1a238aaa4b9ebe" exitCode=0 Jun 11 16:43:05.853825 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:05.853324 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pnzc6" event={"ID":"71aec425-a97e-43a2-a8a1-018d659f1a5c","Type":"ContainerDied","Data":"2008d78e8cae2bb015b46a08361a94266e03f0a6bfa83df20e1a238aaa4b9ebe"} Jun 11 16:43:05.854001 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:05.853980 2563 scope.go:117] "RemoveContainer" containerID="2008d78e8cae2bb015b46a08361a94266e03f0a6bfa83df20e1a238aaa4b9ebe" Jun 11 16:43:05.854856 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:05.854824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzjhm" event={"ID":"30b97202-43bd-411e-b244-7f45861d6056","Type":"ContainerStarted","Data":"031b617a2470f0981820cde39ee1307e035dfdc3ac8275d1bb133221000bf29b"} Jun 11 16:43:06.862589 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:06.862533 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pnzc6" event={"ID":"71aec425-a97e-43a2-a8a1-018d659f1a5c","Type":"ContainerStarted","Data":"f24f3eee8f0d706c1ddf6206196a83dbc7948f0b66d5a5a8e0ae167606b81abf"} Jun 11 16:43:06.864516 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:06.864483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzjhm" event={"ID":"30b97202-43bd-411e-b244-7f45861d6056","Type":"ContainerStarted","Data":"338966cd7498414c0da69cdd6f089a3b62cc14d50b9fd0f23d22ebdb286129da"} Jun 11 16:43:06.864637 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:06.864528 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzjhm" event={"ID":"30b97202-43bd-411e-b244-7f45861d6056","Type":"ContainerStarted","Data":"e40cd8c08c66874212f7f9e066980d28a1b5c5e808a5958b8f95f0b0dc85e1bc"} Jun 11 16:43:06.893348 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:06.893287 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wzjhm" podStartSLOduration=251.449188693 podStartE2EDuration="4m12.893268135s" totalImagesPullingTime="1.444079442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:06.892162147 +0000 UTC m=+253.493156903" watchObservedRunningTime="2026-06-11 16:43:06.893268135 +0000 UTC m=+253.494262890" Jun 11 16:43:09.198929 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:09.198885 2563 patch_prober.go:28] interesting pod/console-75979c6d85-5jxp2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 11 16:43:09.199346 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:09.198956 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75979c6d85-5jxp2" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 11 16:43:10.122580 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:10.122521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-czml2_bff96e85-e3e3-4afc-af8b-283db4f74654/cluster-monitoring-operator/0.log" Jun 11 16:43:10.294261 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:10.294222 2563 patch_prober.go:28] interesting pod/console-c845dc685-dhb8f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 11 16:43:10.294678 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:10.294283 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c845dc685-dhb8f" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 11 16:43:11.121569 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:11.121517 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-7vmpv_6bedfbdc-ca9b-4551-9c86-02b36aa4bacb/monitoring-plugin/0.log" Jun 11 16:43:11.322644 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:11.322612 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67wxg_7aab7579-3ee8-4779-812a-d6ce28489413/init-textfile/0.log" Jun 11 16:43:11.521637 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:11.521520 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67wxg_7aab7579-3ee8-4779-812a-d6ce28489413/node-exporter/0.log" Jun 11 16:43:11.722387 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:11.722356 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67wxg_7aab7579-3ee8-4779-812a-d6ce28489413/kube-rbac-proxy/0.log" Jun 11 16:43:13.122115 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:13.122089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4dcdc_21c9348b-fcbc-429a-9377-46db78ca526f/kube-rbac-proxy-main/0.log" Jun 11 16:43:13.321130 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:13.321100 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4dcdc_21c9348b-fcbc-429a-9377-46db78ca526f/kube-rbac-proxy-self/0.log" Jun 11 16:43:13.522257 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:13.522175 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4dcdc_21c9348b-fcbc-429a-9377-46db78ca526f/openshift-state-metrics/0.log" Jun 11 16:43:15.522153 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:15.522126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-dgcjq_c9da8a90-8f83-46c5-b97b-601fb60dbd83/prometheus-operator-admission-webhook/0.log" Jun 11 16:43:16.321804 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:16.321775 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/thanos-query/0.log" Jun 11 16:43:16.521858 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:16.521820 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy-web/0.log" Jun 11 16:43:16.722006 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:16.721921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy/0.log" Jun 11 16:43:16.922138 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:16.922112 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/prom-label-proxy/0.log" Jun 11 16:43:17.121733 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:17.121702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy-rules/0.log" Jun 11 16:43:17.322112 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:17.322082 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy-metrics/0.log" Jun 11 16:43:17.721731 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:17.721697 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:43:17.923137 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:17.923105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/2.log" Jun 11 16:43:18.322214 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:18.322187 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75979c6d85-5jxp2_94494081-2fbd-4516-a8ea-ca914ac23943/console/0.log" Jun 11 16:43:18.522173 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:18.522141 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c845dc685-dhb8f_79985ee1-15ba-45b7-b178-90618ce6f9a2/console/0.log" Jun 11 16:43:18.723470 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:18.723391 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-nv9k6_cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a/download-server/0.log" Jun 11 16:43:19.198564 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:19.198509 2563 patch_prober.go:28] interesting pod/console-75979c6d85-5jxp2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 11 16:43:19.198945 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:19.198603 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75979c6d85-5jxp2" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 11 16:43:19.916674 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:19.916639 2563 generic.go:356] "Generic (PLEG): container finished" podID="0112852f-29c3-45c1-8627-d49a7a60a5a0" containerID="5f2e7962c644590105f5e704241d7e5c7a6b38c81012b5a09b335aa04169c9cb" exitCode=0 Jun 11 16:43:19.916844 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:19.916715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" event={"ID":"0112852f-29c3-45c1-8627-d49a7a60a5a0","Type":"ContainerDied","Data":"5f2e7962c644590105f5e704241d7e5c7a6b38c81012b5a09b335aa04169c9cb"} Jun 11 16:43:19.917079 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:19.917058 2563 scope.go:117] "RemoveContainer" containerID="5f2e7962c644590105f5e704241d7e5c7a6b38c81012b5a09b335aa04169c9cb" Jun 11 16:43:20.121054 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:20.121024 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5q98_560bde2b-8d7e-4033-b1ec-4b635da8dc3a/dns-node-resolver/0.log" Jun 11 16:43:20.294073 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:20.294038 2563 patch_prober.go:28] interesting pod/console-c845dc685-dhb8f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 11 16:43:20.294451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:20.294106 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c845dc685-dhb8f" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 11 16:43:20.922757 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:20.922724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-84fq4" event={"ID":"0112852f-29c3-45c1-8627-d49a7a60a5a0","Type":"ContainerStarted","Data":"b0bf5c4eefd77aff63d8d3115d24dec6b9b1d69945ab465c3f93224e7ef27474"} Jun 11 16:43:21.522177 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:21.522141 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrnh6_264a2815-ab69-40c7-bf06-7df68cd63369/node-ca/0.log" Jun 11 16:43:21.722396 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:21.722365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74fb4b67bf-txkdz_be962de3-8e94-4e1c-9e12-ec26d6be919a/router/0.log" Jun 11 16:43:21.921375 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:21.921338 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nx2m_b4b0558d-7453-4124-8799-4e62a4780501/serve-healthcheck-canary/0.log" Jun 11 16:43:29.203085 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:29.203054 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:43:29.207031 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:29.207001 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:43:29.263861 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:29.263829 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c845dc685-dhb8f"] Jun 11 16:43:35.420001 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:43:35.419945 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gbgfv" podUID="687074fa-ed83-4c4d-97ba-12c35360082f" Jun 11 16:43:35.986993 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:35.986957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbgfv" Jun 11 16:43:39.117933 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:39.117902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:43:39.120243 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:39.120217 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/687074fa-ed83-4c4d-97ba-12c35360082f-metrics-tls\") pod \"dns-default-gbgfv\" (UID: \"687074fa-ed83-4c4d-97ba-12c35360082f\") " pod="openshift-dns/dns-default-gbgfv" Jun 11 16:43:39.290804 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:39.290766 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-klqh8\"" Jun 11 16:43:39.298410 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:39.298377 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbgfv" Jun 11 16:43:39.433138 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:39.433108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbgfv"] Jun 11 16:43:39.436757 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:43:39.436722 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687074fa_ed83_4c4d_97ba_12c35360082f.slice/crio-2438ccd9f9e0d44e4145b3c2cb4aa95baa326ce65b88bb61daba47701fb3d65b WatchSource:0}: Error finding container 2438ccd9f9e0d44e4145b3c2cb4aa95baa326ce65b88bb61daba47701fb3d65b: Status 404 returned error can't find the container with id 2438ccd9f9e0d44e4145b3c2cb4aa95baa326ce65b88bb61daba47701fb3d65b Jun 11 16:43:40.003342 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:40.003295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbgfv" event={"ID":"687074fa-ed83-4c4d-97ba-12c35360082f","Type":"ContainerStarted","Data":"2438ccd9f9e0d44e4145b3c2cb4aa95baa326ce65b88bb61daba47701fb3d65b"} Jun 11 16:43:42.014204 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:42.014160 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbgfv" event={"ID":"687074fa-ed83-4c4d-97ba-12c35360082f","Type":"ContainerStarted","Data":"3d1e5eb755fcfbe519563a2a8ce2e0c9e03efa90734f7eb92ea8d0c7b638a010"} Jun 11 16:43:42.014626 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:42.014217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbgfv" event={"ID":"687074fa-ed83-4c4d-97ba-12c35360082f","Type":"ContainerStarted","Data":"467639e1728c51461f9890e4a252d9237978e8d5d676f45de87c0b5de2858564"} Jun 11 16:43:42.014626 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:42.014271 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gbgfv" Jun 11 16:43:42.030198 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:42.030141 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gbgfv" podStartSLOduration=251.456706417 podStartE2EDuration="4m13.030113821s" totalImagesPullingTime="1.573407404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:42.028952168 +0000 UTC m=+288.629946923" watchObservedRunningTime="2026-06-11 16:43:42.030113821 +0000 UTC m=+288.631108590" Jun 11 16:43:46.549035 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.548996 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6657ccdb65-7lwbq"] Jun 11 16:43:46.549518 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.549443 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ca05fd7-987f-4dac-be35-06106b35ff67" containerName="registry" Jun 11 16:43:46.549518 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.549459 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ca05fd7-987f-4dac-be35-06106b35ff67" containerName="registry" Jun 11 16:43:46.549667 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.549566 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ca05fd7-987f-4dac-be35-06106b35ff67" containerName="registry" Jun 11 16:43:46.552232 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.552209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.564108 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.564080 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6657ccdb65-7lwbq"] Jun 11 16:43:46.684080 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.684049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxf4t\" (UniqueName: \"kubernetes.io/projected/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-kube-api-access-nxf4t\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.684245 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.684089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-oauth-serving-cert\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.684245 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.684116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-trusted-ca-bundle\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.684245 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.684188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-service-ca\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.684245 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.684222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-config\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.684245 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.684241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-serving-cert\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.684416 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.684261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-oauth-config\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.784715 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.784673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxf4t\" (UniqueName: \"kubernetes.io/projected/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-kube-api-access-nxf4t\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.784715 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.784722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-oauth-serving-cert\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.784975 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.784747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-trusted-ca-bundle\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.784975 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.784778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-service-ca\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.784975 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.784804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-config\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.784975 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.784822 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-serving-cert\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.784975 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.784847 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-oauth-config\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.785544 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.785512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-oauth-serving-cert\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.785691 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.785524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-service-ca\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.785739 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.785697 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-config\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.785825 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.785807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-trusted-ca-bundle\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.787587 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.787531 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-oauth-config\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.787678 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.787627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-serving-cert\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.792690 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.792673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxf4t\" (UniqueName: \"kubernetes.io/projected/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-kube-api-access-nxf4t\") pod \"console-6657ccdb65-7lwbq\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:46.861734 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:46.861639 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:47.003070 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:47.003041 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6657ccdb65-7lwbq"] Jun 11 16:43:47.005389 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:43:47.005351 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a5b559_10b2_4e10_aec2_c04ea1ab850c.slice/crio-7f97e88b9a66c694ec4621244b07660c89a4ce2d6440a2286b2aee34d5654243 WatchSource:0}: Error finding container 7f97e88b9a66c694ec4621244b07660c89a4ce2d6440a2286b2aee34d5654243: Status 404 returned error can't find the container with id 7f97e88b9a66c694ec4621244b07660c89a4ce2d6440a2286b2aee34d5654243 Jun 11 16:43:47.035629 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:47.035593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6657ccdb65-7lwbq" event={"ID":"e8a5b559-10b2-4e10-aec2-c04ea1ab850c","Type":"ContainerStarted","Data":"7f97e88b9a66c694ec4621244b07660c89a4ce2d6440a2286b2aee34d5654243"} Jun 11 16:43:48.040754 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:48.040716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6657ccdb65-7lwbq" event={"ID":"e8a5b559-10b2-4e10-aec2-c04ea1ab850c","Type":"ContainerStarted","Data":"db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7"} Jun 11 16:43:48.061371 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:48.061318 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6657ccdb65-7lwbq" podStartSLOduration=2.061300719 podStartE2EDuration="2.061300719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:48.058784858 +0000 UTC m=+294.659779616" watchObservedRunningTime="2026-06-11 16:43:48.061300719 +0000 UTC m=+294.662295475" Jun 11 16:43:52.019795 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:52.019763 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gbgfv" Jun 11 16:43:53.781871 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:53.781845 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:43:53.784285 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:53.784256 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:43:53.789896 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:53.789872 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:43:53.791835 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:53.791814 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:43:53.793387 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:53.793360 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:43:54.287966 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.287908 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c845dc685-dhb8f" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" containerID="cri-o://3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5" gracePeriod=15 Jun 11 16:43:54.531125 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.531102 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:43:54.656420 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656331 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-serving-cert\") pod \"79985ee1-15ba-45b7-b178-90618ce6f9a2\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " Jun 11 16:43:54.656420 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656378 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-oauth-serving-cert\") pod \"79985ee1-15ba-45b7-b178-90618ce6f9a2\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " Jun 11 16:43:54.656420 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656418 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql6hz\" (UniqueName: \"kubernetes.io/projected/79985ee1-15ba-45b7-b178-90618ce6f9a2-kube-api-access-ql6hz\") pod \"79985ee1-15ba-45b7-b178-90618ce6f9a2\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " Jun 11 16:43:54.656680 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656487 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-config\") pod \"79985ee1-15ba-45b7-b178-90618ce6f9a2\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " Jun 11 16:43:54.656680 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656540 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-trusted-ca-bundle\") pod \"79985ee1-15ba-45b7-b178-90618ce6f9a2\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " Jun 11 16:43:54.656680 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656600 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-oauth-config\") pod \"79985ee1-15ba-45b7-b178-90618ce6f9a2\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " Jun 11 16:43:54.656680 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656643 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-service-ca\") pod \"79985ee1-15ba-45b7-b178-90618ce6f9a2\" (UID: \"79985ee1-15ba-45b7-b178-90618ce6f9a2\") " Jun 11 16:43:54.657024 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.656992 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "79985ee1-15ba-45b7-b178-90618ce6f9a2" (UID: "79985ee1-15ba-45b7-b178-90618ce6f9a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:43:54.657125 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.657034 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-config" (OuterVolumeSpecName: "console-config") pod "79985ee1-15ba-45b7-b178-90618ce6f9a2" (UID: "79985ee1-15ba-45b7-b178-90618ce6f9a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:43:54.657125 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.657064 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "79985ee1-15ba-45b7-b178-90618ce6f9a2" (UID: "79985ee1-15ba-45b7-b178-90618ce6f9a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:43:54.657125 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.657072 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79985ee1-15ba-45b7-b178-90618ce6f9a2" (UID: "79985ee1-15ba-45b7-b178-90618ce6f9a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:43:54.657293 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.657275 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-service-ca\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:43:54.657330 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.657302 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-oauth-serving-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:43:54.657330 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.657317 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:43:54.657390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.657332 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79985ee1-15ba-45b7-b178-90618ce6f9a2-trusted-ca-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:43:54.658866 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.658837 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79985ee1-15ba-45b7-b178-90618ce6f9a2" (UID: "79985ee1-15ba-45b7-b178-90618ce6f9a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:43:54.658866 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.658853 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79985ee1-15ba-45b7-b178-90618ce6f9a2" (UID: "79985ee1-15ba-45b7-b178-90618ce6f9a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:43:54.658998 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.658877 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79985ee1-15ba-45b7-b178-90618ce6f9a2-kube-api-access-ql6hz" (OuterVolumeSpecName: "kube-api-access-ql6hz") pod "79985ee1-15ba-45b7-b178-90618ce6f9a2" (UID: "79985ee1-15ba-45b7-b178-90618ce6f9a2"). InnerVolumeSpecName "kube-api-access-ql6hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:43:54.757947 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.757908 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-serving-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:43:54.757947 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.757940 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql6hz\" (UniqueName: \"kubernetes.io/projected/79985ee1-15ba-45b7-b178-90618ce6f9a2-kube-api-access-ql6hz\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:43:54.757947 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:54.757951 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79985ee1-15ba-45b7-b178-90618ce6f9a2-console-oauth-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:43:55.073003 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.072966 2563 generic.go:356] "Generic (PLEG): container finished" podID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerID="3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5" exitCode=0 Jun 11 16:43:55.073481 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.073021 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c845dc685-dhb8f" Jun 11 16:43:55.073481 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.073052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c845dc685-dhb8f" event={"ID":"79985ee1-15ba-45b7-b178-90618ce6f9a2","Type":"ContainerDied","Data":"3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5"} Jun 11 16:43:55.073481 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.073103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c845dc685-dhb8f" event={"ID":"79985ee1-15ba-45b7-b178-90618ce6f9a2","Type":"ContainerDied","Data":"6fdb1fe66848a73a1f3fa2ce880ac9d209c6009f1be4e656b30876a783eb0556"} Jun 11 16:43:55.073481 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.073126 2563 scope.go:117] "RemoveContainer" containerID="3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5" Jun 11 16:43:55.081933 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.081913 2563 scope.go:117] "RemoveContainer" containerID="3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5" Jun 11 16:43:55.082216 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:43:55.082194 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5\": container with ID starting with 3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5 not found: ID does not exist" containerID="3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5" Jun 11 16:43:55.082281 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.082225 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5"} err="failed to get container status \"3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5\": rpc error: code = NotFound desc = could not find container \"3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5\": container with ID starting with 3f0cd83f7cdece3dfecbad1f97d49b2d1524b374f9749cb876541eefded078a5 not found: ID does not exist" Jun 11 16:43:55.096762 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.096729 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c845dc685-dhb8f"] Jun 11 16:43:55.100089 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.100065 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c845dc685-dhb8f"] Jun 11 16:43:55.842039 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:55.842007 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" path="/var/lib/kubelet/pods/79985ee1-15ba-45b7-b178-90618ce6f9a2/volumes" Jun 11 16:43:56.862251 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:56.862212 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:56.862682 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:56.862303 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:56.867135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:56.867110 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:57.085853 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:57.085823 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:43:57.132857 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:43:57.132765 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75979c6d85-5jxp2"] Jun 11 16:44:22.157336 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.157287 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75979c6d85-5jxp2" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" containerID="cri-o://eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5" gracePeriod=15 Jun 11 16:44:22.398818 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.398793 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:44:22.463269 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463196 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-serving-cert\") pod \"94494081-2fbd-4516-a8ea-ca914ac23943\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " Jun 11 16:44:22.463269 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463237 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-trusted-ca-bundle\") pod \"94494081-2fbd-4516-a8ea-ca914ac23943\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " Jun 11 16:44:22.463463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463273 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6t8j\" (UniqueName: \"kubernetes.io/projected/94494081-2fbd-4516-a8ea-ca914ac23943-kube-api-access-d6t8j\") pod \"94494081-2fbd-4516-a8ea-ca914ac23943\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " Jun 11 16:44:22.463463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463301 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-service-ca\") pod \"94494081-2fbd-4516-a8ea-ca914ac23943\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " Jun 11 16:44:22.463463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463327 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-console-config\") pod \"94494081-2fbd-4516-a8ea-ca914ac23943\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " Jun 11 16:44:22.463463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463353 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-oauth-config\") pod \"94494081-2fbd-4516-a8ea-ca914ac23943\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " Jun 11 16:44:22.463463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463369 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-oauth-serving-cert\") pod \"94494081-2fbd-4516-a8ea-ca914ac23943\" (UID: \"94494081-2fbd-4516-a8ea-ca914ac23943\") " Jun 11 16:44:22.463843 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463811 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-service-ca" (OuterVolumeSpecName: "service-ca") pod "94494081-2fbd-4516-a8ea-ca914ac23943" (UID: "94494081-2fbd-4516-a8ea-ca914ac23943"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:44:22.463843 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463821 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-console-config" (OuterVolumeSpecName: "console-config") pod "94494081-2fbd-4516-a8ea-ca914ac23943" (UID: "94494081-2fbd-4516-a8ea-ca914ac23943"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:44:22.463843 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463831 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "94494081-2fbd-4516-a8ea-ca914ac23943" (UID: "94494081-2fbd-4516-a8ea-ca914ac23943"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:44:22.464036 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.463827 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "94494081-2fbd-4516-a8ea-ca914ac23943" (UID: "94494081-2fbd-4516-a8ea-ca914ac23943"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:44:22.465526 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.465498 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "94494081-2fbd-4516-a8ea-ca914ac23943" (UID: "94494081-2fbd-4516-a8ea-ca914ac23943"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:44:22.465846 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.465829 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "94494081-2fbd-4516-a8ea-ca914ac23943" (UID: "94494081-2fbd-4516-a8ea-ca914ac23943"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:44:22.465915 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.465876 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94494081-2fbd-4516-a8ea-ca914ac23943-kube-api-access-d6t8j" (OuterVolumeSpecName: "kube-api-access-d6t8j") pod "94494081-2fbd-4516-a8ea-ca914ac23943" (UID: "94494081-2fbd-4516-a8ea-ca914ac23943"). InnerVolumeSpecName "kube-api-access-d6t8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:22.564612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.564575 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6t8j\" (UniqueName: \"kubernetes.io/projected/94494081-2fbd-4516-a8ea-ca914ac23943-kube-api-access-d6t8j\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:44:22.564612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.564608 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-service-ca\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:44:22.564612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.564619 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-console-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:44:22.564844 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.564629 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-oauth-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:44:22.564844 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.564638 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-oauth-serving-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:44:22.564844 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.564647 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94494081-2fbd-4516-a8ea-ca914ac23943-console-serving-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:44:22.564844 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:22.564655 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94494081-2fbd-4516-a8ea-ca914ac23943-trusted-ca-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:44:23.185366 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.185332 2563 generic.go:356] "Generic (PLEG): container finished" podID="94494081-2fbd-4516-a8ea-ca914ac23943" containerID="eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5" exitCode=0 Jun 11 16:44:23.185805 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.185378 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75979c6d85-5jxp2" Jun 11 16:44:23.185805 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.185389 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75979c6d85-5jxp2" event={"ID":"94494081-2fbd-4516-a8ea-ca914ac23943","Type":"ContainerDied","Data":"eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5"} Jun 11 16:44:23.185805 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.185429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75979c6d85-5jxp2" event={"ID":"94494081-2fbd-4516-a8ea-ca914ac23943","Type":"ContainerDied","Data":"8fd269a828fd285af3746ff02a673b52c2d2fcfd98146f06d149420bd4f5da87"} Jun 11 16:44:23.185805 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.185448 2563 scope.go:117] "RemoveContainer" containerID="eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5" Jun 11 16:44:23.194257 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.194242 2563 scope.go:117] "RemoveContainer" containerID="eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5" Jun 11 16:44:23.194519 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:44:23.194497 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5\": container with ID starting with eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5 not found: ID does not exist" containerID="eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5" Jun 11 16:44:23.194600 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.194532 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5"} err="failed to get container status \"eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5\": rpc error: code = NotFound desc = could not find container \"eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5\": container with ID starting with eb45a094d1bafd4069bb450fa1b487226058a04541d28cd9bb520feab2b76bc5 not found: ID does not exist" Jun 11 16:44:23.206233 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.206204 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75979c6d85-5jxp2"] Jun 11 16:44:23.209938 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.209916 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75979c6d85-5jxp2"] Jun 11 16:44:23.841117 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:44:23.841083 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" path="/var/lib/kubelet/pods/94494081-2fbd-4516-a8ea-ca914ac23943/volumes" Jun 11 16:48:04.675431 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.675349 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w"] Jun 11 16:48:04.675912 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.675667 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" Jun 11 16:48:04.675912 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.675677 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" Jun 11 16:48:04.675912 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.675697 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" Jun 11 16:48:04.675912 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.675703 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" Jun 11 16:48:04.675912 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.675766 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="94494081-2fbd-4516-a8ea-ca914ac23943" containerName="console" Jun 11 16:48:04.675912 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.675777 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79985ee1-15ba-45b7-b178-90618ce6f9a2" containerName="console" Jun 11 16:48:04.678739 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.678722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.681277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.681256 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:48:04.681394 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.681325 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:48:04.682319 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.682303 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9n7n\"" Jun 11 16:48:04.692956 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.692936 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w"] Jun 11 16:48:04.770990 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.770959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.771105 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.770994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftw8j\" (UniqueName: \"kubernetes.io/projected/b2607d83-c089-4847-b63b-26593c42ea24-kube-api-access-ftw8j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.771105 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.771066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.871689 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.871631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.871833 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.871695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftw8j\" (UniqueName: \"kubernetes.io/projected/b2607d83-c089-4847-b63b-26593c42ea24-kube-api-access-ftw8j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.871833 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.871748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.872114 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.872099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.872156 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.872095 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.880292 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.880261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftw8j\" (UniqueName: \"kubernetes.io/projected/b2607d83-c089-4847-b63b-26593c42ea24-kube-api-access-ftw8j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:04.988134 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:04.988048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:05.114508 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:05.114486 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w"] Jun 11 16:48:05.116738 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:48:05.116710 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2607d83_c089_4847_b63b_26593c42ea24.slice/crio-392204f6114e0a8a43bd729f713faa862989bcd33c5a8212059bc182f0da9add WatchSource:0}: Error finding container 392204f6114e0a8a43bd729f713faa862989bcd33c5a8212059bc182f0da9add: Status 404 returned error can't find the container with id 392204f6114e0a8a43bd729f713faa862989bcd33c5a8212059bc182f0da9add Jun 11 16:48:05.118752 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:05.118730 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:48:06.035649 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:06.035609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" event={"ID":"b2607d83-c089-4847-b63b-26593c42ea24","Type":"ContainerStarted","Data":"392204f6114e0a8a43bd729f713faa862989bcd33c5a8212059bc182f0da9add"} Jun 11 16:48:12.062903 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:12.062866 2563 generic.go:356] "Generic (PLEG): container finished" podID="b2607d83-c089-4847-b63b-26593c42ea24" containerID="87095b0f553f40ca039c6383af21a74235ca1dab94fa7f1910387aa27720dae2" exitCode=0 Jun 11 16:48:12.063397 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:12.062938 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" event={"ID":"b2607d83-c089-4847-b63b-26593c42ea24","Type":"ContainerDied","Data":"87095b0f553f40ca039c6383af21a74235ca1dab94fa7f1910387aa27720dae2"} Jun 11 16:48:15.076899 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:15.076865 2563 generic.go:356] "Generic (PLEG): container finished" podID="b2607d83-c089-4847-b63b-26593c42ea24" containerID="bc697699f2810caccc378f019553c1298d2834ebc52c27ce5a5a3fc2e357ebf8" exitCode=0 Jun 11 16:48:15.077268 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:15.076942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" event={"ID":"b2607d83-c089-4847-b63b-26593c42ea24","Type":"ContainerDied","Data":"bc697699f2810caccc378f019553c1298d2834ebc52c27ce5a5a3fc2e357ebf8"} Jun 11 16:48:27.129610 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:27.129573 2563 generic.go:356] "Generic (PLEG): container finished" podID="b2607d83-c089-4847-b63b-26593c42ea24" containerID="8c2745843d19b44d74bdb382cae973237261bd435a57f4eec9074203e0149b1f" exitCode=0 Jun 11 16:48:27.130000 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:27.129652 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" event={"ID":"b2607d83-c089-4847-b63b-26593c42ea24","Type":"ContainerDied","Data":"8c2745843d19b44d74bdb382cae973237261bd435a57f4eec9074203e0149b1f"} Jun 11 16:48:28.257638 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.257612 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:28.282038 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.282008 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftw8j\" (UniqueName: \"kubernetes.io/projected/b2607d83-c089-4847-b63b-26593c42ea24-kube-api-access-ftw8j\") pod \"b2607d83-c089-4847-b63b-26593c42ea24\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " Jun 11 16:48:28.282219 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.282097 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-bundle\") pod \"b2607d83-c089-4847-b63b-26593c42ea24\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " Jun 11 16:48:28.282219 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.282127 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-util\") pod \"b2607d83-c089-4847-b63b-26593c42ea24\" (UID: \"b2607d83-c089-4847-b63b-26593c42ea24\") " Jun 11 16:48:28.282811 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.282785 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-bundle" (OuterVolumeSpecName: "bundle") pod "b2607d83-c089-4847-b63b-26593c42ea24" (UID: "b2607d83-c089-4847-b63b-26593c42ea24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:48:28.284222 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.284202 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2607d83-c089-4847-b63b-26593c42ea24-kube-api-access-ftw8j" (OuterVolumeSpecName: "kube-api-access-ftw8j") pod "b2607d83-c089-4847-b63b-26593c42ea24" (UID: "b2607d83-c089-4847-b63b-26593c42ea24"). InnerVolumeSpecName "kube-api-access-ftw8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:48:28.289490 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.289462 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-util" (OuterVolumeSpecName: "util") pod "b2607d83-c089-4847-b63b-26593c42ea24" (UID: "b2607d83-c089-4847-b63b-26593c42ea24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:48:28.383237 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.383205 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:48:28.383237 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.383234 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2607d83-c089-4847-b63b-26593c42ea24-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:48:28.383237 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:28.383245 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftw8j\" (UniqueName: \"kubernetes.io/projected/b2607d83-c089-4847-b63b-26593c42ea24-kube-api-access-ftw8j\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:48:29.139537 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:29.139499 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" event={"ID":"b2607d83-c089-4847-b63b-26593c42ea24","Type":"ContainerDied","Data":"392204f6114e0a8a43bd729f713faa862989bcd33c5a8212059bc182f0da9add"} Jun 11 16:48:29.139717 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:29.139578 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="392204f6114e0a8a43bd729f713faa862989bcd33c5a8212059bc182f0da9add" Jun 11 16:48:29.139717 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:29.139517 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnh48w" Jun 11 16:48:32.694764 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.694726 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd"] Jun 11 16:48:32.695135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.695025 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2607d83-c089-4847-b63b-26593c42ea24" containerName="util" Jun 11 16:48:32.695135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.695037 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2607d83-c089-4847-b63b-26593c42ea24" containerName="util" Jun 11 16:48:32.695135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.695046 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2607d83-c089-4847-b63b-26593c42ea24" containerName="extract" Jun 11 16:48:32.695135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.695051 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2607d83-c089-4847-b63b-26593c42ea24" containerName="extract" Jun 11 16:48:32.695135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.695072 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2607d83-c089-4847-b63b-26593c42ea24" containerName="pull" Jun 11 16:48:32.695135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.695078 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2607d83-c089-4847-b63b-26593c42ea24" containerName="pull" Jun 11 16:48:32.695135 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.695126 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2607d83-c089-4847-b63b-26593c42ea24" containerName="extract" Jun 11 16:48:32.697793 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.697775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:32.701065 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.701041 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 16:48:32.701250 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.701228 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:48:32.701377 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.701291 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-75kmz\"" Jun 11 16:48:32.709395 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.709372 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd"] Jun 11 16:48:32.714133 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.714106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzhj7\" (UniqueName: \"kubernetes.io/projected/9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6-kube-api-access-wzhj7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g96hd\" (UID: \"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:32.714229 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.714176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g96hd\" (UID: \"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:32.815227 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.815188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhj7\" (UniqueName: \"kubernetes.io/projected/9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6-kube-api-access-wzhj7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g96hd\" (UID: \"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:32.815410 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.815248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g96hd\" (UID: \"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:32.815657 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.815641 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g96hd\" (UID: \"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:32.842179 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:32.842154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhj7\" (UniqueName: \"kubernetes.io/projected/9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6-kube-api-access-wzhj7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g96hd\" (UID: \"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:33.007041 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:33.006951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" Jun 11 16:48:33.145207 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:33.145184 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd"] Jun 11 16:48:33.147388 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:48:33.147362 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5bc9b5_fc99_4d0e_bcfd_5e00ff3f86f6.slice/crio-2c8ad630d228fca83721832db1add3e25403f9cbbd09462879bb4c441b2ec48e WatchSource:0}: Error finding container 2c8ad630d228fca83721832db1add3e25403f9cbbd09462879bb4c441b2ec48e: Status 404 returned error can't find the container with id 2c8ad630d228fca83721832db1add3e25403f9cbbd09462879bb4c441b2ec48e Jun 11 16:48:33.156997 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:33.156973 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" event={"ID":"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6","Type":"ContainerStarted","Data":"2c8ad630d228fca83721832db1add3e25403f9cbbd09462879bb4c441b2ec48e"} Jun 11 16:48:36.173639 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:36.173543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" event={"ID":"9e5bc9b5-fc99-4d0e-bcfd-5e00ff3f86f6","Type":"ContainerStarted","Data":"c9e70b0c667634ca17d92728ad4b676a08c78e31cd3d3c4eaf3c4d3eba86a815"} Jun 11 16:48:36.194536 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:36.193517 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g96hd" podStartSLOduration=1.430978161 podStartE2EDuration="4.193497403s" totalImagesPullingTime="2.762519242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:36.191711815 +0000 UTC m=+582.792706571" watchObservedRunningTime="2026-06-11 16:48:36.193497403 +0000 UTC m=+582.794492159" Jun 11 16:48:39.436143 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.436101 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf"] Jun 11 16:48:39.439597 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.439580 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.442337 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.442315 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:48:39.442419 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.442386 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6zhl2\"" Jun 11 16:48:39.443574 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.443537 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:48:39.446966 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.446946 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf"] Jun 11 16:48:39.462518 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.462494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3b22f1f-88e3-45b2-b82f-99f4fa106a0d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4g2vf\" (UID: \"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.462623 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.462570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8sj\" (UniqueName: \"kubernetes.io/projected/a3b22f1f-88e3-45b2-b82f-99f4fa106a0d-kube-api-access-8d8sj\") pod \"cert-manager-webhook-7dc76cbb94-4g2vf\" (UID: \"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.563315 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.563274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3b22f1f-88e3-45b2-b82f-99f4fa106a0d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4g2vf\" (UID: \"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.563527 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.563358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8sj\" (UniqueName: \"kubernetes.io/projected/a3b22f1f-88e3-45b2-b82f-99f4fa106a0d-kube-api-access-8d8sj\") pod \"cert-manager-webhook-7dc76cbb94-4g2vf\" (UID: \"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.571908 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.571877 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3b22f1f-88e3-45b2-b82f-99f4fa106a0d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-4g2vf\" (UID: \"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.571908 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.571896 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8sj\" (UniqueName: \"kubernetes.io/projected/a3b22f1f-88e3-45b2-b82f-99f4fa106a0d-kube-api-access-8d8sj\") pod \"cert-manager-webhook-7dc76cbb94-4g2vf\" (UID: \"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.756739 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.756650 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:39.880918 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:39.880837 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf"] Jun 11 16:48:39.883101 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:48:39.883074 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3b22f1f_88e3_45b2_b82f_99f4fa106a0d.slice/crio-d63e09b18437a053f4da48341ce36e00149859af899ffffcc38a21022e788fd5 WatchSource:0}: Error finding container d63e09b18437a053f4da48341ce36e00149859af899ffffcc38a21022e788fd5: Status 404 returned error can't find the container with id d63e09b18437a053f4da48341ce36e00149859af899ffffcc38a21022e788fd5 Jun 11 16:48:40.191771 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:40.191739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" event={"ID":"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d","Type":"ContainerStarted","Data":"d63e09b18437a053f4da48341ce36e00149859af899ffffcc38a21022e788fd5"} Jun 11 16:48:41.581874 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.581841 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5"] Jun 11 16:48:41.585368 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.585346 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:41.587806 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.587781 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mq5rx\"" Jun 11 16:48:41.592092 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.592044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5"] Jun 11 16:48:41.680528 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.680492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/558e1c99-ae11-402d-af49-aec847a2589e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-w5xl5\" (UID: \"558e1c99-ae11-402d-af49-aec847a2589e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:41.680691 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.680532 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fft94\" (UniqueName: \"kubernetes.io/projected/558e1c99-ae11-402d-af49-aec847a2589e-kube-api-access-fft94\") pod \"cert-manager-cainjector-5d99449ffd-w5xl5\" (UID: \"558e1c99-ae11-402d-af49-aec847a2589e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:41.781661 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.781623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/558e1c99-ae11-402d-af49-aec847a2589e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-w5xl5\" (UID: \"558e1c99-ae11-402d-af49-aec847a2589e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:41.781661 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.781670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fft94\" (UniqueName: \"kubernetes.io/projected/558e1c99-ae11-402d-af49-aec847a2589e-kube-api-access-fft94\") pod \"cert-manager-cainjector-5d99449ffd-w5xl5\" (UID: \"558e1c99-ae11-402d-af49-aec847a2589e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:41.790142 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.790115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fft94\" (UniqueName: \"kubernetes.io/projected/558e1c99-ae11-402d-af49-aec847a2589e-kube-api-access-fft94\") pod \"cert-manager-cainjector-5d99449ffd-w5xl5\" (UID: \"558e1c99-ae11-402d-af49-aec847a2589e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:41.790142 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.790130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/558e1c99-ae11-402d-af49-aec847a2589e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-w5xl5\" (UID: \"558e1c99-ae11-402d-af49-aec847a2589e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:41.897482 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:41.897391 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" Jun 11 16:48:42.432830 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:42.432801 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5"] Jun 11 16:48:42.434563 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:48:42.434518 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod558e1c99_ae11_402d_af49_aec847a2589e.slice/crio-929671ea4070d309269fb5bc4f6745719a62fc2dda69fdf12e24e806a0fab3cc WatchSource:0}: Error finding container 929671ea4070d309269fb5bc4f6745719a62fc2dda69fdf12e24e806a0fab3cc: Status 404 returned error can't find the container with id 929671ea4070d309269fb5bc4f6745719a62fc2dda69fdf12e24e806a0fab3cc Jun 11 16:48:43.207683 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:43.207644 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" event={"ID":"a3b22f1f-88e3-45b2-b82f-99f4fa106a0d","Type":"ContainerStarted","Data":"e2a04f131583d5da274b00554732aaf16cd9af83bbccb5fb8bb0665bb12517b1"} Jun 11 16:48:43.208125 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:43.207713 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:43.209208 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:43.209183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" event={"ID":"558e1c99-ae11-402d-af49-aec847a2589e","Type":"ContainerStarted","Data":"101eb605fc649f81c0e1ba7e6d4f7ab450ecf814b9eaaf76ef891fde7484adbb"} Jun 11 16:48:43.209305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:43.209215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" event={"ID":"558e1c99-ae11-402d-af49-aec847a2589e","Type":"ContainerStarted","Data":"929671ea4070d309269fb5bc4f6745719a62fc2dda69fdf12e24e806a0fab3cc"} Jun 11 16:48:43.224159 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:43.224113 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" podStartSLOduration=1.73672804 podStartE2EDuration="4.224096143s" totalImagesPullingTime="2.487368103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:43.223483621 +0000 UTC m=+589.824478377" watchObservedRunningTime="2026-06-11 16:48:43.224096143 +0000 UTC m=+589.825090899" Jun 11 16:48:43.238721 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:43.238673 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w5xl5" podStartSLOduration=2.238660224 podStartE2EDuration="2.238660224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:43.237396875 +0000 UTC m=+589.838391630" watchObservedRunningTime="2026-06-11 16:48:43.238660224 +0000 UTC m=+589.839654980" Jun 11 16:48:49.216430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:49.216400 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-4g2vf" Jun 11 16:48:52.958746 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:52.958708 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b"] Jun 11 16:48:52.963310 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:52.963290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:52.965901 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:52.965878 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:48:52.966010 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:52.965926 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:48:52.967181 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:52.967157 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9n7n\"" Jun 11 16:48:52.969540 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:52.969520 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b"] Jun 11 16:48:53.070941 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.070904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.071118 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.070963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.071118 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.071058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wnbl\" (UniqueName: \"kubernetes.io/projected/725a8dc3-14f9-4d48-a9a9-9135915efd35-kube-api-access-4wnbl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.172447 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.172405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.172644 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.172579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wnbl\" (UniqueName: \"kubernetes.io/projected/725a8dc3-14f9-4d48-a9a9-9135915efd35-kube-api-access-4wnbl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.172644 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.172635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.172811 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.172791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.172960 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.172943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.180744 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.180723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wnbl\" (UniqueName: \"kubernetes.io/projected/725a8dc3-14f9-4d48-a9a9-9135915efd35-kube-api-access-4wnbl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.273586 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.273483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:53.399969 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.399939 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b"] Jun 11 16:48:53.401953 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:48:53.401923 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725a8dc3_14f9_4d48_a9a9_9135915efd35.slice/crio-49163a829f1e989f762d44fcdde68b985c17488724051d73d9f42bef096109b9 WatchSource:0}: Error finding container 49163a829f1e989f762d44fcdde68b985c17488724051d73d9f42bef096109b9: Status 404 returned error can't find the container with id 49163a829f1e989f762d44fcdde68b985c17488724051d73d9f42bef096109b9 Jun 11 16:48:53.812881 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.812857 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:48:53.813224 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.813206 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:48:53.819467 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.819447 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:48:53.819592 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:53.819535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:48:54.257382 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:54.257345 2563 generic.go:356] "Generic (PLEG): container finished" podID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerID="95619dbb89fbff8fc465139be12c14e7b562c91514d66a2e61c1c85b2be8f767" exitCode=0 Jun 11 16:48:54.257762 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:54.257428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" event={"ID":"725a8dc3-14f9-4d48-a9a9-9135915efd35","Type":"ContainerDied","Data":"95619dbb89fbff8fc465139be12c14e7b562c91514d66a2e61c1c85b2be8f767"} Jun 11 16:48:54.257762 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:54.257479 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" event={"ID":"725a8dc3-14f9-4d48-a9a9-9135915efd35","Type":"ContainerStarted","Data":"49163a829f1e989f762d44fcdde68b985c17488724051d73d9f42bef096109b9"} Jun 11 16:48:57.273228 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:57.273192 2563 generic.go:356] "Generic (PLEG): container finished" podID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerID="5a5367ddba55688045a5e8f0b45f4af80d540a14b3766b4db0e1015546383472" exitCode=0 Jun 11 16:48:57.273660 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:57.273274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" event={"ID":"725a8dc3-14f9-4d48-a9a9-9135915efd35","Type":"ContainerDied","Data":"5a5367ddba55688045a5e8f0b45f4af80d540a14b3766b4db0e1015546383472"} Jun 11 16:48:58.279654 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:58.279622 2563 generic.go:356] "Generic (PLEG): container finished" podID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerID="800907f3cc8a7d34bae20bae365c43fcdf41c5559e4f3eb3d86cb6cc8dec8723" exitCode=0 Jun 11 16:48:58.280031 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:58.279712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" event={"ID":"725a8dc3-14f9-4d48-a9a9-9135915efd35","Type":"ContainerDied","Data":"800907f3cc8a7d34bae20bae365c43fcdf41c5559e4f3eb3d86cb6cc8dec8723"} Jun 11 16:48:59.434439 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.434413 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:48:59.529340 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.529307 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-util\") pod \"725a8dc3-14f9-4d48-a9a9-9135915efd35\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " Jun 11 16:48:59.529503 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.529351 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-bundle\") pod \"725a8dc3-14f9-4d48-a9a9-9135915efd35\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " Jun 11 16:48:59.529503 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.529401 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wnbl\" (UniqueName: \"kubernetes.io/projected/725a8dc3-14f9-4d48-a9a9-9135915efd35-kube-api-access-4wnbl\") pod \"725a8dc3-14f9-4d48-a9a9-9135915efd35\" (UID: \"725a8dc3-14f9-4d48-a9a9-9135915efd35\") " Jun 11 16:48:59.529749 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.529727 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-bundle" (OuterVolumeSpecName: "bundle") pod "725a8dc3-14f9-4d48-a9a9-9135915efd35" (UID: "725a8dc3-14f9-4d48-a9a9-9135915efd35"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:48:59.531648 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.531624 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/725a8dc3-14f9-4d48-a9a9-9135915efd35-kube-api-access-4wnbl" (OuterVolumeSpecName: "kube-api-access-4wnbl") pod "725a8dc3-14f9-4d48-a9a9-9135915efd35" (UID: "725a8dc3-14f9-4d48-a9a9-9135915efd35"). InnerVolumeSpecName "kube-api-access-4wnbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:48:59.534340 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.534287 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-util" (OuterVolumeSpecName: "util") pod "725a8dc3-14f9-4d48-a9a9-9135915efd35" (UID: "725a8dc3-14f9-4d48-a9a9-9135915efd35"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:48:59.630832 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.630798 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:48:59.630832 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.630824 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725a8dc3-14f9-4d48-a9a9-9135915efd35-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:48:59.630832 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:48:59.630834 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wnbl\" (UniqueName: \"kubernetes.io/projected/725a8dc3-14f9-4d48-a9a9-9135915efd35-kube-api-access-4wnbl\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:00.289721 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:00.289696 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" Jun 11 16:49:00.289873 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:00.289684 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffrq7b" event={"ID":"725a8dc3-14f9-4d48-a9a9-9135915efd35","Type":"ContainerDied","Data":"49163a829f1e989f762d44fcdde68b985c17488724051d73d9f42bef096109b9"} Jun 11 16:49:00.289873 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:00.289813 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49163a829f1e989f762d44fcdde68b985c17488724051d73d9f42bef096109b9" Jun 11 16:49:11.385928 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.385844 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq"] Jun 11 16:49:11.386305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.386219 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerName="pull" Jun 11 16:49:11.386305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.386233 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerName="pull" Jun 11 16:49:11.386305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.386246 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerName="extract" Jun 11 16:49:11.386305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.386252 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerName="extract" Jun 11 16:49:11.386305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.386261 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerName="util" Jun 11 16:49:11.386305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.386266 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerName="util" Jun 11 16:49:11.386498 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.386318 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="725a8dc3-14f9-4d48-a9a9-9135915efd35" containerName="extract" Jun 11 16:49:11.392228 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.392209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.396023 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.395991 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9n7n\"" Jun 11 16:49:11.396170 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.396007 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:49:11.396170 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.396007 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:49:11.397158 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.397137 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq"] Jun 11 16:49:11.530991 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.530948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxhn9\" (UniqueName: \"kubernetes.io/projected/96eb7301-b16a-4cc5-8c13-7b54f539edc1-kube-api-access-vxhn9\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.530991 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.530993 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.531210 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.531019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.632018 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.631981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxhn9\" (UniqueName: \"kubernetes.io/projected/96eb7301-b16a-4cc5-8c13-7b54f539edc1-kube-api-access-vxhn9\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.632164 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.632026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.632164 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.632052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.632367 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.632350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.632400 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.632373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.640805 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.640742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxhn9\" (UniqueName: \"kubernetes.io/projected/96eb7301-b16a-4cc5-8c13-7b54f539edc1-kube-api-access-vxhn9\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.703774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.703725 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:11.829339 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:11.829312 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq"] Jun 11 16:49:11.831840 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:49:11.831806 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96eb7301_b16a_4cc5_8c13_7b54f539edc1.slice/crio-26e6b9ddd41dbbe5bce96f6c2308e9cd8f5284f3f77d3383c34de33169533acf WatchSource:0}: Error finding container 26e6b9ddd41dbbe5bce96f6c2308e9cd8f5284f3f77d3383c34de33169533acf: Status 404 returned error can't find the container with id 26e6b9ddd41dbbe5bce96f6c2308e9cd8f5284f3f77d3383c34de33169533acf Jun 11 16:49:12.345532 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:12.345498 2563 generic.go:356] "Generic (PLEG): container finished" podID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerID="0b1efd721d45c801ac523a8077c7e88f6f5900b3f646014bcc538dc0fb771548" exitCode=0 Jun 11 16:49:12.345721 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:12.345589 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" event={"ID":"96eb7301-b16a-4cc5-8c13-7b54f539edc1","Type":"ContainerDied","Data":"0b1efd721d45c801ac523a8077c7e88f6f5900b3f646014bcc538dc0fb771548"} Jun 11 16:49:12.345721 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:12.345639 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" event={"ID":"96eb7301-b16a-4cc5-8c13-7b54f539edc1","Type":"ContainerStarted","Data":"26e6b9ddd41dbbe5bce96f6c2308e9cd8f5284f3f77d3383c34de33169533acf"} Jun 11 16:49:13.352134 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:13.352097 2563 generic.go:356] "Generic (PLEG): container finished" podID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerID="a31bc5793c9d39e926aebdb368459fdfa2de4beac3d34818c600ec990e99dba8" exitCode=0 Jun 11 16:49:13.352546 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:13.352191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" event={"ID":"96eb7301-b16a-4cc5-8c13-7b54f539edc1","Type":"ContainerDied","Data":"a31bc5793c9d39e926aebdb368459fdfa2de4beac3d34818c600ec990e99dba8"} Jun 11 16:49:14.358548 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:14.358509 2563 generic.go:356] "Generic (PLEG): container finished" podID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerID="5274e3553518a31f2d4b87036b2535373a6b3edd58b0c75965027c04c162a8f6" exitCode=0 Jun 11 16:49:14.358971 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:14.358601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" event={"ID":"96eb7301-b16a-4cc5-8c13-7b54f539edc1","Type":"ContainerDied","Data":"5274e3553518a31f2d4b87036b2535373a6b3edd58b0c75965027c04c162a8f6"} Jun 11 16:49:15.511427 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.511394 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:15.665883 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.665791 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-bundle\") pod \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " Jun 11 16:49:15.665883 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.665848 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxhn9\" (UniqueName: \"kubernetes.io/projected/96eb7301-b16a-4cc5-8c13-7b54f539edc1-kube-api-access-vxhn9\") pod \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " Jun 11 16:49:15.666124 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.665923 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-util\") pod \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\" (UID: \"96eb7301-b16a-4cc5-8c13-7b54f539edc1\") " Jun 11 16:49:15.666640 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.666609 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-bundle" (OuterVolumeSpecName: "bundle") pod "96eb7301-b16a-4cc5-8c13-7b54f539edc1" (UID: "96eb7301-b16a-4cc5-8c13-7b54f539edc1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:49:15.667952 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.667930 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96eb7301-b16a-4cc5-8c13-7b54f539edc1-kube-api-access-vxhn9" (OuterVolumeSpecName: "kube-api-access-vxhn9") pod "96eb7301-b16a-4cc5-8c13-7b54f539edc1" (UID: "96eb7301-b16a-4cc5-8c13-7b54f539edc1"). InnerVolumeSpecName "kube-api-access-vxhn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:15.671689 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.671646 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-util" (OuterVolumeSpecName: "util") pod "96eb7301-b16a-4cc5-8c13-7b54f539edc1" (UID: "96eb7301-b16a-4cc5-8c13-7b54f539edc1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:49:15.766984 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.766943 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:15.766984 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.766982 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96eb7301-b16a-4cc5-8c13-7b54f539edc1-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:15.767222 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:15.766996 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxhn9\" (UniqueName: \"kubernetes.io/projected/96eb7301-b16a-4cc5-8c13-7b54f539edc1-kube-api-access-vxhn9\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:16.369986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:16.369956 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" Jun 11 16:49:16.370151 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:16.369961 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hlcxq" event={"ID":"96eb7301-b16a-4cc5-8c13-7b54f539edc1","Type":"ContainerDied","Data":"26e6b9ddd41dbbe5bce96f6c2308e9cd8f5284f3f77d3383c34de33169533acf"} Jun 11 16:49:16.370151 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:16.370077 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26e6b9ddd41dbbe5bce96f6c2308e9cd8f5284f3f77d3383c34de33169533acf" Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.747937 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6"] Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.748692 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerName="util" Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.748713 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerName="util" Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.748732 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerName="pull" Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.748748 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerName="pull" Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.748784 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerName="extract" Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.748793 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerName="extract" Jun 11 16:49:23.750451 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.748941 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="96eb7301-b16a-4cc5-8c13-7b54f539edc1" containerName="extract" Jun 11 16:49:23.753780 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.753749 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.758599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.758574 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:49:23.758775 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.758574 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:49:23.759057 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.759039 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:49:23.759218 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.759195 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4r8jk\"" Jun 11 16:49:23.759326 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.759140 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:49:23.759390 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.759144 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:49:23.761501 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.761268 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6"] Jun 11 16:49:23.833890 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.833853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f110368b-d149-415b-93c9-95d8b608070f-metrics-cert\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.834104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.833931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f110368b-d149-415b-93c9-95d8b608070f-manager-config\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.834104 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.833987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr4c2\" (UniqueName: \"kubernetes.io/projected/f110368b-d149-415b-93c9-95d8b608070f-kube-api-access-gr4c2\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.834241 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.834097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f110368b-d149-415b-93c9-95d8b608070f-cert\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.935080 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.935041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f110368b-d149-415b-93c9-95d8b608070f-metrics-cert\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.935274 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.935093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f110368b-d149-415b-93c9-95d8b608070f-manager-config\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.935274 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.935128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr4c2\" (UniqueName: \"kubernetes.io/projected/f110368b-d149-415b-93c9-95d8b608070f-kube-api-access-gr4c2\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.935274 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.935149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f110368b-d149-415b-93c9-95d8b608070f-cert\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.935865 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.935840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f110368b-d149-415b-93c9-95d8b608070f-manager-config\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.937770 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.937752 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f110368b-d149-415b-93c9-95d8b608070f-metrics-cert\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.937770 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.937763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f110368b-d149-415b-93c9-95d8b608070f-cert\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:23.946824 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:23.946799 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr4c2\" (UniqueName: \"kubernetes.io/projected/f110368b-d149-415b-93c9-95d8b608070f-kube-api-access-gr4c2\") pod \"lws-controller-manager-7fdcd8fdb-l88w6\" (UID: \"f110368b-d149-415b-93c9-95d8b608070f\") " pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:24.064864 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:24.064828 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:24.199969 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:24.199945 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6"] Jun 11 16:49:24.202122 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:49:24.202096 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf110368b_d149_415b_93c9_95d8b608070f.slice/crio-7bf4fd5c415d6c93567050094cbf5b495b2c4563ede180cc9ddebbfaf3157deb WatchSource:0}: Error finding container 7bf4fd5c415d6c93567050094cbf5b495b2c4563ede180cc9ddebbfaf3157deb: Status 404 returned error can't find the container with id 7bf4fd5c415d6c93567050094cbf5b495b2c4563ede180cc9ddebbfaf3157deb Jun 11 16:49:24.406737 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:24.406648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" event={"ID":"f110368b-d149-415b-93c9-95d8b608070f","Type":"ContainerStarted","Data":"7bf4fd5c415d6c93567050094cbf5b495b2c4563ede180cc9ddebbfaf3157deb"} Jun 11 16:49:26.417034 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:26.416996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" event={"ID":"f110368b-d149-415b-93c9-95d8b608070f","Type":"ContainerStarted","Data":"088f4893a1ffba80c967e048866f6bb0a440da5bf12296e7d5f33df975a618b9"} Jun 11 16:49:26.417662 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:26.417096 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:26.435619 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:26.435573 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" podStartSLOduration=1.8592706940000001 podStartE2EDuration="3.435542978s" totalImagesPullingTime="1.576272284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:26.434071661 +0000 UTC m=+633.035066431" watchObservedRunningTime="2026-06-11 16:49:26.435542978 +0000 UTC m=+633.036537737" Jun 11 16:49:28.378194 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.378158 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx"] Jun 11 16:49:28.386117 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.386096 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.388751 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.388730 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:49:28.388874 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.388826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:49:28.388937 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.388912 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:49:28.389241 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.389222 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nk9xg\"" Jun 11 16:49:28.389365 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.389348 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:49:28.401067 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.401046 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx"] Jun 11 16:49:28.474224 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.474191 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8"] Jun 11 16:49:28.476530 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.476502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.476655 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.476604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.476655 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.476630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r8xf\" (UniqueName: \"kubernetes.io/projected/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-kube-api-access-7r8xf\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.478415 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.478399 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.481131 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.481110 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:49:28.481203 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.481138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9n7n\"" Jun 11 16:49:28.481203 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.481110 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:49:28.487007 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.486987 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8"] Jun 11 16:49:28.577341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.577303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.577341 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.577343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r8xf\" (UniqueName: \"kubernetes.io/projected/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-kube-api-access-7r8xf\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.577612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.577375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.577612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.577403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.577612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.577457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.577612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.577499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcl9\" (UniqueName: \"kubernetes.io/projected/643b0e53-262a-46ba-aa19-99fb8b6af81d-kube-api-access-txcl9\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.579765 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.579736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.579875 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.579783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.585747 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.585704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r8xf\" (UniqueName: \"kubernetes.io/projected/801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7-kube-api-access-7r8xf\") pod \"opendatahub-operator-controller-manager-cf9999c4-dkpcx\" (UID: \"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7\") " pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.678857 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.678768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.678857 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.678818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcl9\" (UniqueName: \"kubernetes.io/projected/643b0e53-262a-46ba-aa19-99fb8b6af81d-kube-api-access-txcl9\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.679030 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.678865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.679179 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.679160 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.679216 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.679197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.688689 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.688664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcl9\" (UniqueName: \"kubernetes.io/projected/643b0e53-262a-46ba-aa19-99fb8b6af81d-kube-api-access-txcl9\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.696782 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.696762 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:28.788256 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.788226 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:28.860976 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.860952 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx"] Jun 11 16:49:28.864125 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:49:28.864100 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801ea96b_5e02_4a6e_ab07_d7a57ae9f3b7.slice/crio-084ba0ed34cca898eb8d589cd7651b4492a12b0d1bd9e8ad19c11d9eac4185bc WatchSource:0}: Error finding container 084ba0ed34cca898eb8d589cd7651b4492a12b0d1bd9e8ad19c11d9eac4185bc: Status 404 returned error can't find the container with id 084ba0ed34cca898eb8d589cd7651b4492a12b0d1bd9e8ad19c11d9eac4185bc Jun 11 16:49:28.931736 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:28.931710 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8"] Jun 11 16:49:28.933510 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:49:28.933485 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643b0e53_262a_46ba_aa19_99fb8b6af81d.slice/crio-62f79aacd81881733b27606a8a1fb49ef8b0c8a6794aa7dc175bf9de287583f0 WatchSource:0}: Error finding container 62f79aacd81881733b27606a8a1fb49ef8b0c8a6794aa7dc175bf9de287583f0: Status 404 returned error can't find the container with id 62f79aacd81881733b27606a8a1fb49ef8b0c8a6794aa7dc175bf9de287583f0 Jun 11 16:49:29.438008 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:29.437973 2563 generic.go:356] "Generic (PLEG): container finished" podID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerID="d5b89cbccc98c2e2b867cba37347c0a53587773a97bc08033b52c4438afb0c75" exitCode=0 Jun 11 16:49:29.438475 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:29.438062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" event={"ID":"643b0e53-262a-46ba-aa19-99fb8b6af81d","Type":"ContainerDied","Data":"d5b89cbccc98c2e2b867cba37347c0a53587773a97bc08033b52c4438afb0c75"} Jun 11 16:49:29.438475 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:29.438118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" event={"ID":"643b0e53-262a-46ba-aa19-99fb8b6af81d","Type":"ContainerStarted","Data":"62f79aacd81881733b27606a8a1fb49ef8b0c8a6794aa7dc175bf9de287583f0"} Jun 11 16:49:29.439459 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:29.439429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" event={"ID":"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7","Type":"ContainerStarted","Data":"084ba0ed34cca898eb8d589cd7651b4492a12b0d1bd9e8ad19c11d9eac4185bc"} Jun 11 16:49:30.446944 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:30.446854 2563 generic.go:356] "Generic (PLEG): container finished" podID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerID="46511a1dd62f88f80c314aec9c3ed156582b7e9e00c9116bad35733370319c27" exitCode=0 Jun 11 16:49:30.447374 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:30.447004 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" event={"ID":"643b0e53-262a-46ba-aa19-99fb8b6af81d","Type":"ContainerDied","Data":"46511a1dd62f88f80c314aec9c3ed156582b7e9e00c9116bad35733370319c27"} Jun 11 16:49:32.459382 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:32.459342 2563 generic.go:356] "Generic (PLEG): container finished" podID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerID="77642563ce52ea71149bf86d66f91dfafc2a9c3be6988454e23fd1b6d37139f0" exitCode=0 Jun 11 16:49:32.459808 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:32.459432 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" event={"ID":"643b0e53-262a-46ba-aa19-99fb8b6af81d","Type":"ContainerDied","Data":"77642563ce52ea71149bf86d66f91dfafc2a9c3be6988454e23fd1b6d37139f0"} Jun 11 16:49:32.460951 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:32.460927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" event={"ID":"801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7","Type":"ContainerStarted","Data":"f975b59ca76e6305ed39f33fe42cb305f92a698c10a6f18d34da848fe80c9657"} Jun 11 16:49:32.461061 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:32.461049 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:32.497115 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:32.497062 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" podStartSLOduration=1.708268346 podStartE2EDuration="4.497045836s" totalImagesPullingTime="2.78877749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:32.496633297 +0000 UTC m=+639.097628118" watchObservedRunningTime="2026-06-11 16:49:32.497045836 +0000 UTC m=+639.098040591" Jun 11 16:49:33.605767 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.605742 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:33.631355 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.631329 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-util\") pod \"643b0e53-262a-46ba-aa19-99fb8b6af81d\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " Jun 11 16:49:33.631480 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.631388 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txcl9\" (UniqueName: \"kubernetes.io/projected/643b0e53-262a-46ba-aa19-99fb8b6af81d-kube-api-access-txcl9\") pod \"643b0e53-262a-46ba-aa19-99fb8b6af81d\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " Jun 11 16:49:33.631480 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.631416 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-bundle\") pod \"643b0e53-262a-46ba-aa19-99fb8b6af81d\" (UID: \"643b0e53-262a-46ba-aa19-99fb8b6af81d\") " Jun 11 16:49:33.632727 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.632694 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-bundle" (OuterVolumeSpecName: "bundle") pod "643b0e53-262a-46ba-aa19-99fb8b6af81d" (UID: "643b0e53-262a-46ba-aa19-99fb8b6af81d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:49:33.633621 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.633599 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643b0e53-262a-46ba-aa19-99fb8b6af81d-kube-api-access-txcl9" (OuterVolumeSpecName: "kube-api-access-txcl9") pod "643b0e53-262a-46ba-aa19-99fb8b6af81d" (UID: "643b0e53-262a-46ba-aa19-99fb8b6af81d"). InnerVolumeSpecName "kube-api-access-txcl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:33.636860 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.636824 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-util" (OuterVolumeSpecName: "util") pod "643b0e53-262a-46ba-aa19-99fb8b6af81d" (UID: "643b0e53-262a-46ba-aa19-99fb8b6af81d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:49:33.731986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.731904 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txcl9\" (UniqueName: \"kubernetes.io/projected/643b0e53-262a-46ba-aa19-99fb8b6af81d-kube-api-access-txcl9\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:33.731986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.731933 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:33.731986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:33.731942 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/643b0e53-262a-46ba-aa19-99fb8b6af81d-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:34.472190 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:34.472157 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" Jun 11 16:49:34.472190 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:34.472179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9nrtr8" event={"ID":"643b0e53-262a-46ba-aa19-99fb8b6af81d","Type":"ContainerDied","Data":"62f79aacd81881733b27606a8a1fb49ef8b0c8a6794aa7dc175bf9de287583f0"} Jun 11 16:49:34.472410 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:34.472224 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62f79aacd81881733b27606a8a1fb49ef8b0c8a6794aa7dc175bf9de287583f0" Jun 11 16:49:37.429373 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:37.429346 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fdcd8fdb-l88w6" Jun 11 16:49:43.467997 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:43.467964 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cf9999c4-dkpcx" Jun 11 16:49:47.786316 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786276 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts"] Jun 11 16:49:47.786824 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786804 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerName="extract" Jun 11 16:49:47.786824 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786823 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerName="extract" Jun 11 16:49:47.786943 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786847 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerName="pull" Jun 11 16:49:47.786943 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786855 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerName="pull" Jun 11 16:49:47.786943 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786883 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerName="util" Jun 11 16:49:47.786943 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786892 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerName="util" Jun 11 16:49:47.787139 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.786990 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="643b0e53-262a-46ba-aa19-99fb8b6af81d" containerName="extract" Jun 11 16:49:47.790388 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.790365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.793058 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.793038 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:49:47.794241 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.794223 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9n7n\"" Jun 11 16:49:47.794305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.794223 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:49:47.798402 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.798376 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts"] Jun 11 16:49:47.843278 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.843250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.843437 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.843300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.843437 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.843356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmz8g\" (UniqueName: \"kubernetes.io/projected/49f9f868-0672-4c90-a206-d6e7fb9838c8-kube-api-access-lmz8g\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.944380 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.944344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.944539 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.944405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmz8g\" (UniqueName: \"kubernetes.io/projected/49f9f868-0672-4c90-a206-d6e7fb9838c8-kube-api-access-lmz8g\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.944539 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.944461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.944870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.944849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.944908 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.944876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:47.952945 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:47.952920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmz8g\" (UniqueName: \"kubernetes.io/projected/49f9f868-0672-4c90-a206-d6e7fb9838c8-kube-api-access-lmz8g\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:48.100908 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:48.100807 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:48.234944 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:48.234920 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts"] Jun 11 16:49:48.235996 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:49:48.235973 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f9f868_0672_4c90_a206_d6e7fb9838c8.slice/crio-b76709c15e46799f16005494ae229e0e207be1cba97a865b81f4859ff71bf3b2 WatchSource:0}: Error finding container b76709c15e46799f16005494ae229e0e207be1cba97a865b81f4859ff71bf3b2: Status 404 returned error can't find the container with id b76709c15e46799f16005494ae229e0e207be1cba97a865b81f4859ff71bf3b2 Jun 11 16:49:48.548430 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:48.548395 2563 generic.go:356] "Generic (PLEG): container finished" podID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerID="a58d7e1f329023b95ac35c43eebf46f203281f4fa44b6fd45ba5b2aefaa4ceec" exitCode=0 Jun 11 16:49:48.548628 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:48.548479 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" event={"ID":"49f9f868-0672-4c90-a206-d6e7fb9838c8","Type":"ContainerDied","Data":"a58d7e1f329023b95ac35c43eebf46f203281f4fa44b6fd45ba5b2aefaa4ceec"} Jun 11 16:49:48.548628 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:48.548572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" event={"ID":"49f9f868-0672-4c90-a206-d6e7fb9838c8","Type":"ContainerStarted","Data":"b76709c15e46799f16005494ae229e0e207be1cba97a865b81f4859ff71bf3b2"} Jun 11 16:49:49.555508 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:49.555471 2563 generic.go:356] "Generic (PLEG): container finished" podID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerID="ac542959b23b71a02c19b23539773626cc573f5b19f516ed23c5658ad6f22a3d" exitCode=0 Jun 11 16:49:49.555865 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:49.555524 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" event={"ID":"49f9f868-0672-4c90-a206-d6e7fb9838c8","Type":"ContainerDied","Data":"ac542959b23b71a02c19b23539773626cc573f5b19f516ed23c5658ad6f22a3d"} Jun 11 16:49:50.562406 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:50.562372 2563 generic.go:356] "Generic (PLEG): container finished" podID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerID="c2070ef585861e53bcff11c85194d33cab39fe1fe7355766539f3ded62037d35" exitCode=0 Jun 11 16:49:50.562814 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:50.562431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" event={"ID":"49f9f868-0672-4c90-a206-d6e7fb9838c8","Type":"ContainerDied","Data":"c2070ef585861e53bcff11c85194d33cab39fe1fe7355766539f3ded62037d35"} Jun 11 16:49:51.698057 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.698032 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:49:51.776914 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.776882 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-bundle\") pod \"49f9f868-0672-4c90-a206-d6e7fb9838c8\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " Jun 11 16:49:51.777083 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.776923 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmz8g\" (UniqueName: \"kubernetes.io/projected/49f9f868-0672-4c90-a206-d6e7fb9838c8-kube-api-access-lmz8g\") pod \"49f9f868-0672-4c90-a206-d6e7fb9838c8\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " Jun 11 16:49:51.777083 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.776981 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-util\") pod \"49f9f868-0672-4c90-a206-d6e7fb9838c8\" (UID: \"49f9f868-0672-4c90-a206-d6e7fb9838c8\") " Jun 11 16:49:51.777840 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.777803 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-bundle" (OuterVolumeSpecName: "bundle") pod "49f9f868-0672-4c90-a206-d6e7fb9838c8" (UID: "49f9f868-0672-4c90-a206-d6e7fb9838c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:49:51.779112 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.779089 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f9f868-0672-4c90-a206-d6e7fb9838c8-kube-api-access-lmz8g" (OuterVolumeSpecName: "kube-api-access-lmz8g") pod "49f9f868-0672-4c90-a206-d6e7fb9838c8" (UID: "49f9f868-0672-4c90-a206-d6e7fb9838c8"). InnerVolumeSpecName "kube-api-access-lmz8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:51.782564 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.782523 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-util" (OuterVolumeSpecName: "util") pod "49f9f868-0672-4c90-a206-d6e7fb9838c8" (UID: "49f9f868-0672-4c90-a206-d6e7fb9838c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:49:51.878314 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.878283 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:51.878314 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.878308 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmz8g\" (UniqueName: \"kubernetes.io/projected/49f9f868-0672-4c90-a206-d6e7fb9838c8-kube-api-access-lmz8g\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:51.878517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:51.878324 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49f9f868-0672-4c90-a206-d6e7fb9838c8-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:49:52.573724 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:52.573694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" event={"ID":"49f9f868-0672-4c90-a206-d6e7fb9838c8","Type":"ContainerDied","Data":"b76709c15e46799f16005494ae229e0e207be1cba97a865b81f4859ff71bf3b2"} Jun 11 16:49:52.573906 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:52.573739 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b76709c15e46799f16005494ae229e0e207be1cba97a865b81f4859ff71bf3b2" Jun 11 16:49:52.573906 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:49:52.573738 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lt7ts" Jun 11 16:50:02.561656 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.561624 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4"] Jun 11 16:50:02.562093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.561936 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerName="extract" Jun 11 16:50:02.562093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.561946 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerName="extract" Jun 11 16:50:02.562093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.561955 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerName="util" Jun 11 16:50:02.562093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.561960 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerName="util" Jun 11 16:50:02.562093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.561982 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerName="pull" Jun 11 16:50:02.562093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.561987 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerName="pull" Jun 11 16:50:02.562093 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.562038 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="49f9f868-0672-4c90-a206-d6e7fb9838c8" containerName="extract" Jun 11 16:50:02.568010 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.567987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.570926 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.570903 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9n7n\"" Jun 11 16:50:02.573053 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.573035 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 16:50:02.573657 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.573638 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 16:50:02.577813 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.577790 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4"] Jun 11 16:50:02.670776 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.670731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9x2\" (UniqueName: \"kubernetes.io/projected/c6773785-a608-4f52-b250-b54e92ea5ef7-kube-api-access-7c9x2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.670776 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.670780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.670986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.670818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.771627 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.771580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9x2\" (UniqueName: \"kubernetes.io/projected/c6773785-a608-4f52-b250-b54e92ea5ef7-kube-api-access-7c9x2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.771627 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.771632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.771848 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.771686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.772168 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.772143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.772235 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.772154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.779966 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.779943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9x2\" (UniqueName: \"kubernetes.io/projected/c6773785-a608-4f52-b250-b54e92ea5ef7-kube-api-access-7c9x2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:02.878624 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:02.878497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:03.008011 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:03.007984 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4"] Jun 11 16:50:03.010329 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:50:03.010297 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6773785_a608_4f52_b250_b54e92ea5ef7.slice/crio-c960917c7ea88b2b6bd42b7f4cdfc04379bbefeddb24c7b72d9c0257947d5b52 WatchSource:0}: Error finding container c960917c7ea88b2b6bd42b7f4cdfc04379bbefeddb24c7b72d9c0257947d5b52: Status 404 returned error can't find the container with id c960917c7ea88b2b6bd42b7f4cdfc04379bbefeddb24c7b72d9c0257947d5b52 Jun 11 16:50:03.633569 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:03.633525 2563 generic.go:356] "Generic (PLEG): container finished" podID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerID="24f9614e266c5d24969e45dfac0483dd02ee2a0c4c567020d0ac036cd6cbfbcd" exitCode=0 Jun 11 16:50:03.634004 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:03.633613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" event={"ID":"c6773785-a608-4f52-b250-b54e92ea5ef7","Type":"ContainerDied","Data":"24f9614e266c5d24969e45dfac0483dd02ee2a0c4c567020d0ac036cd6cbfbcd"} Jun 11 16:50:03.634004 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:03.633665 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" event={"ID":"c6773785-a608-4f52-b250-b54e92ea5ef7","Type":"ContainerStarted","Data":"c960917c7ea88b2b6bd42b7f4cdfc04379bbefeddb24c7b72d9c0257947d5b52"} Jun 11 16:50:06.649199 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:06.649168 2563 generic.go:356] "Generic (PLEG): container finished" podID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerID="2786cb195bee2361cde883e655a84a3607ffda13bbc9d153ec3f302b805b6091" exitCode=0 Jun 11 16:50:06.649610 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:06.649259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" event={"ID":"c6773785-a608-4f52-b250-b54e92ea5ef7","Type":"ContainerDied","Data":"2786cb195bee2361cde883e655a84a3607ffda13bbc9d153ec3f302b805b6091"} Jun 11 16:50:07.656271 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:07.656237 2563 generic.go:356] "Generic (PLEG): container finished" podID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerID="6f99b60335950447107d1028d2f1b87f690dd4cc5e175e0cd6ae7488a500ea1f" exitCode=0 Jun 11 16:50:07.656700 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:07.656316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" event={"ID":"c6773785-a608-4f52-b250-b54e92ea5ef7","Type":"ContainerDied","Data":"6f99b60335950447107d1028d2f1b87f690dd4cc5e175e0cd6ae7488a500ea1f"} Jun 11 16:50:08.803017 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:08.802990 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:08.927699 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:08.927612 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c9x2\" (UniqueName: \"kubernetes.io/projected/c6773785-a608-4f52-b250-b54e92ea5ef7-kube-api-access-7c9x2\") pod \"c6773785-a608-4f52-b250-b54e92ea5ef7\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " Jun 11 16:50:08.927699 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:08.927670 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-util\") pod \"c6773785-a608-4f52-b250-b54e92ea5ef7\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " Jun 11 16:50:08.927877 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:08.927704 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-bundle\") pod \"c6773785-a608-4f52-b250-b54e92ea5ef7\" (UID: \"c6773785-a608-4f52-b250-b54e92ea5ef7\") " Jun 11 16:50:08.928968 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:08.928931 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-bundle" (OuterVolumeSpecName: "bundle") pod "c6773785-a608-4f52-b250-b54e92ea5ef7" (UID: "c6773785-a608-4f52-b250-b54e92ea5ef7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:50:08.929761 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:08.929732 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6773785-a608-4f52-b250-b54e92ea5ef7-kube-api-access-7c9x2" (OuterVolumeSpecName: "kube-api-access-7c9x2") pod "c6773785-a608-4f52-b250-b54e92ea5ef7" (UID: "c6773785-a608-4f52-b250-b54e92ea5ef7"). InnerVolumeSpecName "kube-api-access-7c9x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:50:08.932756 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:08.932734 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-util" (OuterVolumeSpecName: "util") pod "c6773785-a608-4f52-b250-b54e92ea5ef7" (UID: "c6773785-a608-4f52-b250-b54e92ea5ef7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:50:09.028983 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:09.028949 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c9x2\" (UniqueName: \"kubernetes.io/projected/c6773785-a608-4f52-b250-b54e92ea5ef7-kube-api-access-7c9x2\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:50:09.028983 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:09.028977 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:50:09.028983 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:09.028986 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6773785-a608-4f52-b250-b54e92ea5ef7-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:50:09.666907 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:09.666869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" event={"ID":"c6773785-a608-4f52-b250-b54e92ea5ef7","Type":"ContainerDied","Data":"c960917c7ea88b2b6bd42b7f4cdfc04379bbefeddb24c7b72d9c0257947d5b52"} Jun 11 16:50:09.666907 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:09.666897 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aghnc4" Jun 11 16:50:09.666907 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:09.666915 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c960917c7ea88b2b6bd42b7f4cdfc04379bbefeddb24c7b72d9c0257947d5b52" Jun 11 16:50:55.566610 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.566508 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh"] Jun 11 16:50:55.567082 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.566971 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerName="pull" Jun 11 16:50:55.567082 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.566989 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerName="pull" Jun 11 16:50:55.567082 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.566999 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerName="extract" Jun 11 16:50:55.567082 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.567008 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerName="extract" Jun 11 16:50:55.567082 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.567019 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerName="util" Jun 11 16:50:55.567082 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.567024 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerName="util" Jun 11 16:50:55.567272 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.567098 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6773785-a608-4f52-b250-b54e92ea5ef7" containerName="extract" Jun 11 16:50:55.570492 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.570475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.573399 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.573374 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:50:55.573519 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.573386 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b2cz8\"" Jun 11 16:50:55.582028 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.582009 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh"] Jun 11 16:50:55.615214 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615371 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615371 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68beccde-72b3-4cff-bab1-35ec276f932f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615371 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68beccde-72b3-4cff-bab1-35ec276f932f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.615576 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.615530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtbsb\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-kube-api-access-rtbsb\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716439 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716439 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68beccde-72b3-4cff-bab1-35ec276f932f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716725 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716725 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68beccde-72b3-4cff-bab1-35ec276f932f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716725 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716725 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716725 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716725 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbsb\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-kube-api-access-rtbsb\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.716725 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716680 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.717089 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.717089 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.716923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.717248 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.717217 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.717373 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.717331 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68beccde-72b3-4cff-bab1-35ec276f932f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.717373 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.717353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.719028 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.719006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.719136 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.719039 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68beccde-72b3-4cff-bab1-35ec276f932f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.725138 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.725115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtbsb\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-kube-api-access-rtbsb\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.725223 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.725176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.779191 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.779153 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x"] Jun 11 16:50:55.783715 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.783693 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.795515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.795485 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x"] Jun 11 16:50:55.817929 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.817844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxd7x\" (UniqueName: \"kubernetes.io/projected/d6a8199b-f843-409e-bbeb-81eecaee6276-kube-api-access-bxd7x\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.817929 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.817896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.818132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.817959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a8199b-f843-409e-bbeb-81eecaee6276-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.818132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.818033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.818132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.818086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.818132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.818107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.818132 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.818125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.818352 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.818208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.818352 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.818273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.881817 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.881781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:50:55.919392 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919588 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxd7x\" (UniqueName: \"kubernetes.io/projected/d6a8199b-f843-409e-bbeb-81eecaee6276-kube-api-access-bxd7x\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919588 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919588 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a8199b-f843-409e-bbeb-81eecaee6276-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919588 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919864 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919864 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919864 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.919864 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.920067 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.919966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.920067 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.920043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.920276 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.920251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.920612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.920590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.920873 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.920848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a8199b-f843-409e-bbeb-81eecaee6276-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.922337 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.922313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.922564 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.922535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.930154 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.930081 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a8199b-f843-409e-bbeb-81eecaee6276-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:55.930391 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:55.930364 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxd7x\" (UniqueName: \"kubernetes.io/projected/d6a8199b-f843-409e-bbeb-81eecaee6276-kube-api-access-bxd7x\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tlp2x\" (UID: \"d6a8199b-f843-409e-bbeb-81eecaee6276\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:56.032561 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:56.032523 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh"] Jun 11 16:50:56.033933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:50:56.033905 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68beccde_72b3_4cff_bab1_35ec276f932f.slice/crio-22deea9961caa62252b04485ba8c8ffb29d85d7707aadc16f1bae25516396afe WatchSource:0}: Error finding container 22deea9961caa62252b04485ba8c8ffb29d85d7707aadc16f1bae25516396afe: Status 404 returned error can't find the container with id 22deea9961caa62252b04485ba8c8ffb29d85d7707aadc16f1bae25516396afe Jun 11 16:50:56.094961 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:56.094874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:50:56.227832 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:56.227807 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x"] Jun 11 16:50:56.229480 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:50:56.229457 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a8199b_f843_409e_bbeb_81eecaee6276.slice/crio-103e301c4ede0f4fb1cc1dae4fa5d907f7943ab27ecf0417cfe268c60bc4a7c6 WatchSource:0}: Error finding container 103e301c4ede0f4fb1cc1dae4fa5d907f7943ab27ecf0417cfe268c60bc4a7c6: Status 404 returned error can't find the container with id 103e301c4ede0f4fb1cc1dae4fa5d907f7943ab27ecf0417cfe268c60bc4a7c6 Jun 11 16:50:56.896829 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:56.896794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" event={"ID":"68beccde-72b3-4cff-bab1-35ec276f932f","Type":"ContainerStarted","Data":"22deea9961caa62252b04485ba8c8ffb29d85d7707aadc16f1bae25516396afe"} Jun 11 16:50:56.897981 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:56.897960 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" event={"ID":"d6a8199b-f843-409e-bbeb-81eecaee6276","Type":"ContainerStarted","Data":"103e301c4ede0f4fb1cc1dae4fa5d907f7943ab27ecf0417cfe268c60bc4a7c6"} Jun 11 16:50:59.817941 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.817896 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:50:59.818257 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.817988 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:50:59.818257 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.818022 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:50:59.824124 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.824021 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:50:59.824124 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.824086 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:50:59.824124 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.824115 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:50:59.926860 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.926808 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" event={"ID":"d6a8199b-f843-409e-bbeb-81eecaee6276","Type":"ContainerStarted","Data":"2fa21332fdf17a90d539d1b65def8b364e8ceb94ef78b8e87d5aa8cd6ab84e4f"} Jun 11 16:50:59.929149 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.929070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" event={"ID":"68beccde-72b3-4cff-bab1-35ec276f932f","Type":"ContainerStarted","Data":"f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b"} Jun 11 16:50:59.946927 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.946865 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" podStartSLOduration=1.354474406 podStartE2EDuration="4.946844008s" totalImagesPullingTime="3.592369602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:50:59.945317681 +0000 UTC m=+726.546312438" watchObservedRunningTime="2026-06-11 16:50:59.946844008 +0000 UTC m=+726.547838765" Jun 11 16:50:59.965655 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:50:59.965580 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" podStartSLOduration=1.183936502 podStartE2EDuration="4.965543289s" totalImagesPullingTime="3.781606787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:50:59.963291151 +0000 UTC m=+726.564285907" watchObservedRunningTime="2026-06-11 16:50:59.965543289 +0000 UTC m=+726.566538047" Jun 11 16:51:00.095674 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:00.095596 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:51:00.097161 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:00.097135 2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-74759f9795tlp2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jun 11 16:51:00.097280 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:00.097191 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" podUID="d6a8199b-f843-409e-bbeb-81eecaee6276" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jun 11 16:51:00.882899 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:00.882861 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:51:00.884364 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:00.884334 2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jun 11 16:51:00.884490 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:00.884387 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jun 11 16:51:01.099134 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:01.099104 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:51:01.882854 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:01.882813 2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jun 11 16:51:01.883056 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:01.882884 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jun 11 16:51:01.938904 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:01.938868 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:51:01.939673 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:01.939658 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tlp2x" Jun 11 16:51:01.991949 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:01.991916 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh"] Jun 11 16:51:02.001178 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.001151 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn"] Jun 11 16:51:02.005806 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.005787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.008487 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.008454 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:51:02.008487 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.008486 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:51:02.008668 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.008457 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dggrw\"" Jun 11 16:51:02.013217 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.013190 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn"] Jun 11 16:51:02.074352 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.074312 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.074779 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.074579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc67p\" (UniqueName: \"kubernetes.io/projected/85f4995d-159d-4616-a799-b89ed67e3059-kube-api-access-dc67p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.074779 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.074634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.175932 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.175841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc67p\" (UniqueName: \"kubernetes.io/projected/85f4995d-159d-4616-a799-b89ed67e3059-kube-api-access-dc67p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.175932 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.175882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.175932 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.175915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.176270 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.176243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.176347 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.176322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.183969 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.183940 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc67p\" (UniqueName: \"kubernetes.io/projected/85f4995d-159d-4616-a799-b89ed67e3059-kube-api-access-dc67p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.317422 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.317389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:02.407717 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.407687 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn"] Jun 11 16:51:02.412201 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.412178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.432937 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.432869 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn"] Jun 11 16:51:02.478863 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.478827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5jll\" (UniqueName: \"kubernetes.io/projected/d3e961c0-d07a-4e99-875e-2783076df758-kube-api-access-b5jll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.479022 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.478879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.479022 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.478994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.486764 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.486740 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn"] Jun 11 16:51:02.488757 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:02.488730 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f4995d_159d_4616_a799_b89ed67e3059.slice/crio-f998009677902a1343824a6a1ef861a813f0283171fb4da2d1729bc546e1e790 WatchSource:0}: Error finding container f998009677902a1343824a6a1ef861a813f0283171fb4da2d1729bc546e1e790: Status 404 returned error can't find the container with id f998009677902a1343824a6a1ef861a813f0283171fb4da2d1729bc546e1e790 Jun 11 16:51:02.580373 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.580338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.580585 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.580484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.580585 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.580516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5jll\" (UniqueName: \"kubernetes.io/projected/d3e961c0-d07a-4e99-875e-2783076df758-kube-api-access-b5jll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.580774 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.580746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.580931 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.580844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.588598 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.588574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5jll\" (UniqueName: \"kubernetes.io/projected/d3e961c0-d07a-4e99-875e-2783076df758-kube-api-access-b5jll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.722686 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.722595 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:02.853727 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.853701 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn"] Jun 11 16:51:02.854951 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:02.854925 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e961c0_d07a_4e99_875e_2783076df758.slice/crio-740eb1489a5afc798668a8d6f9aef09256d0a35e37b9adde44f0db66d0ebafb3 WatchSource:0}: Error finding container 740eb1489a5afc798668a8d6f9aef09256d0a35e37b9adde44f0db66d0ebafb3: Status 404 returned error can't find the container with id 740eb1489a5afc798668a8d6f9aef09256d0a35e37b9adde44f0db66d0ebafb3 Jun 11 16:51:02.883262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.883236 2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jun 11 16:51:02.883536 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.883284 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jun 11 16:51:02.946312 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.946285 2563 generic.go:356] "Generic (PLEG): container finished" podID="85f4995d-159d-4616-a799-b89ed67e3059" containerID="5b51c1aafaed463d49ac97ae5ea8984e09d95c267e0dc80034a8ac5f96dd27fc" exitCode=0 Jun 11 16:51:02.946449 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.946365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" event={"ID":"85f4995d-159d-4616-a799-b89ed67e3059","Type":"ContainerDied","Data":"5b51c1aafaed463d49ac97ae5ea8984e09d95c267e0dc80034a8ac5f96dd27fc"} Jun 11 16:51:02.946449 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.946416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" event={"ID":"85f4995d-159d-4616-a799-b89ed67e3059","Type":"ContainerStarted","Data":"f998009677902a1343824a6a1ef861a813f0283171fb4da2d1729bc546e1e790"} Jun 11 16:51:02.948090 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.948063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" event={"ID":"d3e961c0-d07a-4e99-875e-2783076df758","Type":"ContainerStarted","Data":"99e8b9b216ab927428ffb30dc00781ec1354815d0abaaa79b50d73d5d05d0e51"} Jun 11 16:51:02.948225 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.948113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" event={"ID":"d3e961c0-d07a-4e99-875e-2783076df758","Type":"ContainerStarted","Data":"740eb1489a5afc798668a8d6f9aef09256d0a35e37b9adde44f0db66d0ebafb3"} Jun 11 16:51:02.948225 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:02.948181 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" containerName="istio-proxy" containerID="cri-o://f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b" gracePeriod=30 Jun 11 16:51:03.003969 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.003876 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42"] Jun 11 16:51:03.008645 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.008615 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.009059 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.009037 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42"] Jun 11 16:51:03.084949 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.084916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.085118 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.085087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxn2\" (UniqueName: \"kubernetes.io/projected/3ec17f95-3a2f-43d5-85ab-713d39931780-kube-api-access-5pxn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.085195 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.085152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.186388 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.186343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.186615 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.186396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxn2\" (UniqueName: \"kubernetes.io/projected/3ec17f95-3a2f-43d5-85ab-713d39931780-kube-api-access-5pxn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.186615 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.186427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.186835 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.186811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.186892 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.186821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.195138 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.195112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxn2\" (UniqueName: \"kubernetes.io/projected/3ec17f95-3a2f-43d5-85ab-713d39931780-kube-api-access-5pxn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.331214 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.331174 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:03.464384 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.464359 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42"] Jun 11 16:51:03.465933 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:03.465892 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec17f95_3a2f_43d5_85ab_713d39931780.slice/crio-874299e3039b0538ca043132b6db70b3c5db58f14f9032c1f0410d415dcc39bc WatchSource:0}: Error finding container 874299e3039b0538ca043132b6db70b3c5db58f14f9032c1f0410d415dcc39bc: Status 404 returned error can't find the container with id 874299e3039b0538ca043132b6db70b3c5db58f14f9032c1f0410d415dcc39bc Jun 11 16:51:03.595335 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.595256 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v"] Jun 11 16:51:03.599050 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.599032 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.606352 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.606321 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v"] Jun 11 16:51:03.689945 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.689921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pl6\" (UniqueName: \"kubernetes.io/projected/1f46478a-c272-43df-b462-74538b8c662e-kube-api-access-56pl6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.690054 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.689961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.690054 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.689980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.790917 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.790878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56pl6\" (UniqueName: \"kubernetes.io/projected/1f46478a-c272-43df-b462-74538b8c662e-kube-api-access-56pl6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.790917 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.790924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.791120 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.790944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.791320 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.791290 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.791358 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.791315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.798624 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.798601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pl6\" (UniqueName: \"kubernetes.io/projected/1f46478a-c272-43df-b462-74538b8c662e-kube-api-access-56pl6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.923738 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.923637 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:03.955638 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.955604 2563 generic.go:356] "Generic (PLEG): container finished" podID="85f4995d-159d-4616-a799-b89ed67e3059" containerID="007d0310febb5dba3f7fcdd5a3c7187d8e63510a5eb5b01978b2c39c205d21b6" exitCode=0 Jun 11 16:51:03.955825 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.955702 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" event={"ID":"85f4995d-159d-4616-a799-b89ed67e3059","Type":"ContainerDied","Data":"007d0310febb5dba3f7fcdd5a3c7187d8e63510a5eb5b01978b2c39c205d21b6"} Jun 11 16:51:03.957333 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.957293 2563 generic.go:356] "Generic (PLEG): container finished" podID="d3e961c0-d07a-4e99-875e-2783076df758" containerID="99e8b9b216ab927428ffb30dc00781ec1354815d0abaaa79b50d73d5d05d0e51" exitCode=0 Jun 11 16:51:03.957438 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.957383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" event={"ID":"d3e961c0-d07a-4e99-875e-2783076df758","Type":"ContainerDied","Data":"99e8b9b216ab927428ffb30dc00781ec1354815d0abaaa79b50d73d5d05d0e51"} Jun 11 16:51:03.959124 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.959094 2563 generic.go:356] "Generic (PLEG): container finished" podID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerID="17f9bdd25041380d0695293f6e97ec2a62d1310132680ddbfecc2f4ed7d255e3" exitCode=0 Jun 11 16:51:03.959203 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.959166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" event={"ID":"3ec17f95-3a2f-43d5-85ab-713d39931780","Type":"ContainerDied","Data":"17f9bdd25041380d0695293f6e97ec2a62d1310132680ddbfecc2f4ed7d255e3"} Jun 11 16:51:03.959243 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:03.959200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" event={"ID":"3ec17f95-3a2f-43d5-85ab-713d39931780","Type":"ContainerStarted","Data":"874299e3039b0538ca043132b6db70b3c5db58f14f9032c1f0410d415dcc39bc"} Jun 11 16:51:04.069803 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.069779 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v"] Jun 11 16:51:04.071357 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:04.071329 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f46478a_c272_43df_b462_74538b8c662e.slice/crio-08a7c0907d730c6b0453212fc05bcca99fa4b93476bee62da30b7756c3994496 WatchSource:0}: Error finding container 08a7c0907d730c6b0453212fc05bcca99fa4b93476bee62da30b7756c3994496: Status 404 returned error can't find the container with id 08a7c0907d730c6b0453212fc05bcca99fa4b93476bee62da30b7756c3994496 Jun 11 16:51:04.967184 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.967148 2563 generic.go:356] "Generic (PLEG): container finished" podID="1f46478a-c272-43df-b462-74538b8c662e" containerID="c74d9cc92926440533dbe091fdeb7282a4cd0ebc8db330cc8cf638a9b6885763" exitCode=0 Jun 11 16:51:04.967643 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.967224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" event={"ID":"1f46478a-c272-43df-b462-74538b8c662e","Type":"ContainerDied","Data":"c74d9cc92926440533dbe091fdeb7282a4cd0ebc8db330cc8cf638a9b6885763"} Jun 11 16:51:04.967643 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.967300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" event={"ID":"1f46478a-c272-43df-b462-74538b8c662e","Type":"ContainerStarted","Data":"08a7c0907d730c6b0453212fc05bcca99fa4b93476bee62da30b7756c3994496"} Jun 11 16:51:04.969653 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.969625 2563 generic.go:356] "Generic (PLEG): container finished" podID="85f4995d-159d-4616-a799-b89ed67e3059" containerID="d1fa9fc2195ea05f87184a05a624c3842c036814c6238f1b33cd787cb0b737d2" exitCode=0 Jun 11 16:51:04.969738 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.969659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" event={"ID":"85f4995d-159d-4616-a799-b89ed67e3059","Type":"ContainerDied","Data":"d1fa9fc2195ea05f87184a05a624c3842c036814c6238f1b33cd787cb0b737d2"} Jun 11 16:51:04.971886 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.971859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" event={"ID":"d3e961c0-d07a-4e99-875e-2783076df758","Type":"ContainerStarted","Data":"02328e3db00054377231af94fbb9b1696600ce82d074e8021a6b3adfd8fa0e71"} Jun 11 16:51:04.973611 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.973592 2563 generic.go:356] "Generic (PLEG): container finished" podID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerID="d198e11bb609fde82967ceadb005d1b6ad5a5e3eb86edafba9af67062c6b6977" exitCode=0 Jun 11 16:51:04.973707 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:04.973652 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" event={"ID":"3ec17f95-3a2f-43d5-85ab-713d39931780","Type":"ContainerDied","Data":"d198e11bb609fde82967ceadb005d1b6ad5a5e3eb86edafba9af67062c6b6977"} Jun 11 16:51:05.981483 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:05.981392 2563 generic.go:356] "Generic (PLEG): container finished" podID="d3e961c0-d07a-4e99-875e-2783076df758" containerID="02328e3db00054377231af94fbb9b1696600ce82d074e8021a6b3adfd8fa0e71" exitCode=0 Jun 11 16:51:05.981928 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:05.981481 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" event={"ID":"d3e961c0-d07a-4e99-875e-2783076df758","Type":"ContainerDied","Data":"02328e3db00054377231af94fbb9b1696600ce82d074e8021a6b3adfd8fa0e71"} Jun 11 16:51:05.983838 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:05.983775 2563 generic.go:356] "Generic (PLEG): container finished" podID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerID="da2c1d95508b878623089d05064d6064dce8711427ea7e9f0ab1a814365b5a2e" exitCode=0 Jun 11 16:51:05.983914 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:05.983852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" event={"ID":"3ec17f95-3a2f-43d5-85ab-713d39931780","Type":"ContainerDied","Data":"da2c1d95508b878623089d05064d6064dce8711427ea7e9f0ab1a814365b5a2e"} Jun 11 16:51:05.985753 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:05.985730 2563 generic.go:356] "Generic (PLEG): container finished" podID="1f46478a-c272-43df-b462-74538b8c662e" containerID="8e6e9fba5aa458de253b00bc24abde2397516acfe5249efd3f523c10402dedbe" exitCode=0 Jun 11 16:51:05.985826 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:05.985786 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" event={"ID":"1f46478a-c272-43df-b462-74538b8c662e","Type":"ContainerDied","Data":"8e6e9fba5aa458de253b00bc24abde2397516acfe5249efd3f523c10402dedbe"} Jun 11 16:51:06.124582 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.124515 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:06.211803 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.211771 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc67p\" (UniqueName: \"kubernetes.io/projected/85f4995d-159d-4616-a799-b89ed67e3059-kube-api-access-dc67p\") pod \"85f4995d-159d-4616-a799-b89ed67e3059\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " Jun 11 16:51:06.211952 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.211844 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-util\") pod \"85f4995d-159d-4616-a799-b89ed67e3059\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " Jun 11 16:51:06.211952 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.211945 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-bundle\") pod \"85f4995d-159d-4616-a799-b89ed67e3059\" (UID: \"85f4995d-159d-4616-a799-b89ed67e3059\") " Jun 11 16:51:06.212400 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.212375 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-bundle" (OuterVolumeSpecName: "bundle") pod "85f4995d-159d-4616-a799-b89ed67e3059" (UID: "85f4995d-159d-4616-a799-b89ed67e3059"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:06.213962 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.213941 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f4995d-159d-4616-a799-b89ed67e3059-kube-api-access-dc67p" (OuterVolumeSpecName: "kube-api-access-dc67p") pod "85f4995d-159d-4616-a799-b89ed67e3059" (UID: "85f4995d-159d-4616-a799-b89ed67e3059"). InnerVolumeSpecName "kube-api-access-dc67p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:06.217278 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.217244 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-util" (OuterVolumeSpecName: "util") pod "85f4995d-159d-4616-a799-b89ed67e3059" (UID: "85f4995d-159d-4616-a799-b89ed67e3059"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:06.313166 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.313113 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:06.313166 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.313158 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc67p\" (UniqueName: \"kubernetes.io/projected/85f4995d-159d-4616-a799-b89ed67e3059-kube-api-access-dc67p\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:06.313166 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.313169 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85f4995d-159d-4616-a799-b89ed67e3059-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:06.993035 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.992998 2563 generic.go:356] "Generic (PLEG): container finished" podID="1f46478a-c272-43df-b462-74538b8c662e" containerID="8d726229b7b650ee898d014ad293b10b872539adb353973424f340c4c3df8d6e" exitCode=0 Jun 11 16:51:06.993441 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.993084 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" event={"ID":"1f46478a-c272-43df-b462-74538b8c662e","Type":"ContainerDied","Data":"8d726229b7b650ee898d014ad293b10b872539adb353973424f340c4c3df8d6e"} Jun 11 16:51:06.994843 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.994825 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" Jun 11 16:51:06.994843 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.994828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn" event={"ID":"85f4995d-159d-4616-a799-b89ed67e3059","Type":"ContainerDied","Data":"f998009677902a1343824a6a1ef861a813f0283171fb4da2d1729bc546e1e790"} Jun 11 16:51:06.994991 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.994861 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f998009677902a1343824a6a1ef861a813f0283171fb4da2d1729bc546e1e790" Jun 11 16:51:06.996771 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.996744 2563 generic.go:356] "Generic (PLEG): container finished" podID="d3e961c0-d07a-4e99-875e-2783076df758" containerID="3b7eba3f10463bd4598cad5eda1e55f390c5d938518ea113cb776308ab101dd9" exitCode=0 Jun 11 16:51:06.996897 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:06.996775 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" event={"ID":"d3e961c0-d07a-4e99-875e-2783076df758","Type":"ContainerDied","Data":"3b7eba3f10463bd4598cad5eda1e55f390c5d938518ea113cb776308ab101dd9"} Jun 11 16:51:07.130533 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.130507 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:07.222805 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.222765 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-util\") pod \"3ec17f95-3a2f-43d5-85ab-713d39931780\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " Jun 11 16:51:07.222980 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.222838 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-bundle\") pod \"3ec17f95-3a2f-43d5-85ab-713d39931780\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " Jun 11 16:51:07.222980 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.222869 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pxn2\" (UniqueName: \"kubernetes.io/projected/3ec17f95-3a2f-43d5-85ab-713d39931780-kube-api-access-5pxn2\") pod \"3ec17f95-3a2f-43d5-85ab-713d39931780\" (UID: \"3ec17f95-3a2f-43d5-85ab-713d39931780\") " Jun 11 16:51:07.223263 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.223239 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-bundle" (OuterVolumeSpecName: "bundle") pod "3ec17f95-3a2f-43d5-85ab-713d39931780" (UID: "3ec17f95-3a2f-43d5-85ab-713d39931780"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:07.224994 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.224969 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec17f95-3a2f-43d5-85ab-713d39931780-kube-api-access-5pxn2" (OuterVolumeSpecName: "kube-api-access-5pxn2") pod "3ec17f95-3a2f-43d5-85ab-713d39931780" (UID: "3ec17f95-3a2f-43d5-85ab-713d39931780"). InnerVolumeSpecName "kube-api-access-5pxn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:07.229938 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.229911 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-util" (OuterVolumeSpecName: "util") pod "3ec17f95-3a2f-43d5-85ab-713d39931780" (UID: "3ec17f95-3a2f-43d5-85ab-713d39931780"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:07.323849 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.323811 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:07.323849 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.323845 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pxn2\" (UniqueName: \"kubernetes.io/projected/3ec17f95-3a2f-43d5-85ab-713d39931780-kube-api-access-5pxn2\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:07.323849 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:07.323856 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ec17f95-3a2f-43d5-85ab-713d39931780-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.004549 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.004516 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" Jun 11 16:51:08.004913 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.004545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42" event={"ID":"3ec17f95-3a2f-43d5-85ab-713d39931780","Type":"ContainerDied","Data":"874299e3039b0538ca043132b6db70b3c5db58f14f9032c1f0410d415dcc39bc"} Jun 11 16:51:08.004913 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.004612 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="874299e3039b0538ca043132b6db70b3c5db58f14f9032c1f0410d415dcc39bc" Jun 11 16:51:08.177929 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.177906 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:08.188668 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.188640 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:08.219728 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.219697 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:51:08.232793 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.232765 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56pl6\" (UniqueName: \"kubernetes.io/projected/1f46478a-c272-43df-b462-74538b8c662e-kube-api-access-56pl6\") pod \"1f46478a-c272-43df-b462-74538b8c662e\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " Jun 11 16:51:08.232938 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.232861 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-util\") pod \"1f46478a-c272-43df-b462-74538b8c662e\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " Jun 11 16:51:08.232938 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.232918 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-bundle\") pod \"1f46478a-c272-43df-b462-74538b8c662e\" (UID: \"1f46478a-c272-43df-b462-74538b8c662e\") " Jun 11 16:51:08.233586 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.233536 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-bundle" (OuterVolumeSpecName: "bundle") pod "1f46478a-c272-43df-b462-74538b8c662e" (UID: "1f46478a-c272-43df-b462-74538b8c662e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.234917 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.234896 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f46478a-c272-43df-b462-74538b8c662e-kube-api-access-56pl6" (OuterVolumeSpecName: "kube-api-access-56pl6") pod "1f46478a-c272-43df-b462-74538b8c662e" (UID: "1f46478a-c272-43df-b462-74538b8c662e"). InnerVolumeSpecName "kube-api-access-56pl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:08.242044 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.242014 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-util" (OuterVolumeSpecName: "util") pod "1f46478a-c272-43df-b462-74538b8c662e" (UID: "1f46478a-c272-43df-b462-74538b8c662e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.333819 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333784 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-envoy\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.333819 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333827 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-istio-token\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333849 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-util\") pod \"d3e961c0-d07a-4e99-875e-2783076df758\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333871 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-socket\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333895 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-certs\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333931 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68beccde-72b3-4cff-bab1-35ec276f932f-istio-podinfo\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333949 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68beccde-72b3-4cff-bab1-35ec276f932f-istiod-ca-cert\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.333973 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-credential-socket\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334004 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtbsb\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-kube-api-access-rtbsb\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334048 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-data\") pod \"68beccde-72b3-4cff-bab1-35ec276f932f\" (UID: \"68beccde-72b3-4cff-bab1-35ec276f932f\") " Jun 11 16:51:08.334078 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334078 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-bundle\") pod \"d3e961c0-d07a-4e99-875e-2783076df758\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334119 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5jll\" (UniqueName: \"kubernetes.io/projected/d3e961c0-d07a-4e99-875e-2783076df758-kube-api-access-b5jll\") pod \"d3e961c0-d07a-4e99-875e-2783076df758\" (UID: \"d3e961c0-d07a-4e99-875e-2783076df758\") " Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334155 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334314 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334406 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-data" (OuterVolumeSpecName: "istio-data") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334421 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334455 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334475 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-socket\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334491 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f46478a-c272-43df-b462-74538b8c662e-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334505 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-credential-socket\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.334599 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334520 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56pl6\" (UniqueName: \"kubernetes.io/projected/1f46478a-c272-43df-b462-74538b8c662e-kube-api-access-56pl6\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.335069 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.334949 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68beccde-72b3-4cff-bab1-35ec276f932f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:51:08.335279 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.335254 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-bundle" (OuterVolumeSpecName: "bundle") pod "d3e961c0-d07a-4e99-875e-2783076df758" (UID: "d3e961c0-d07a-4e99-875e-2783076df758"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.336463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.336426 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e961c0-d07a-4e99-875e-2783076df758-kube-api-access-b5jll" (OuterVolumeSpecName: "kube-api-access-b5jll") pod "d3e961c0-d07a-4e99-875e-2783076df758" (UID: "d3e961c0-d07a-4e99-875e-2783076df758"). InnerVolumeSpecName "kube-api-access-b5jll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:08.336731 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.336704 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.336875 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.336856 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-istio-token" (OuterVolumeSpecName: "istio-token") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:08.336946 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.336872 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-kube-api-access-rtbsb" (OuterVolumeSpecName: "kube-api-access-rtbsb") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "kube-api-access-rtbsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:08.337863 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.337836 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68beccde-72b3-4cff-bab1-35ec276f932f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68beccde-72b3-4cff-bab1-35ec276f932f" (UID: "68beccde-72b3-4cff-bab1-35ec276f932f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:51:08.340439 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.340415 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-util" (OuterVolumeSpecName: "util") pod "d3e961c0-d07a-4e99-875e-2783076df758" (UID: "d3e961c0-d07a-4e99-875e-2783076df758"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435698 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-envoy\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435730 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-istio-token\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435739 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-util\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435747 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-workload-certs\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435754 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68beccde-72b3-4cff-bab1-35ec276f932f-istio-podinfo\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435762 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68beccde-72b3-4cff-bab1-35ec276f932f-istiod-ca-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435771 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtbsb\" (UniqueName: \"kubernetes.io/projected/68beccde-72b3-4cff-bab1-35ec276f932f-kube-api-access-rtbsb\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435779 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68beccde-72b3-4cff-bab1-35ec276f932f-istio-data\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435790 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3e961c0-d07a-4e99-875e-2783076df758-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:08.435786 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:08.435797 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5jll\" (UniqueName: \"kubernetes.io/projected/d3e961c0-d07a-4e99-875e-2783076df758-kube-api-access-b5jll\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:09.011115 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.011079 2563 generic.go:356] "Generic (PLEG): container finished" podID="68beccde-72b3-4cff-bab1-35ec276f932f" containerID="f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b" exitCode=0 Jun 11 16:51:09.011606 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.011123 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" Jun 11 16:51:09.011606 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.011169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" event={"ID":"68beccde-72b3-4cff-bab1-35ec276f932f","Type":"ContainerDied","Data":"f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b"} Jun 11 16:51:09.011606 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.011231 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh" event={"ID":"68beccde-72b3-4cff-bab1-35ec276f932f","Type":"ContainerDied","Data":"22deea9961caa62252b04485ba8c8ffb29d85d7707aadc16f1bae25516396afe"} Jun 11 16:51:09.011606 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.011269 2563 scope.go:117] "RemoveContainer" containerID="f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b" Jun 11 16:51:09.013264 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.013241 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" Jun 11 16:51:09.013361 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.013274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v" event={"ID":"1f46478a-c272-43df-b462-74538b8c662e","Type":"ContainerDied","Data":"08a7c0907d730c6b0453212fc05bcca99fa4b93476bee62da30b7756c3994496"} Jun 11 16:51:09.013361 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.013308 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08a7c0907d730c6b0453212fc05bcca99fa4b93476bee62da30b7756c3994496" Jun 11 16:51:09.015654 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.015631 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" event={"ID":"d3e961c0-d07a-4e99-875e-2783076df758","Type":"ContainerDied","Data":"740eb1489a5afc798668a8d6f9aef09256d0a35e37b9adde44f0db66d0ebafb3"} Jun 11 16:51:09.015769 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.015665 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="740eb1489a5afc798668a8d6f9aef09256d0a35e37b9adde44f0db66d0ebafb3" Jun 11 16:51:09.015769 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.015679 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn" Jun 11 16:51:09.023619 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.023601 2563 scope.go:117] "RemoveContainer" containerID="f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b" Jun 11 16:51:09.023922 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:51:09.023900 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b\": container with ID starting with f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b not found: ID does not exist" containerID="f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b" Jun 11 16:51:09.023980 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.023934 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b"} err="failed to get container status \"f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b\": rpc error: code = NotFound desc = could not find container \"f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b\": container with ID starting with f82ecaf7162c41e67846a2d8cfd4d1d40e43d70a63ecc761785d6a91d92d7d7b not found: ID does not exist" Jun 11 16:51:09.036439 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.036415 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh"] Jun 11 16:51:09.040069 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.040047 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvjmmh"] Jun 11 16:51:09.842770 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:09.842737 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" path="/var/lib/kubelet/pods/68beccde-72b3-4cff-bab1-35ec276f932f/volumes" Jun 11 16:51:18.500363 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500326 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh"] Jun 11 16:51:18.500863 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500845 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerName="util" Jun 11 16:51:18.500925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500864 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerName="util" Jun 11 16:51:18.500925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500875 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e961c0-d07a-4e99-875e-2783076df758" containerName="pull" Jun 11 16:51:18.500925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500884 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e961c0-d07a-4e99-875e-2783076df758" containerName="pull" Jun 11 16:51:18.500925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500893 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e961c0-d07a-4e99-875e-2783076df758" containerName="extract" Jun 11 16:51:18.500925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500901 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e961c0-d07a-4e99-875e-2783076df758" containerName="extract" Jun 11 16:51:18.500925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500916 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f4995d-159d-4616-a799-b89ed67e3059" containerName="util" Jun 11 16:51:18.500925 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500924 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f4995d-159d-4616-a799-b89ed67e3059" containerName="util" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500933 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500942 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500958 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f46478a-c272-43df-b462-74538b8c662e" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500966 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f46478a-c272-43df-b462-74538b8c662e" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500982 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f46478a-c272-43df-b462-74538b8c662e" containerName="util" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500990 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f46478a-c272-43df-b462-74538b8c662e" containerName="util" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.500998 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f4995d-159d-4616-a799-b89ed67e3059" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501005 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f4995d-159d-4616-a799-b89ed67e3059" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501020 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" containerName="istio-proxy" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501028 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" containerName="istio-proxy" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501041 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f4995d-159d-4616-a799-b89ed67e3059" containerName="pull" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501049 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f4995d-159d-4616-a799-b89ed67e3059" containerName="pull" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501063 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e961c0-d07a-4e99-875e-2783076df758" containerName="util" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501071 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e961c0-d07a-4e99-875e-2783076df758" containerName="util" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501081 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerName="pull" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501089 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerName="pull" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501098 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f46478a-c272-43df-b462-74538b8c662e" containerName="pull" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501107 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f46478a-c272-43df-b462-74538b8c662e" containerName="pull" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501219 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="85f4995d-159d-4616-a799-b89ed67e3059" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501232 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec17f95-3a2f-43d5-85ab-713d39931780" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501245 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="68beccde-72b3-4cff-bab1-35ec276f932f" containerName="istio-proxy" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501255 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e961c0-d07a-4e99-875e-2783076df758" containerName="extract" Jun 11 16:51:18.501262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.501264 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f46478a-c272-43df-b462-74538b8c662e" containerName="extract" Jun 11 16:51:18.519636 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.519599 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:18.520263 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.520240 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh"] Jun 11 16:51:18.522244 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.522218 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:51:18.522370 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.522285 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4hr4v\"" Jun 11 16:51:18.523356 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.523334 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:51:18.623413 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.623375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cwvc\" (UniqueName: \"kubernetes.io/projected/7cb736d3-9917-4822-86d1-f0280b8cd518-kube-api-access-2cwvc\") pod \"limitador-operator-controller-manager-859d7b78bd-7gvgh\" (UID: \"7cb736d3-9917-4822-86d1-f0280b8cd518\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:18.723881 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.723839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cwvc\" (UniqueName: \"kubernetes.io/projected/7cb736d3-9917-4822-86d1-f0280b8cd518-kube-api-access-2cwvc\") pod \"limitador-operator-controller-manager-859d7b78bd-7gvgh\" (UID: \"7cb736d3-9917-4822-86d1-f0280b8cd518\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:18.734270 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.734235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cwvc\" (UniqueName: \"kubernetes.io/projected/7cb736d3-9917-4822-86d1-f0280b8cd518-kube-api-access-2cwvc\") pod \"limitador-operator-controller-manager-859d7b78bd-7gvgh\" (UID: \"7cb736d3-9917-4822-86d1-f0280b8cd518\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:18.830409 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.830372 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:18.967105 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:18.967081 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh"] Jun 11 16:51:18.968717 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:18.968691 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb736d3_9917_4822_86d1_f0280b8cd518.slice/crio-c1dd0efb120a48a38c5eb576c94f963a613c51f8efb280f286b2aeff119cc5f6 WatchSource:0}: Error finding container c1dd0efb120a48a38c5eb576c94f963a613c51f8efb280f286b2aeff119cc5f6: Status 404 returned error can't find the container with id c1dd0efb120a48a38c5eb576c94f963a613c51f8efb280f286b2aeff119cc5f6 Jun 11 16:51:19.076084 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:19.076049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" event={"ID":"7cb736d3-9917-4822-86d1-f0280b8cd518","Type":"ContainerStarted","Data":"c1dd0efb120a48a38c5eb576c94f963a613c51f8efb280f286b2aeff119cc5f6"} Jun 11 16:51:22.095922 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:22.095882 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" event={"ID":"7cb736d3-9917-4822-86d1-f0280b8cd518","Type":"ContainerStarted","Data":"4534b95eadc4d12a173fa58f2422b036d74fb4cf71b0e0f3182210a4b4380cd1"} Jun 11 16:51:22.096324 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:22.095963 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:22.113463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:22.113406 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" podStartSLOduration=1.933171539 podStartE2EDuration="4.113389519s" totalImagesPullingTime="2.18021798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:51:22.111101929 +0000 UTC m=+748.712096688" watchObservedRunningTime="2026-06-11 16:51:22.113389519 +0000 UTC m=+748.714384280" Jun 11 16:51:28.794185 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:28.794151 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz"] Jun 11 16:51:28.798064 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:28.798044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" Jun 11 16:51:28.800546 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:28.800527 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-x8rdb\"" Jun 11 16:51:28.806318 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:28.806292 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz"] Jun 11 16:51:28.913538 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:28.913496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjbd\" (UniqueName: \"kubernetes.io/projected/a09f2301-b847-4466-8afc-18da7b96fe21-kube-api-access-9mjbd\") pod \"authorino-operator-75cc8d5cb7-hgbjz\" (UID: \"a09f2301-b847-4466-8afc-18da7b96fe21\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" Jun 11 16:51:29.014967 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:29.014932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjbd\" (UniqueName: \"kubernetes.io/projected/a09f2301-b847-4466-8afc-18da7b96fe21-kube-api-access-9mjbd\") pod \"authorino-operator-75cc8d5cb7-hgbjz\" (UID: \"a09f2301-b847-4466-8afc-18da7b96fe21\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" Jun 11 16:51:29.023494 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:29.023461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjbd\" (UniqueName: \"kubernetes.io/projected/a09f2301-b847-4466-8afc-18da7b96fe21-kube-api-access-9mjbd\") pod \"authorino-operator-75cc8d5cb7-hgbjz\" (UID: \"a09f2301-b847-4466-8afc-18da7b96fe21\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" Jun 11 16:51:29.108798 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:29.108700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" Jun 11 16:51:29.243387 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:29.243362 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz"] Jun 11 16:51:29.245347 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:29.245320 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09f2301_b847_4466_8afc_18da7b96fe21.slice/crio-130d1b1f3bf80445e5348e0e1ae6d44436ec7962c0079aa62421eab24748f2fd WatchSource:0}: Error finding container 130d1b1f3bf80445e5348e0e1ae6d44436ec7962c0079aa62421eab24748f2fd: Status 404 returned error can't find the container with id 130d1b1f3bf80445e5348e0e1ae6d44436ec7962c0079aa62421eab24748f2fd Jun 11 16:51:30.144358 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:30.144311 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" event={"ID":"a09f2301-b847-4466-8afc-18da7b96fe21","Type":"ContainerStarted","Data":"130d1b1f3bf80445e5348e0e1ae6d44436ec7962c0079aa62421eab24748f2fd"} Jun 11 16:51:32.155657 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:32.155616 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" event={"ID":"a09f2301-b847-4466-8afc-18da7b96fe21","Type":"ContainerStarted","Data":"d1592dbe144434dec1ef6ac49fcf964b9a2a88dc084dccabf3c74404f5417212"} Jun 11 16:51:32.156128 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:32.155749 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" Jun 11 16:51:32.173218 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:32.173165 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" podStartSLOduration=1.9814600900000001 podStartE2EDuration="4.173149533s" totalImagesPullingTime="2.191689443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:51:32.171754635 +0000 UTC m=+758.772749413" watchObservedRunningTime="2026-06-11 16:51:32.173149533 +0000 UTC m=+758.774144288" Jun 11 16:51:33.104526 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:33.104498 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:34.491282 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.491245 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl"] Jun 11 16:51:34.494853 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.494836 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.497442 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.497409 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 16:51:34.497583 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.497513 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 16:51:34.497583 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.497546 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dggrw\"" Jun 11 16:51:34.504309 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.504286 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl"] Jun 11 16:51:34.562036 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.561998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f4f56a-c6a2-4788-9278-c36329634e38-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.562246 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.562086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhv24\" (UniqueName: \"kubernetes.io/projected/28f4f56a-c6a2-4788-9278-c36329634e38-kube-api-access-lhv24\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.562246 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.562134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28f4f56a-c6a2-4788-9278-c36329634e38-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.662848 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.662817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhv24\" (UniqueName: \"kubernetes.io/projected/28f4f56a-c6a2-4788-9278-c36329634e38-kube-api-access-lhv24\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.663024 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.662865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28f4f56a-c6a2-4788-9278-c36329634e38-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.663024 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.662906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f4f56a-c6a2-4788-9278-c36329634e38-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.663590 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.663569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28f4f56a-c6a2-4788-9278-c36329634e38-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.665238 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.665220 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28f4f56a-c6a2-4788-9278-c36329634e38-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.670502 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.670480 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhv24\" (UniqueName: \"kubernetes.io/projected/28f4f56a-c6a2-4788-9278-c36329634e38-kube-api-access-lhv24\") pod \"kuadrant-console-plugin-66b5774985-bsvpl\" (UID: \"28f4f56a-c6a2-4788-9278-c36329634e38\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.806358 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.806322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" Jun 11 16:51:34.939945 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:34.939912 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl"] Jun 11 16:51:34.941347 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:34.941319 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28f4f56a_c6a2_4788_9278_c36329634e38.slice/crio-d41ec7addfd45acf75b7dde2534d3d463a150909e6a4f927cbd1e733ce8aa506 WatchSource:0}: Error finding container d41ec7addfd45acf75b7dde2534d3d463a150909e6a4f927cbd1e733ce8aa506: Status 404 returned error can't find the container with id d41ec7addfd45acf75b7dde2534d3d463a150909e6a4f927cbd1e733ce8aa506 Jun 11 16:51:35.172665 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:35.172578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" event={"ID":"28f4f56a-c6a2-4788-9278-c36329634e38","Type":"ContainerStarted","Data":"d41ec7addfd45acf75b7dde2534d3d463a150909e6a4f927cbd1e733ce8aa506"} Jun 11 16:51:43.164205 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:43.164174 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hgbjz" Jun 11 16:51:45.072895 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.072860 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh"] Jun 11 16:51:45.073362 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.073061 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" podUID="7cb736d3-9917-4822-86d1-f0280b8cd518" containerName="manager" containerID="cri-o://4534b95eadc4d12a173fa58f2422b036d74fb4cf71b0e0f3182210a4b4380cd1" gracePeriod=2 Jun 11 16:51:45.089373 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.089350 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh"] Jun 11 16:51:45.090357 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:51:45.090310 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7cb736d3-9917-4822-86d1-f0280b8cd518\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-7gvgh\": pods \"limitador-operator-controller-manager-859d7b78bd-7gvgh\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:45.114857 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.114820 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45"] Jun 11 16:51:45.115779 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.115755 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb736d3-9917-4822-86d1-f0280b8cd518" containerName="manager" Jun 11 16:51:45.115928 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.115917 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb736d3-9917-4822-86d1-f0280b8cd518" containerName="manager" Jun 11 16:51:45.116106 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.116095 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb736d3-9917-4822-86d1-f0280b8cd518" containerName="manager" Jun 11 16:51:45.123547 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.123501 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" Jun 11 16:51:45.135954 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:51:45.126633 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gvgh\" is forbidden: User \"system:node:ip-10-0-139-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-153.ec2.internal' and this object" podUID="7cb736d3-9917-4822-86d1-f0280b8cd518" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:45.135954 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.128261 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45"] Jun 11 16:51:45.159397 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.159354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wspzk\" (UniqueName: \"kubernetes.io/projected/8a540b2d-69ef-45c9-b021-9ce4fe4624a8-kube-api-access-wspzk\") pod \"limitador-operator-controller-manager-859d7b78bd-zml45\" (UID: \"8a540b2d-69ef-45c9-b021-9ce4fe4624a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" Jun 11 16:51:45.236984 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.236934 2563 generic.go:356] "Generic (PLEG): container finished" podID="7cb736d3-9917-4822-86d1-f0280b8cd518" containerID="4534b95eadc4d12a173fa58f2422b036d74fb4cf71b0e0f3182210a4b4380cd1" exitCode=0 Jun 11 16:51:45.260262 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.260149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wspzk\" (UniqueName: \"kubernetes.io/projected/8a540b2d-69ef-45c9-b021-9ce4fe4624a8-kube-api-access-wspzk\") pod \"limitador-operator-controller-manager-859d7b78bd-zml45\" (UID: \"8a540b2d-69ef-45c9-b021-9ce4fe4624a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" Jun 11 16:51:45.269261 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.269186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wspzk\" (UniqueName: \"kubernetes.io/projected/8a540b2d-69ef-45c9-b021-9ce4fe4624a8-kube-api-access-wspzk\") pod \"limitador-operator-controller-manager-859d7b78bd-zml45\" (UID: \"8a540b2d-69ef-45c9-b021-9ce4fe4624a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" Jun 11 16:51:45.328647 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.328577 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:45.331108 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:51:45.331078 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gvgh\" is forbidden: User \"system:node:ip-10-0-139-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-153.ec2.internal' and this object" podUID="7cb736d3-9917-4822-86d1-f0280b8cd518" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:45.360855 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.360821 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cwvc\" (UniqueName: \"kubernetes.io/projected/7cb736d3-9917-4822-86d1-f0280b8cd518-kube-api-access-2cwvc\") pod \"7cb736d3-9917-4822-86d1-f0280b8cd518\" (UID: \"7cb736d3-9917-4822-86d1-f0280b8cd518\") " Jun 11 16:51:45.363245 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.363204 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cb736d3-9917-4822-86d1-f0280b8cd518-kube-api-access-2cwvc" (OuterVolumeSpecName: "kube-api-access-2cwvc") pod "7cb736d3-9917-4822-86d1-f0280b8cd518" (UID: "7cb736d3-9917-4822-86d1-f0280b8cd518"). InnerVolumeSpecName "kube-api-access-2cwvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:45.457603 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.457565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" Jun 11 16:51:45.461899 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.461852 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cwvc\" (UniqueName: \"kubernetes.io/projected/7cb736d3-9917-4822-86d1-f0280b8cd518-kube-api-access-2cwvc\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:51:45.603280 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.603249 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45"] Jun 11 16:51:45.605702 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:51:45.605673 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a540b2d_69ef_45c9_b021_9ce4fe4624a8.slice/crio-f51e6870f3bf2a006f85ef7744da78eebfa978060ebe5f035bff66000766a87b WatchSource:0}: Error finding container f51e6870f3bf2a006f85ef7744da78eebfa978060ebe5f035bff66000766a87b: Status 404 returned error can't find the container with id f51e6870f3bf2a006f85ef7744da78eebfa978060ebe5f035bff66000766a87b Jun 11 16:51:45.843208 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:45.843172 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cb736d3-9917-4822-86d1-f0280b8cd518" path="/var/lib/kubelet/pods/7cb736d3-9917-4822-86d1-f0280b8cd518/volumes" Jun 11 16:51:46.245112 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:46.245080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" event={"ID":"8a540b2d-69ef-45c9-b021-9ce4fe4624a8","Type":"ContainerStarted","Data":"ea8b38f6d5977219706b94043a7258cc30a13b8835ccd9cd17fb1efa05db0382"} Jun 11 16:51:46.245598 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:46.245130 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" event={"ID":"8a540b2d-69ef-45c9-b021-9ce4fe4624a8","Type":"ContainerStarted","Data":"f51e6870f3bf2a006f85ef7744da78eebfa978060ebe5f035bff66000766a87b"} Jun 11 16:51:46.245598 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:46.245169 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" Jun 11 16:51:46.246678 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:46.246655 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gvgh" Jun 11 16:51:46.246787 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:46.246654 2563 scope.go:117] "RemoveContainer" containerID="4534b95eadc4d12a173fa58f2422b036d74fb4cf71b0e0f3182210a4b4380cd1" Jun 11 16:51:46.269702 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:46.269653 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" podStartSLOduration=1.269637535 podStartE2EDuration="1.269637535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:51:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:51:46.267847386 +0000 UTC m=+772.868842144" watchObservedRunningTime="2026-06-11 16:51:46.269637535 +0000 UTC m=+772.870632363" Jun 11 16:51:57.256309 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:51:57.256276 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zml45" Jun 11 16:52:01.342344 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:01.342299 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" event={"ID":"28f4f56a-c6a2-4788-9278-c36329634e38","Type":"ContainerStarted","Data":"ee70075b5e6e72bd1fda974dc4185486083e4548bc88a69c06fd3d199547001f"} Jun 11 16:52:01.357726 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:01.357673 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bsvpl" podStartSLOduration=1.833766703 podStartE2EDuration="27.357657699s" totalImagesPullingTime="25.523890996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:01.356641676 +0000 UTC m=+787.957636442" watchObservedRunningTime="2026-06-11 16:52:01.357657699 +0000 UTC m=+787.958652455" Jun 11 16:52:24.836539 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.836500 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-l4pq9"] Jun 11 16:52:24.869876 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.869835 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l4pq9"] Jun 11 16:52:24.870035 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.869965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l4pq9" Jun 11 16:52:24.872650 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.872627 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rqhts\"" Jun 11 16:52:24.913006 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.912969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njppw\" (UniqueName: \"kubernetes.io/projected/901a811e-a6a7-4e78-92ae-3c71633b894f-kube-api-access-njppw\") pod \"authorino-58cd955675-l4pq9\" (UID: \"901a811e-a6a7-4e78-92ae-3c71633b894f\") " pod="kuadrant-system/authorino-58cd955675-l4pq9" Jun 11 16:52:24.978417 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.978381 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ndsp4"] Jun 11 16:52:24.981914 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.981899 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ndsp4" Jun 11 16:52:24.988061 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:24.988032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ndsp4"] Jun 11 16:52:25.013620 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.013582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njppw\" (UniqueName: \"kubernetes.io/projected/901a811e-a6a7-4e78-92ae-3c71633b894f-kube-api-access-njppw\") pod \"authorino-58cd955675-l4pq9\" (UID: \"901a811e-a6a7-4e78-92ae-3c71633b894f\") " pod="kuadrant-system/authorino-58cd955675-l4pq9" Jun 11 16:52:25.013788 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.013642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xdt\" (UniqueName: \"kubernetes.io/projected/f13c1e3b-482b-444d-86cd-76189e0cc2ef-kube-api-access-n9xdt\") pod \"authorino-75d556bd77-ndsp4\" (UID: \"f13c1e3b-482b-444d-86cd-76189e0cc2ef\") " pod="kuadrant-system/authorino-75d556bd77-ndsp4" Jun 11 16:52:25.022522 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.022500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njppw\" (UniqueName: \"kubernetes.io/projected/901a811e-a6a7-4e78-92ae-3c71633b894f-kube-api-access-njppw\") pod \"authorino-58cd955675-l4pq9\" (UID: \"901a811e-a6a7-4e78-92ae-3c71633b894f\") " pod="kuadrant-system/authorino-58cd955675-l4pq9" Jun 11 16:52:25.114373 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.114289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xdt\" (UniqueName: \"kubernetes.io/projected/f13c1e3b-482b-444d-86cd-76189e0cc2ef-kube-api-access-n9xdt\") pod \"authorino-75d556bd77-ndsp4\" (UID: \"f13c1e3b-482b-444d-86cd-76189e0cc2ef\") " pod="kuadrant-system/authorino-75d556bd77-ndsp4" Jun 11 16:52:25.127237 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.127207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xdt\" (UniqueName: \"kubernetes.io/projected/f13c1e3b-482b-444d-86cd-76189e0cc2ef-kube-api-access-n9xdt\") pod \"authorino-75d556bd77-ndsp4\" (UID: \"f13c1e3b-482b-444d-86cd-76189e0cc2ef\") " pod="kuadrant-system/authorino-75d556bd77-ndsp4" Jun 11 16:52:25.179730 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.179692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l4pq9" Jun 11 16:52:25.292010 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.291977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ndsp4" Jun 11 16:52:25.312356 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.312332 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l4pq9"] Jun 11 16:52:25.314150 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:52:25.314126 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod901a811e_a6a7_4e78_92ae_3c71633b894f.slice/crio-aa718b8cabf521db041789ef997f51bba1f51b3cc963457cdfd82eb8ed0ff123 WatchSource:0}: Error finding container aa718b8cabf521db041789ef997f51bba1f51b3cc963457cdfd82eb8ed0ff123: Status 404 returned error can't find the container with id aa718b8cabf521db041789ef997f51bba1f51b3cc963457cdfd82eb8ed0ff123 Jun 11 16:52:25.425986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.425951 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ndsp4"] Jun 11 16:52:25.427767 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:52:25.427743 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf13c1e3b_482b_444d_86cd_76189e0cc2ef.slice/crio-641732337e03ab339b881405d82359012a2ab0d74fad453a5868fbe84a8151f8 WatchSource:0}: Error finding container 641732337e03ab339b881405d82359012a2ab0d74fad453a5868fbe84a8151f8: Status 404 returned error can't find the container with id 641732337e03ab339b881405d82359012a2ab0d74fad453a5868fbe84a8151f8 Jun 11 16:52:25.485207 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.485173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l4pq9" event={"ID":"901a811e-a6a7-4e78-92ae-3c71633b894f","Type":"ContainerStarted","Data":"aa718b8cabf521db041789ef997f51bba1f51b3cc963457cdfd82eb8ed0ff123"} Jun 11 16:52:25.486315 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:25.486289 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ndsp4" event={"ID":"f13c1e3b-482b-444d-86cd-76189e0cc2ef","Type":"ContainerStarted","Data":"641732337e03ab339b881405d82359012a2ab0d74fad453a5868fbe84a8151f8"} Jun 11 16:52:29.522537 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:29.522489 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ndsp4" event={"ID":"f13c1e3b-482b-444d-86cd-76189e0cc2ef","Type":"ContainerStarted","Data":"996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2"} Jun 11 16:52:29.524103 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:29.524078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l4pq9" event={"ID":"901a811e-a6a7-4e78-92ae-3c71633b894f","Type":"ContainerStarted","Data":"729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f"} Jun 11 16:52:29.539042 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:29.538992 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ndsp4" podStartSLOduration=2.16881125 podStartE2EDuration="5.538976809s" totalImagesPullingTime="3.370165559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:29.536624536 +0000 UTC m=+816.137619294" watchObservedRunningTime="2026-06-11 16:52:29.538976809 +0000 UTC m=+816.139971588" Jun 11 16:52:29.552277 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:29.552208 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-l4pq9" podStartSLOduration=2.080094888 podStartE2EDuration="5.55218603s" totalImagesPullingTime="3.472091142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:29.550372527 +0000 UTC m=+816.151367283" watchObservedRunningTime="2026-06-11 16:52:29.55218603 +0000 UTC m=+816.153180788" Jun 11 16:52:29.585741 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:29.585709 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l4pq9"] Jun 11 16:52:31.534877 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:31.534834 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-l4pq9" podUID="901a811e-a6a7-4e78-92ae-3c71633b894f" containerName="authorino" containerID="cri-o://729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f" gracePeriod=30 Jun 11 16:52:32.287613 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.287588 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l4pq9" Jun 11 16:52:32.384748 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.384709 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njppw\" (UniqueName: \"kubernetes.io/projected/901a811e-a6a7-4e78-92ae-3c71633b894f-kube-api-access-njppw\") pod \"901a811e-a6a7-4e78-92ae-3c71633b894f\" (UID: \"901a811e-a6a7-4e78-92ae-3c71633b894f\") " Jun 11 16:52:32.386796 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.386774 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901a811e-a6a7-4e78-92ae-3c71633b894f-kube-api-access-njppw" (OuterVolumeSpecName: "kube-api-access-njppw") pod "901a811e-a6a7-4e78-92ae-3c71633b894f" (UID: "901a811e-a6a7-4e78-92ae-3c71633b894f"). InnerVolumeSpecName "kube-api-access-njppw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:32.485956 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.485871 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njppw\" (UniqueName: \"kubernetes.io/projected/901a811e-a6a7-4e78-92ae-3c71633b894f-kube-api-access-njppw\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:52:32.540730 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.540691 2563 generic.go:356] "Generic (PLEG): container finished" podID="901a811e-a6a7-4e78-92ae-3c71633b894f" containerID="729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f" exitCode=0 Jun 11 16:52:32.541183 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.540735 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l4pq9" Jun 11 16:52:32.541183 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.540773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l4pq9" event={"ID":"901a811e-a6a7-4e78-92ae-3c71633b894f","Type":"ContainerDied","Data":"729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f"} Jun 11 16:52:32.541183 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.540816 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l4pq9" event={"ID":"901a811e-a6a7-4e78-92ae-3c71633b894f","Type":"ContainerDied","Data":"aa718b8cabf521db041789ef997f51bba1f51b3cc963457cdfd82eb8ed0ff123"} Jun 11 16:52:32.541183 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.540842 2563 scope.go:117] "RemoveContainer" containerID="729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f" Jun 11 16:52:32.550544 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.550529 2563 scope.go:117] "RemoveContainer" containerID="729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f" Jun 11 16:52:32.550803 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:52:32.550785 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f\": container with ID starting with 729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f not found: ID does not exist" containerID="729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f" Jun 11 16:52:32.550852 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.550813 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f"} err="failed to get container status \"729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f\": rpc error: code = NotFound desc = could not find container \"729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f\": container with ID starting with 729d7cf974436bdcec3a9eb62511725d9f90748138ae1a93c4143ed8c598830f not found: ID does not exist" Jun 11 16:52:32.562820 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.562797 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l4pq9"] Jun 11 16:52:32.566353 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:32.566332 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-l4pq9"] Jun 11 16:52:33.842939 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:33.842906 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901a811e-a6a7-4e78-92ae-3c71633b894f" path="/var/lib/kubelet/pods/901a811e-a6a7-4e78-92ae-3c71633b894f/volumes" Jun 11 16:52:49.108016 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.107985 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f95876bb-2tbj7"] Jun 11 16:52:49.108622 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.108494 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901a811e-a6a7-4e78-92ae-3c71633b894f" containerName="authorino" Jun 11 16:52:49.108622 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.108519 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="901a811e-a6a7-4e78-92ae-3c71633b894f" containerName="authorino" Jun 11 16:52:49.108812 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.108652 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="901a811e-a6a7-4e78-92ae-3c71633b894f" containerName="authorino" Jun 11 16:52:49.111030 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.111009 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.125139 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.125113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f95876bb-2tbj7"] Jun 11 16:52:49.226114 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.226077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-config\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.226283 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.226125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zs8\" (UniqueName: \"kubernetes.io/projected/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-kube-api-access-x7zs8\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.226283 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.226183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-service-ca\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.226283 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.226205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-trusted-ca-bundle\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.226283 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.226242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-oauth-config\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.226283 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.226265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-oauth-serving-cert\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.226481 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.226362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-serving-cert\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.327474 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.327433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-service-ca\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.327474 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.327477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-trusted-ca-bundle\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.327766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.327511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-oauth-config\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.327766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.327535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-oauth-serving-cert\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.327766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.327617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-serving-cert\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.327766 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.327690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-config\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.327977 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.327838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zs8\" (UniqueName: \"kubernetes.io/projected/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-kube-api-access-x7zs8\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.328275 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.328251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-service-ca\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.328393 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.328338 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-oauth-serving-cert\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.328478 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.328457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-trusted-ca-bundle\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.328517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.328496 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-config\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.330221 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.330200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-oauth-config\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.330278 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.330209 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-console-serving-cert\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.336113 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.336089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zs8\" (UniqueName: \"kubernetes.io/projected/1313ba1c-57cc-4cee-8bf6-3a3e6ee33967-kube-api-access-x7zs8\") pod \"console-57f95876bb-2tbj7\" (UID: \"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967\") " pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.422708 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.422619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:49.562190 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.562157 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f95876bb-2tbj7"] Jun 11 16:52:49.563358 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:52:49.563331 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1313ba1c_57cc_4cee_8bf6_3a3e6ee33967.slice/crio-94dca39ddf90fe2d79371dbff50db79422be54643eb06a87b5f9ac7617e3e55f WatchSource:0}: Error finding container 94dca39ddf90fe2d79371dbff50db79422be54643eb06a87b5f9ac7617e3e55f: Status 404 returned error can't find the container with id 94dca39ddf90fe2d79371dbff50db79422be54643eb06a87b5f9ac7617e3e55f Jun 11 16:52:49.634997 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.634962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f95876bb-2tbj7" event={"ID":"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967","Type":"ContainerStarted","Data":"ee36de04fb8f666fc7dbb0e9359697c9a54281e2ae1f46b9c30b3b0742265b63"} Jun 11 16:52:49.635154 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.635022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f95876bb-2tbj7" event={"ID":"1313ba1c-57cc-4cee-8bf6-3a3e6ee33967","Type":"ContainerStarted","Data":"94dca39ddf90fe2d79371dbff50db79422be54643eb06a87b5f9ac7617e3e55f"} Jun 11 16:52:49.655498 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:49.655435 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57f95876bb-2tbj7" podStartSLOduration=0.655413345 podStartE2EDuration="655.413345ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:49.650894661 +0000 UTC m=+836.251889431" watchObservedRunningTime="2026-06-11 16:52:49.655413345 +0000 UTC m=+836.256408105" Jun 11 16:52:55.496498 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.496463 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqjtk"] Jun 11 16:52:55.499018 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.499000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" Jun 11 16:52:55.506020 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.505989 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqjtk"] Jun 11 16:52:55.582961 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.582919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm7d9\" (UniqueName: \"kubernetes.io/projected/3ca698e9-30b9-42a8-92c5-78ebc4ebdd88-kube-api-access-hm7d9\") pod \"authorino-5d4b67c446-hqjtk\" (UID: \"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88\") " pod="kuadrant-system/authorino-5d4b67c446-hqjtk" Jun 11 16:52:55.684431 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.684396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm7d9\" (UniqueName: \"kubernetes.io/projected/3ca698e9-30b9-42a8-92c5-78ebc4ebdd88-kube-api-access-hm7d9\") pod \"authorino-5d4b67c446-hqjtk\" (UID: \"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88\") " pod="kuadrant-system/authorino-5d4b67c446-hqjtk" Jun 11 16:52:55.692351 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.692328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm7d9\" (UniqueName: \"kubernetes.io/projected/3ca698e9-30b9-42a8-92c5-78ebc4ebdd88-kube-api-access-hm7d9\") pod \"authorino-5d4b67c446-hqjtk\" (UID: \"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88\") " pod="kuadrant-system/authorino-5d4b67c446-hqjtk" Jun 11 16:52:55.737685 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.737648 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqjtk"] Jun 11 16:52:55.737959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.737948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" Jun 11 16:52:55.765174 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.765144 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-755bc56f49-6z2wb"] Jun 11 16:52:55.768382 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.768358 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755bc56f49-6z2wb" Jun 11 16:52:55.774139 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.774115 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-755bc56f49-6z2wb"] Jun 11 16:52:55.885515 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.885479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94rr\" (UniqueName: \"kubernetes.io/projected/07d9e4f8-1bd7-454f-9f1c-f86730d2302f-kube-api-access-p94rr\") pod \"authorino-755bc56f49-6z2wb\" (UID: \"07d9e4f8-1bd7-454f-9f1c-f86730d2302f\") " pod="kuadrant-system/authorino-755bc56f49-6z2wb" Jun 11 16:52:55.890075 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.890049 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqjtk"] Jun 11 16:52:55.891040 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:52:55.891016 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ca698e9_30b9_42a8_92c5_78ebc4ebdd88.slice/crio-0323029da059f0c1273fb95c017aa81e4c2fc871c270d386f0dbe8747f41759b WatchSource:0}: Error finding container 0323029da059f0c1273fb95c017aa81e4c2fc871c270d386f0dbe8747f41759b: Status 404 returned error can't find the container with id 0323029da059f0c1273fb95c017aa81e4c2fc871c270d386f0dbe8747f41759b Jun 11 16:52:55.986800 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.986766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94rr\" (UniqueName: \"kubernetes.io/projected/07d9e4f8-1bd7-454f-9f1c-f86730d2302f-kube-api-access-p94rr\") pod \"authorino-755bc56f49-6z2wb\" (UID: \"07d9e4f8-1bd7-454f-9f1c-f86730d2302f\") " pod="kuadrant-system/authorino-755bc56f49-6z2wb" Jun 11 16:52:55.994651 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.994623 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94rr\" (UniqueName: \"kubernetes.io/projected/07d9e4f8-1bd7-454f-9f1c-f86730d2302f-kube-api-access-p94rr\") pod \"authorino-755bc56f49-6z2wb\" (UID: \"07d9e4f8-1bd7-454f-9f1c-f86730d2302f\") " pod="kuadrant-system/authorino-755bc56f49-6z2wb" Jun 11 16:52:55.997973 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.997947 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-755bc56f49-6z2wb"] Jun 11 16:52:55.998243 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:55.998227 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755bc56f49-6z2wb" Jun 11 16:52:56.024094 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.024064 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7784f69fb9-lj9b9"] Jun 11 16:52:56.027162 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.027142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.031261 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.031240 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 16:52:56.040220 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.040197 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7784f69fb9-lj9b9"] Jun 11 16:52:56.088256 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.088220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5a414f3-90a4-4626-b197-ae37115ecafb-tls-cert\") pod \"authorino-7784f69fb9-lj9b9\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.088420 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.088341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j667c\" (UniqueName: \"kubernetes.io/projected/c5a414f3-90a4-4626-b197-ae37115ecafb-kube-api-access-j667c\") pod \"authorino-7784f69fb9-lj9b9\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.130898 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.130872 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-755bc56f49-6z2wb"] Jun 11 16:52:56.131905 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:52:56.131875 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07d9e4f8_1bd7_454f_9f1c_f86730d2302f.slice/crio-90d131f13f1e4e2088d77346c7b1c59409d0323f2338c34a7052f94bebd89c47 WatchSource:0}: Error finding container 90d131f13f1e4e2088d77346c7b1c59409d0323f2338c34a7052f94bebd89c47: Status 404 returned error can't find the container with id 90d131f13f1e4e2088d77346c7b1c59409d0323f2338c34a7052f94bebd89c47 Jun 11 16:52:56.189073 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.189041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j667c\" (UniqueName: \"kubernetes.io/projected/c5a414f3-90a4-4626-b197-ae37115ecafb-kube-api-access-j667c\") pod \"authorino-7784f69fb9-lj9b9\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.189209 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.189102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5a414f3-90a4-4626-b197-ae37115ecafb-tls-cert\") pod \"authorino-7784f69fb9-lj9b9\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.191513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.191491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5a414f3-90a4-4626-b197-ae37115ecafb-tls-cert\") pod \"authorino-7784f69fb9-lj9b9\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.196707 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.196680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j667c\" (UniqueName: \"kubernetes.io/projected/c5a414f3-90a4-4626-b197-ae37115ecafb-kube-api-access-j667c\") pod \"authorino-7784f69fb9-lj9b9\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.337314 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.337279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:52:56.478649 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.478616 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7784f69fb9-lj9b9"] Jun 11 16:52:56.479739 ip-10-0-139-153 kubenswrapper[2563]: W0611 16:52:56.479715 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5a414f3_90a4_4626_b197_ae37115ecafb.slice/crio-fe7b82908ecffcccfa2815a5ea8ab841fc65b7704c52d7b2aab5761bcc822264 WatchSource:0}: Error finding container fe7b82908ecffcccfa2815a5ea8ab841fc65b7704c52d7b2aab5761bcc822264: Status 404 returned error can't find the container with id fe7b82908ecffcccfa2815a5ea8ab841fc65b7704c52d7b2aab5761bcc822264 Jun 11 16:52:56.678589 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.678539 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755bc56f49-6z2wb" event={"ID":"07d9e4f8-1bd7-454f-9f1c-f86730d2302f","Type":"ContainerStarted","Data":"0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e"} Jun 11 16:52:56.679088 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.678604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755bc56f49-6z2wb" event={"ID":"07d9e4f8-1bd7-454f-9f1c-f86730d2302f","Type":"ContainerStarted","Data":"90d131f13f1e4e2088d77346c7b1c59409d0323f2338c34a7052f94bebd89c47"} Jun 11 16:52:56.679088 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.678594 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-755bc56f49-6z2wb" podUID="07d9e4f8-1bd7-454f-9f1c-f86730d2302f" containerName="authorino" containerID="cri-o://0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e" gracePeriod=30 Jun 11 16:52:56.679966 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.679931 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" event={"ID":"c5a414f3-90a4-4626-b197-ae37115ecafb","Type":"ContainerStarted","Data":"fe7b82908ecffcccfa2815a5ea8ab841fc65b7704c52d7b2aab5761bcc822264"} Jun 11 16:52:56.681834 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.681802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" event={"ID":"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88","Type":"ContainerStarted","Data":"d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102"} Jun 11 16:52:56.681959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.681843 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" event={"ID":"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88","Type":"ContainerStarted","Data":"0323029da059f0c1273fb95c017aa81e4c2fc871c270d386f0dbe8747f41759b"} Jun 11 16:52:56.681959 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.681871 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" podUID="3ca698e9-30b9-42a8-92c5-78ebc4ebdd88" containerName="authorino" containerID="cri-o://d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102" gracePeriod=30 Jun 11 16:52:56.697238 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.697190 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-755bc56f49-6z2wb" podStartSLOduration=1.386635629 podStartE2EDuration="1.697175506s" totalImagesPullingTime="310.539877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:56.694998291 +0000 UTC m=+843.295993050" watchObservedRunningTime="2026-06-11 16:52:56.697175506 +0000 UTC m=+843.298170240" Jun 11 16:52:56.710360 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.710321 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" podStartSLOduration=1.3790629779999999 podStartE2EDuration="1.71030863s" totalImagesPullingTime="331.245652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:56.707660348 +0000 UTC m=+843.308655118" watchObservedRunningTime="2026-06-11 16:52:56.71030863 +0000 UTC m=+843.311303386" Jun 11 16:52:56.950604 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.950577 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755bc56f49-6z2wb" Jun 11 16:52:56.954212 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:56.954193 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" Jun 11 16:52:57.098314 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.098277 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm7d9\" (UniqueName: \"kubernetes.io/projected/3ca698e9-30b9-42a8-92c5-78ebc4ebdd88-kube-api-access-hm7d9\") pod \"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88\" (UID: \"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88\") " Jun 11 16:52:57.098314 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.098314 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p94rr\" (UniqueName: \"kubernetes.io/projected/07d9e4f8-1bd7-454f-9f1c-f86730d2302f-kube-api-access-p94rr\") pod \"07d9e4f8-1bd7-454f-9f1c-f86730d2302f\" (UID: \"07d9e4f8-1bd7-454f-9f1c-f86730d2302f\") " Jun 11 16:52:57.100426 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.100395 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca698e9-30b9-42a8-92c5-78ebc4ebdd88-kube-api-access-hm7d9" (OuterVolumeSpecName: "kube-api-access-hm7d9") pod "3ca698e9-30b9-42a8-92c5-78ebc4ebdd88" (UID: "3ca698e9-30b9-42a8-92c5-78ebc4ebdd88"). InnerVolumeSpecName "kube-api-access-hm7d9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:57.100677 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.100653 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d9e4f8-1bd7-454f-9f1c-f86730d2302f-kube-api-access-p94rr" (OuterVolumeSpecName: "kube-api-access-p94rr") pod "07d9e4f8-1bd7-454f-9f1c-f86730d2302f" (UID: "07d9e4f8-1bd7-454f-9f1c-f86730d2302f"). InnerVolumeSpecName "kube-api-access-p94rr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:57.199383 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.199300 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm7d9\" (UniqueName: \"kubernetes.io/projected/3ca698e9-30b9-42a8-92c5-78ebc4ebdd88-kube-api-access-hm7d9\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:52:57.199383 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.199329 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p94rr\" (UniqueName: \"kubernetes.io/projected/07d9e4f8-1bd7-454f-9f1c-f86730d2302f-kube-api-access-p94rr\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:52:57.689518 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.689481 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" event={"ID":"c5a414f3-90a4-4626-b197-ae37115ecafb","Type":"ContainerStarted","Data":"8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f"} Jun 11 16:52:57.690782 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.690758 2563 generic.go:356] "Generic (PLEG): container finished" podID="3ca698e9-30b9-42a8-92c5-78ebc4ebdd88" containerID="d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102" exitCode=0 Jun 11 16:52:57.690910 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.690799 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" Jun 11 16:52:57.690910 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.690805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" event={"ID":"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88","Type":"ContainerDied","Data":"d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102"} Jun 11 16:52:57.690910 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.690842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqjtk" event={"ID":"3ca698e9-30b9-42a8-92c5-78ebc4ebdd88","Type":"ContainerDied","Data":"0323029da059f0c1273fb95c017aa81e4c2fc871c270d386f0dbe8747f41759b"} Jun 11 16:52:57.690910 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.690860 2563 scope.go:117] "RemoveContainer" containerID="d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102" Jun 11 16:52:57.692413 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.692391 2563 generic.go:356] "Generic (PLEG): container finished" podID="07d9e4f8-1bd7-454f-9f1c-f86730d2302f" containerID="0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e" exitCode=0 Jun 11 16:52:57.692503 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.692428 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755bc56f49-6z2wb" Jun 11 16:52:57.692503 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.692486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755bc56f49-6z2wb" event={"ID":"07d9e4f8-1bd7-454f-9f1c-f86730d2302f","Type":"ContainerDied","Data":"0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e"} Jun 11 16:52:57.692636 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.692526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755bc56f49-6z2wb" event={"ID":"07d9e4f8-1bd7-454f-9f1c-f86730d2302f","Type":"ContainerDied","Data":"90d131f13f1e4e2088d77346c7b1c59409d0323f2338c34a7052f94bebd89c47"} Jun 11 16:52:57.703974 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.703794 2563 scope.go:117] "RemoveContainer" containerID="d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102" Jun 11 16:52:57.704613 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:52:57.704585 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102\": container with ID starting with d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102 not found: ID does not exist" containerID="d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102" Jun 11 16:52:57.704723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.704627 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102"} err="failed to get container status \"d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102\": rpc error: code = NotFound desc = could not find container \"d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102\": container with ID starting with d4c11828dfa8123f830fcc348c074bfd893ee39c467e522e8beefa51768c0102 not found: ID does not exist" Jun 11 16:52:57.704723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.704652 2563 scope.go:117] "RemoveContainer" containerID="0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e" Jun 11 16:52:57.707082 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.707040 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" podStartSLOduration=1.324271775 podStartE2EDuration="1.707026934s" totalImagesPullingTime="382.755159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:57.703870798 +0000 UTC m=+844.304865556" watchObservedRunningTime="2026-06-11 16:52:57.707026934 +0000 UTC m=+844.308021708" Jun 11 16:52:57.714185 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.714070 2563 scope.go:117] "RemoveContainer" containerID="0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e" Jun 11 16:52:57.714426 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:52:57.714392 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e\": container with ID starting with 0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e not found: ID does not exist" containerID="0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e" Jun 11 16:52:57.714499 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.714448 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e"} err="failed to get container status \"0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e\": rpc error: code = NotFound desc = could not find container \"0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e\": container with ID starting with 0f426e232e67168a7ecde458557642d43ab7c5384b8143ec82f109106b58102e not found: ID does not exist" Jun 11 16:52:57.719007 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.718983 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqjtk"] Jun 11 16:52:57.725025 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.724999 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqjtk"] Jun 11 16:52:57.728955 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.728934 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ndsp4"] Jun 11 16:52:57.729126 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.729107 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ndsp4" podUID="f13c1e3b-482b-444d-86cd-76189e0cc2ef" containerName="authorino" containerID="cri-o://996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2" gracePeriod=30 Jun 11 16:52:57.752612 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.752525 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-755bc56f49-6z2wb"] Jun 11 16:52:57.756678 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.756652 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-755bc56f49-6z2wb"] Jun 11 16:52:57.845838 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.845801 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07d9e4f8-1bd7-454f-9f1c-f86730d2302f" path="/var/lib/kubelet/pods/07d9e4f8-1bd7-454f-9f1c-f86730d2302f/volumes" Jun 11 16:52:57.846378 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.846356 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca698e9-30b9-42a8-92c5-78ebc4ebdd88" path="/var/lib/kubelet/pods/3ca698e9-30b9-42a8-92c5-78ebc4ebdd88/volumes" Jun 11 16:52:57.999154 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:57.999128 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ndsp4" Jun 11 16:52:58.107700 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.107653 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9xdt\" (UniqueName: \"kubernetes.io/projected/f13c1e3b-482b-444d-86cd-76189e0cc2ef-kube-api-access-n9xdt\") pod \"f13c1e3b-482b-444d-86cd-76189e0cc2ef\" (UID: \"f13c1e3b-482b-444d-86cd-76189e0cc2ef\") " Jun 11 16:52:58.109819 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.109796 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13c1e3b-482b-444d-86cd-76189e0cc2ef-kube-api-access-n9xdt" (OuterVolumeSpecName: "kube-api-access-n9xdt") pod "f13c1e3b-482b-444d-86cd-76189e0cc2ef" (UID: "f13c1e3b-482b-444d-86cd-76189e0cc2ef"). InnerVolumeSpecName "kube-api-access-n9xdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:52:58.208572 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.208513 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9xdt\" (UniqueName: \"kubernetes.io/projected/f13c1e3b-482b-444d-86cd-76189e0cc2ef-kube-api-access-n9xdt\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:52:58.700628 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.700590 2563 generic.go:356] "Generic (PLEG): container finished" podID="f13c1e3b-482b-444d-86cd-76189e0cc2ef" containerID="996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2" exitCode=0 Jun 11 16:52:58.700628 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.700622 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ndsp4" Jun 11 16:52:58.701162 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.700665 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ndsp4" event={"ID":"f13c1e3b-482b-444d-86cd-76189e0cc2ef","Type":"ContainerDied","Data":"996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2"} Jun 11 16:52:58.701162 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.700704 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ndsp4" event={"ID":"f13c1e3b-482b-444d-86cd-76189e0cc2ef","Type":"ContainerDied","Data":"641732337e03ab339b881405d82359012a2ab0d74fad453a5868fbe84a8151f8"} Jun 11 16:52:58.701162 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.700722 2563 scope.go:117] "RemoveContainer" containerID="996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2" Jun 11 16:52:58.709961 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.709944 2563 scope.go:117] "RemoveContainer" containerID="996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2" Jun 11 16:52:58.710231 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:52:58.710209 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2\": container with ID starting with 996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2 not found: ID does not exist" containerID="996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2" Jun 11 16:52:58.710328 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.710239 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2"} err="failed to get container status \"996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2\": rpc error: code = NotFound desc = could not find container \"996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2\": container with ID starting with 996b5fcd0934bba74b55ecb42ac2ca790df8ff7277a55840585cddfdeb5c0ce2 not found: ID does not exist" Jun 11 16:52:58.721303 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.721279 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ndsp4"] Jun 11 16:52:58.723616 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:58.723597 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ndsp4"] Jun 11 16:52:59.422982 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:59.422942 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:59.423165 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:59.423007 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:59.428181 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:59.428156 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:59.713272 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:59.713194 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57f95876bb-2tbj7" Jun 11 16:52:59.759326 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:59.759289 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6657ccdb65-7lwbq"] Jun 11 16:52:59.845266 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:52:59.845225 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13c1e3b-482b-444d-86cd-76189e0cc2ef" path="/var/lib/kubelet/pods/f13c1e3b-482b-444d-86cd-76189e0cc2ef/volumes" Jun 11 16:53:24.783463 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:24.783406 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6657ccdb65-7lwbq" podUID="e8a5b559-10b2-4e10-aec2-c04ea1ab850c" containerName="console" containerID="cri-o://db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7" gracePeriod=15 Jun 11 16:53:25.032027 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.032004 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:53:25.041434 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041378 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-serving-cert\") pod \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " Jun 11 16:53:25.041513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041443 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-oauth-config\") pod \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " Jun 11 16:53:25.041513 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041500 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-config\") pod \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " Jun 11 16:53:25.041613 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041564 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxf4t\" (UniqueName: \"kubernetes.io/projected/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-kube-api-access-nxf4t\") pod \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " Jun 11 16:53:25.041613 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041592 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-service-ca\") pod \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " Jun 11 16:53:25.041723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041620 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-trusted-ca-bundle\") pod \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " Jun 11 16:53:25.041723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041662 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-oauth-serving-cert\") pod \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\" (UID: \"e8a5b559-10b2-4e10-aec2-c04ea1ab850c\") " Jun 11 16:53:25.041928 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.041901 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-config" (OuterVolumeSpecName: "console-config") pod "e8a5b559-10b2-4e10-aec2-c04ea1ab850c" (UID: "e8a5b559-10b2-4e10-aec2-c04ea1ab850c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:25.042189 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.042161 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8a5b559-10b2-4e10-aec2-c04ea1ab850c" (UID: "e8a5b559-10b2-4e10-aec2-c04ea1ab850c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:25.042256 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.042163 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8a5b559-10b2-4e10-aec2-c04ea1ab850c" (UID: "e8a5b559-10b2-4e10-aec2-c04ea1ab850c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:25.042305 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.042285 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8a5b559-10b2-4e10-aec2-c04ea1ab850c" (UID: "e8a5b559-10b2-4e10-aec2-c04ea1ab850c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:53:25.043744 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.043720 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8a5b559-10b2-4e10-aec2-c04ea1ab850c" (UID: "e8a5b559-10b2-4e10-aec2-c04ea1ab850c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:53:25.044043 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.044016 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8a5b559-10b2-4e10-aec2-c04ea1ab850c" (UID: "e8a5b559-10b2-4e10-aec2-c04ea1ab850c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:53:25.044043 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.044022 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-kube-api-access-nxf4t" (OuterVolumeSpecName: "kube-api-access-nxf4t") pod "e8a5b559-10b2-4e10-aec2-c04ea1ab850c" (UID: "e8a5b559-10b2-4e10-aec2-c04ea1ab850c"). InnerVolumeSpecName "kube-api-access-nxf4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:53:25.142796 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.142762 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-serving-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:53:25.142796 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.142789 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-oauth-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:53:25.142796 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.142800 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-console-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:53:25.143036 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.142809 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxf4t\" (UniqueName: \"kubernetes.io/projected/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-kube-api-access-nxf4t\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:53:25.143036 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.142820 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-service-ca\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:53:25.143036 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.142828 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-trusted-ca-bundle\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:53:25.143036 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.142836 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a5b559-10b2-4e10-aec2-c04ea1ab850c-oauth-serving-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:53:25.855338 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.855302 2563 generic.go:356] "Generic (PLEG): container finished" podID="e8a5b559-10b2-4e10-aec2-c04ea1ab850c" containerID="db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7" exitCode=0 Jun 11 16:53:25.855723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.855349 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6657ccdb65-7lwbq" Jun 11 16:53:25.855723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.855379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6657ccdb65-7lwbq" event={"ID":"e8a5b559-10b2-4e10-aec2-c04ea1ab850c","Type":"ContainerDied","Data":"db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7"} Jun 11 16:53:25.855723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.855423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6657ccdb65-7lwbq" event={"ID":"e8a5b559-10b2-4e10-aec2-c04ea1ab850c","Type":"ContainerDied","Data":"7f97e88b9a66c694ec4621244b07660c89a4ce2d6440a2286b2aee34d5654243"} Jun 11 16:53:25.855723 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.855442 2563 scope.go:117] "RemoveContainer" containerID="db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7" Jun 11 16:53:25.864622 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.864602 2563 scope.go:117] "RemoveContainer" containerID="db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7" Jun 11 16:53:25.864899 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:53:25.864880 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7\": container with ID starting with db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7 not found: ID does not exist" containerID="db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7" Jun 11 16:53:25.864946 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.864907 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7"} err="failed to get container status \"db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7\": rpc error: code = NotFound desc = could not find container \"db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7\": container with ID starting with db0d09371e45d5535cc8a38eb83f3713e356efe0747515a561ed973a67f218c7 not found: ID does not exist" Jun 11 16:53:25.874306 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.874282 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6657ccdb65-7lwbq"] Jun 11 16:53:25.878064 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:25.878043 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6657ccdb65-7lwbq"] Jun 11 16:53:27.848215 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:27.848179 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a5b559-10b2-4e10-aec2-c04ea1ab850c" path="/var/lib/kubelet/pods/e8a5b559-10b2-4e10-aec2-c04ea1ab850c/volumes" Jun 11 16:53:53.849870 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:53.849842 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:53:53.851433 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:53.851408 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:53:53.856752 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:53.856730 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:53:53.857890 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:53:53.857868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:54:57.098325 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098290 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-556869f76-9rmwz"] Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098680 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d9e4f8-1bd7-454f-9f1c-f86730d2302f" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098694 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d9e4f8-1bd7-454f-9f1c-f86730d2302f" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098709 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13c1e3b-482b-444d-86cd-76189e0cc2ef" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098717 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13c1e3b-482b-444d-86cd-76189e0cc2ef" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098723 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca698e9-30b9-42a8-92c5-78ebc4ebdd88" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098729 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca698e9-30b9-42a8-92c5-78ebc4ebdd88" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098739 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a5b559-10b2-4e10-aec2-c04ea1ab850c" containerName="console" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098745 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a5b559-10b2-4e10-aec2-c04ea1ab850c" containerName="console" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098805 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13c1e3b-482b-444d-86cd-76189e0cc2ef" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098813 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d9e4f8-1bd7-454f-9f1c-f86730d2302f" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098820 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca698e9-30b9-42a8-92c5-78ebc4ebdd88" containerName="authorino" Jun 11 16:54:57.098828 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.098828 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a5b559-10b2-4e10-aec2-c04ea1ab850c" containerName="console" Jun 11 16:54:57.101745 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.101728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.109095 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.109070 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-556869f76-9rmwz"] Jun 11 16:54:57.156309 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.156277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c77d588d-2e56-467d-bd22-440c402b3741-tls-cert\") pod \"authorino-556869f76-9rmwz\" (UID: \"c77d588d-2e56-467d-bd22-440c402b3741\") " pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.156517 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.156358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8c77\" (UniqueName: \"kubernetes.io/projected/c77d588d-2e56-467d-bd22-440c402b3741-kube-api-access-t8c77\") pod \"authorino-556869f76-9rmwz\" (UID: \"c77d588d-2e56-467d-bd22-440c402b3741\") " pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.257598 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.257541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8c77\" (UniqueName: \"kubernetes.io/projected/c77d588d-2e56-467d-bd22-440c402b3741-kube-api-access-t8c77\") pod \"authorino-556869f76-9rmwz\" (UID: \"c77d588d-2e56-467d-bd22-440c402b3741\") " pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.257782 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.257608 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c77d588d-2e56-467d-bd22-440c402b3741-tls-cert\") pod \"authorino-556869f76-9rmwz\" (UID: \"c77d588d-2e56-467d-bd22-440c402b3741\") " pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.260039 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.260016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c77d588d-2e56-467d-bd22-440c402b3741-tls-cert\") pod \"authorino-556869f76-9rmwz\" (UID: \"c77d588d-2e56-467d-bd22-440c402b3741\") " pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.264856 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.264830 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8c77\" (UniqueName: \"kubernetes.io/projected/c77d588d-2e56-467d-bd22-440c402b3741-kube-api-access-t8c77\") pod \"authorino-556869f76-9rmwz\" (UID: \"c77d588d-2e56-467d-bd22-440c402b3741\") " pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.411757 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.411654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556869f76-9rmwz" Jun 11 16:54:57.553578 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.553479 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-556869f76-9rmwz"] Jun 11 16:54:57.555422 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:57.555402 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:54:58.361231 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.361194 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-556869f76-9rmwz" event={"ID":"c77d588d-2e56-467d-bd22-440c402b3741","Type":"ContainerStarted","Data":"0fdb429715e2e770ad7ff02462e0ea37d2ea8f34fa50512017663ebc25e699aa"} Jun 11 16:54:58.361767 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.361250 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-556869f76-9rmwz" event={"ID":"c77d588d-2e56-467d-bd22-440c402b3741","Type":"ContainerStarted","Data":"cc32edeefd7646fa30c69e8aa355792e8b61e595408384ffa2e0ae48dae2f543"} Jun 11 16:54:58.383155 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.383093 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-556869f76-9rmwz" podStartSLOduration=1.0093725 podStartE2EDuration="1.383074091s" totalImagesPullingTime="373.701591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:58.382313137 +0000 UTC m=+964.983307894" watchObservedRunningTime="2026-06-11 16:54:58.383074091 +0000 UTC m=+964.984068848" Jun 11 16:54:58.411182 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.411141 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7784f69fb9-lj9b9"] Jun 11 16:54:58.411413 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.411382 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" podUID="c5a414f3-90a4-4626-b197-ae37115ecafb" containerName="authorino" containerID="cri-o://8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f" gracePeriod=30 Jun 11 16:54:58.686769 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.686737 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:54:58.770141 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.770112 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5a414f3-90a4-4626-b197-ae37115ecafb-tls-cert\") pod \"c5a414f3-90a4-4626-b197-ae37115ecafb\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " Jun 11 16:54:58.780966 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.780939 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5a414f3-90a4-4626-b197-ae37115ecafb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c5a414f3-90a4-4626-b197-ae37115ecafb" (UID: "c5a414f3-90a4-4626-b197-ae37115ecafb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:54:58.871287 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.871249 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j667c\" (UniqueName: \"kubernetes.io/projected/c5a414f3-90a4-4626-b197-ae37115ecafb-kube-api-access-j667c\") pod \"c5a414f3-90a4-4626-b197-ae37115ecafb\" (UID: \"c5a414f3-90a4-4626-b197-ae37115ecafb\") " Jun 11 16:54:58.871505 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.871489 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5a414f3-90a4-4626-b197-ae37115ecafb-tls-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:54:58.873274 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.873243 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5a414f3-90a4-4626-b197-ae37115ecafb-kube-api-access-j667c" (OuterVolumeSpecName: "kube-api-access-j667c") pod "c5a414f3-90a4-4626-b197-ae37115ecafb" (UID: "c5a414f3-90a4-4626-b197-ae37115ecafb"). InnerVolumeSpecName "kube-api-access-j667c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:54:58.972657 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:58.972530 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j667c\" (UniqueName: \"kubernetes.io/projected/c5a414f3-90a4-4626-b197-ae37115ecafb-kube-api-access-j667c\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 16:54:59.367874 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.367841 2563 generic.go:356] "Generic (PLEG): container finished" podID="c5a414f3-90a4-4626-b197-ae37115ecafb" containerID="8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f" exitCode=0 Jun 11 16:54:59.368317 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.367884 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" Jun 11 16:54:59.368317 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.367927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" event={"ID":"c5a414f3-90a4-4626-b197-ae37115ecafb","Type":"ContainerDied","Data":"8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f"} Jun 11 16:54:59.368317 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.367966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7784f69fb9-lj9b9" event={"ID":"c5a414f3-90a4-4626-b197-ae37115ecafb","Type":"ContainerDied","Data":"fe7b82908ecffcccfa2815a5ea8ab841fc65b7704c52d7b2aab5761bcc822264"} Jun 11 16:54:59.368317 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.367982 2563 scope.go:117] "RemoveContainer" containerID="8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f" Jun 11 16:54:59.377184 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.377169 2563 scope.go:117] "RemoveContainer" containerID="8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f" Jun 11 16:54:59.377426 ip-10-0-139-153 kubenswrapper[2563]: E0611 16:54:59.377408 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f\": container with ID starting with 8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f not found: ID does not exist" containerID="8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f" Jun 11 16:54:59.377466 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.377435 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f"} err="failed to get container status \"8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f\": rpc error: code = NotFound desc = could not find container \"8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f\": container with ID starting with 8c709700de2eefbce6803b30293bbfe4c1eefbd725da2c16505340414a30167f not found: ID does not exist" Jun 11 16:54:59.388986 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.388960 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7784f69fb9-lj9b9"] Jun 11 16:54:59.391196 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.391180 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7784f69fb9-lj9b9"] Jun 11 16:54:59.844750 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:54:59.844717 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5a414f3-90a4-4626-b197-ae37115ecafb" path="/var/lib/kubelet/pods/c5a414f3-90a4-4626-b197-ae37115ecafb/volumes" Jun 11 16:58:53.885678 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:58:53.885648 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:58:53.888675 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:58:53.888653 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 16:58:53.892378 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:58:53.892358 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 16:58:53.895438 ip-10-0-139-153 kubenswrapper[2563]: I0611 16:58:53.895420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 17:00:00.141401 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.141316 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-pfhkl"] Jun 11 17:00:00.144012 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.141904 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5a414f3-90a4-4626-b197-ae37115ecafb" containerName="authorino" Jun 11 17:00:00.144012 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.141920 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5a414f3-90a4-4626-b197-ae37115ecafb" containerName="authorino" Jun 11 17:00:00.144012 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.141984 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5a414f3-90a4-4626-b197-ae37115ecafb" containerName="authorino" Jun 11 17:00:00.144926 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.144908 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" Jun 11 17:00:00.147368 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.147352 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2d9f4\"" Jun 11 17:00:00.156807 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.156778 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-pfhkl"] Jun 11 17:00:00.184315 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.184277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnqx\" (UniqueName: \"kubernetes.io/projected/9765b601-8678-4d66-88d6-17554f00a1eb-kube-api-access-gtnqx\") pod \"maas-api-key-cleanup-29686620-pfhkl\" (UID: \"9765b601-8678-4d66-88d6-17554f00a1eb\") " pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" Jun 11 17:00:00.285807 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.285763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnqx\" (UniqueName: \"kubernetes.io/projected/9765b601-8678-4d66-88d6-17554f00a1eb-kube-api-access-gtnqx\") pod \"maas-api-key-cleanup-29686620-pfhkl\" (UID: \"9765b601-8678-4d66-88d6-17554f00a1eb\") " pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" Jun 11 17:00:00.294077 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.294036 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnqx\" (UniqueName: \"kubernetes.io/projected/9765b601-8678-4d66-88d6-17554f00a1eb-kube-api-access-gtnqx\") pod \"maas-api-key-cleanup-29686620-pfhkl\" (UID: \"9765b601-8678-4d66-88d6-17554f00a1eb\") " pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" Jun 11 17:00:00.455367 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.455281 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" Jun 11 17:00:00.593568 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.593529 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-pfhkl"] Jun 11 17:00:00.595919 ip-10-0-139-153 kubenswrapper[2563]: W0611 17:00:00.595891 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9765b601_8678_4d66_88d6_17554f00a1eb.slice/crio-1b99c24bd8df125d4dfc6dcbaa8a6a60f36a1660b20ddd94f6128fb3f3f1952e WatchSource:0}: Error finding container 1b99c24bd8df125d4dfc6dcbaa8a6a60f36a1660b20ddd94f6128fb3f3f1952e: Status 404 returned error can't find the container with id 1b99c24bd8df125d4dfc6dcbaa8a6a60f36a1660b20ddd94f6128fb3f3f1952e Jun 11 17:00:00.597981 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:00.597962 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:00:01.041722 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:01.041686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" event={"ID":"9765b601-8678-4d66-88d6-17554f00a1eb","Type":"ContainerStarted","Data":"1b99c24bd8df125d4dfc6dcbaa8a6a60f36a1660b20ddd94f6128fb3f3f1952e"} Jun 11 17:00:15.123050 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:15.123002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" event={"ID":"9765b601-8678-4d66-88d6-17554f00a1eb","Type":"ContainerStarted","Data":"e1945f01f729a2313be5e7995b1d59b12b35009bdcac2debc5d73f409a1478fe"} Jun 11 17:00:15.138363 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:15.138302 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" podStartSLOduration=1.109561339 podStartE2EDuration="15.138286704s" totalImagesPullingTime="14.028725365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:00:15.13680827 +0000 UTC m=+1281.737803026" watchObservedRunningTime="2026-06-11 17:00:15.138286704 +0000 UTC m=+1281.739281459" Jun 11 17:00:36.242613 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:36.242573 2563 generic.go:356] "Generic (PLEG): container finished" podID="9765b601-8678-4d66-88d6-17554f00a1eb" containerID="e1945f01f729a2313be5e7995b1d59b12b35009bdcac2debc5d73f409a1478fe" exitCode=6 Jun 11 17:00:36.243024 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:36.242646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" event={"ID":"9765b601-8678-4d66-88d6-17554f00a1eb","Type":"ContainerDied","Data":"e1945f01f729a2313be5e7995b1d59b12b35009bdcac2debc5d73f409a1478fe"} Jun 11 17:00:36.243024 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:36.243009 2563 scope.go:117] "RemoveContainer" containerID="e1945f01f729a2313be5e7995b1d59b12b35009bdcac2debc5d73f409a1478fe" Jun 11 17:00:37.250493 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:37.250451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" event={"ID":"9765b601-8678-4d66-88d6-17554f00a1eb","Type":"ContainerStarted","Data":"d2d3a3aa520959c3e23a87432667091fded47bdb3e94de9307a87f25930e5ee8"} Jun 11 17:00:57.360926 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:57.360889 2563 generic.go:356] "Generic (PLEG): container finished" podID="9765b601-8678-4d66-88d6-17554f00a1eb" containerID="d2d3a3aa520959c3e23a87432667091fded47bdb3e94de9307a87f25930e5ee8" exitCode=6 Jun 11 17:00:57.361366 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:57.360971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" event={"ID":"9765b601-8678-4d66-88d6-17554f00a1eb","Type":"ContainerDied","Data":"d2d3a3aa520959c3e23a87432667091fded47bdb3e94de9307a87f25930e5ee8"} Jun 11 17:00:57.361366 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:57.361038 2563 scope.go:117] "RemoveContainer" containerID="e1945f01f729a2313be5e7995b1d59b12b35009bdcac2debc5d73f409a1478fe" Jun 11 17:00:57.361366 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:00:57.361326 2563 scope.go:117] "RemoveContainer" containerID="d2d3a3aa520959c3e23a87432667091fded47bdb3e94de9307a87f25930e5ee8" Jun 11 17:00:57.361631 ip-10-0-139-153 kubenswrapper[2563]: E0611 17:00:57.361613 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29686620-pfhkl_opendatahub(9765b601-8678-4d66-88d6-17554f00a1eb)\"" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" Jun 11 17:01:00.010107 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.010074 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-pfhkl"] Jun 11 17:01:00.146364 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.146333 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" Jun 11 17:01:00.204973 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.204937 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtnqx\" (UniqueName: \"kubernetes.io/projected/9765b601-8678-4d66-88d6-17554f00a1eb-kube-api-access-gtnqx\") pod \"9765b601-8678-4d66-88d6-17554f00a1eb\" (UID: \"9765b601-8678-4d66-88d6-17554f00a1eb\") " Jun 11 17:01:00.207115 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.207080 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9765b601-8678-4d66-88d6-17554f00a1eb-kube-api-access-gtnqx" (OuterVolumeSpecName: "kube-api-access-gtnqx") pod "9765b601-8678-4d66-88d6-17554f00a1eb" (UID: "9765b601-8678-4d66-88d6-17554f00a1eb"). InnerVolumeSpecName "kube-api-access-gtnqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:01:00.305781 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.305745 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtnqx\" (UniqueName: \"kubernetes.io/projected/9765b601-8678-4d66-88d6-17554f00a1eb-kube-api-access-gtnqx\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jun 11 17:01:00.380695 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.380665 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" Jun 11 17:01:00.380857 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.380694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-pfhkl" event={"ID":"9765b601-8678-4d66-88d6-17554f00a1eb","Type":"ContainerDied","Data":"1b99c24bd8df125d4dfc6dcbaa8a6a60f36a1660b20ddd94f6128fb3f3f1952e"} Jun 11 17:01:00.380857 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.380749 2563 scope.go:117] "RemoveContainer" containerID="d2d3a3aa520959c3e23a87432667091fded47bdb3e94de9307a87f25930e5ee8" Jun 11 17:01:00.401412 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.401385 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-pfhkl"] Jun 11 17:01:00.404693 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:00.404670 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-pfhkl"] Jun 11 17:01:01.842905 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:01:01.842871 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" path="/var/lib/kubelet/pods/9765b601-8678-4d66-88d6-17554f00a1eb/volumes" Jun 11 17:03:53.926055 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:03:53.926022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 17:03:53.928422 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:03:53.928397 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 17:03:53.933064 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:03:53.933044 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 17:03:53.942238 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:03:53.938394 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 17:08:53.964081 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:08:53.964054 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 17:08:53.971244 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:08:53.971217 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 17:08:53.973438 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:08:53.973416 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 17:08:53.979897 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:08:53.979874 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 17:13:02.391830 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:02.391793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-556869f76-9rmwz_c77d588d-2e56-467d-bd22-440c402b3741/authorino/0.log" Jun 11 17:13:06.692274 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:06.692244 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf9999c4-dkpcx_801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7/manager/0.log" Jun 11 17:13:07.834911 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:07.834884 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42_3ec17f95-3a2f-43d5-85ab-713d39931780/extract/0.log" Jun 11 17:13:07.840727 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:07.840696 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42_3ec17f95-3a2f-43d5-85ab-713d39931780/util/0.log" Jun 11 17:13:07.846711 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:07.846687 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42_3ec17f95-3a2f-43d5-85ab-713d39931780/pull/0.log" Jun 11 17:13:07.960276 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:07.960250 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn_85f4995d-159d-4616-a799-b89ed67e3059/util/0.log" Jun 11 17:13:07.965654 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:07.965634 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn_85f4995d-159d-4616-a799-b89ed67e3059/pull/0.log" Jun 11 17:13:07.970592 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:07.970544 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn_85f4995d-159d-4616-a799-b89ed67e3059/extract/0.log" Jun 11 17:13:08.086520 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.086432 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v_1f46478a-c272-43df-b462-74538b8c662e/util/0.log" Jun 11 17:13:08.092544 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.092522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v_1f46478a-c272-43df-b462-74538b8c662e/pull/0.log" Jun 11 17:13:08.098498 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.098475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v_1f46478a-c272-43df-b462-74538b8c662e/extract/0.log" Jun 11 17:13:08.214040 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.214012 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn_d3e961c0-d07a-4e99-875e-2783076df758/util/0.log" Jun 11 17:13:08.222814 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.222790 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn_d3e961c0-d07a-4e99-875e-2783076df758/pull/0.log" Jun 11 17:13:08.229027 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.229005 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn_d3e961c0-d07a-4e99-875e-2783076df758/extract/0.log" Jun 11 17:13:08.345526 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.345436 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-556869f76-9rmwz_c77d588d-2e56-467d-bd22-440c402b3741/authorino/0.log" Jun 11 17:13:08.460146 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.460110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hgbjz_a09f2301-b847-4466-8afc-18da7b96fe21/manager/0.log" Jun 11 17:13:08.675429 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:08.675344 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bsvpl_28f4f56a-c6a2-4788-9278-c36329634e38/kuadrant-console-plugin/0.log" Jun 11 17:13:09.132735 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:09.132705 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zml45_8a540b2d-69ef-45c9-b021-9ce4fe4624a8/manager/0.log" Jun 11 17:13:09.494427 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:09.494351 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tlp2x_d6a8199b-f843-409e-bbeb-81eecaee6276/istio-proxy/0.log" Jun 11 17:13:10.088817 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:10.088785 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74fb4b67bf-txkdz_be962de3-8e94-4e1c-9e12-ec26d6be919a/router/0.log" Jun 11 17:13:15.323775 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.323646 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4w2bj/must-gather-725hn"] Jun 11 17:13:15.324337 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.324315 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" containerName="cleanup" Jun 11 17:13:15.324337 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.324340 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" containerName="cleanup" Jun 11 17:13:15.324522 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.324507 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" containerName="cleanup" Jun 11 17:13:15.324619 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.324529 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" containerName="cleanup" Jun 11 17:13:15.324712 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.324665 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" containerName="cleanup" Jun 11 17:13:15.324712 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.324710 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9765b601-8678-4d66-88d6-17554f00a1eb" containerName="cleanup" Jun 11 17:13:15.327988 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.327972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.330910 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.330890 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w2bj\"/\"kube-root-ca.crt\"" Jun 11 17:13:15.332191 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.332173 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4w2bj\"/\"default-dockercfg-f4ndb\"" Jun 11 17:13:15.332275 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.332188 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w2bj\"/\"openshift-service-ca.crt\"" Jun 11 17:13:15.343099 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.343071 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w2bj/must-gather-725hn"] Jun 11 17:13:15.415467 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.415426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0d70620-cad4-41fe-83c1-1e7e89b42b9e-must-gather-output\") pod \"must-gather-725hn\" (UID: \"c0d70620-cad4-41fe-83c1-1e7e89b42b9e\") " pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.415678 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.415496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lpft\" (UniqueName: \"kubernetes.io/projected/c0d70620-cad4-41fe-83c1-1e7e89b42b9e-kube-api-access-2lpft\") pod \"must-gather-725hn\" (UID: \"c0d70620-cad4-41fe-83c1-1e7e89b42b9e\") " pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.516171 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.516136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0d70620-cad4-41fe-83c1-1e7e89b42b9e-must-gather-output\") pod \"must-gather-725hn\" (UID: \"c0d70620-cad4-41fe-83c1-1e7e89b42b9e\") " pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.516352 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.516194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lpft\" (UniqueName: \"kubernetes.io/projected/c0d70620-cad4-41fe-83c1-1e7e89b42b9e-kube-api-access-2lpft\") pod \"must-gather-725hn\" (UID: \"c0d70620-cad4-41fe-83c1-1e7e89b42b9e\") " pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.516478 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.516459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0d70620-cad4-41fe-83c1-1e7e89b42b9e-must-gather-output\") pod \"must-gather-725hn\" (UID: \"c0d70620-cad4-41fe-83c1-1e7e89b42b9e\") " pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.524715 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.524683 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lpft\" (UniqueName: \"kubernetes.io/projected/c0d70620-cad4-41fe-83c1-1e7e89b42b9e-kube-api-access-2lpft\") pod \"must-gather-725hn\" (UID: \"c0d70620-cad4-41fe-83c1-1e7e89b42b9e\") " pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.637405 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.637318 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w2bj/must-gather-725hn" Jun 11 17:13:15.772529 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.772502 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w2bj/must-gather-725hn"] Jun 11 17:13:15.773971 ip-10-0-139-153 kubenswrapper[2563]: W0611 17:13:15.773941 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0d70620_cad4_41fe_83c1_1e7e89b42b9e.slice/crio-2f9b5402dd63d1f54912a5cbc97669c801078d37a2cecd237435a312c768e26a WatchSource:0}: Error finding container 2f9b5402dd63d1f54912a5cbc97669c801078d37a2cecd237435a312c768e26a: Status 404 returned error can't find the container with id 2f9b5402dd63d1f54912a5cbc97669c801078d37a2cecd237435a312c768e26a Jun 11 17:13:15.775804 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:15.775787 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:13:16.457839 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:16.457781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w2bj/must-gather-725hn" event={"ID":"c0d70620-cad4-41fe-83c1-1e7e89b42b9e","Type":"ContainerStarted","Data":"2f9b5402dd63d1f54912a5cbc97669c801078d37a2cecd237435a312c768e26a"} Jun 11 17:13:17.482834 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:17.482769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w2bj/must-gather-725hn" event={"ID":"c0d70620-cad4-41fe-83c1-1e7e89b42b9e","Type":"ContainerStarted","Data":"ca4b7f93e32eb1bc6150b70ed08c070f69513b0ba918f85159dfe26e0ad3e223"} Jun 11 17:13:17.483600 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:17.483549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w2bj/must-gather-725hn" event={"ID":"c0d70620-cad4-41fe-83c1-1e7e89b42b9e","Type":"ContainerStarted","Data":"0101e65835704d99c918b9c32fd037e2deeb3c1ce5838b7e46281eade888a0ab"} Jun 11 17:13:17.499779 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:17.499712 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4w2bj/must-gather-725hn" podStartSLOduration=1.47775284 podStartE2EDuration="2.499688662s" totalImagesPullingTime="1.021935822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:13:17.498822513 +0000 UTC m=+2064.099817270" watchObservedRunningTime="2026-06-11 17:13:17.499688662 +0000 UTC m=+2064.100683420" Jun 11 17:13:18.353893 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:18.353862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-58rw9_c7aea5eb-069b-4c6c-9d7e-8dd28a249c35/global-pull-secret-syncer/0.log" Jun 11 17:13:18.513595 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:18.513534 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tsm7v_c4251613-305b-4630-9ce2-ebb8da165130/konnectivity-agent/0.log" Jun 11 17:13:18.586338 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:18.586306 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-153.ec2.internal_1fd1671d92e37017c08f53f45fd2b754/haproxy/0.log" Jun 11 17:13:22.497451 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.497413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42_3ec17f95-3a2f-43d5-85ab-713d39931780/extract/0.log" Jun 11 17:13:22.526705 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.526674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42_3ec17f95-3a2f-43d5-85ab-713d39931780/util/0.log" Jun 11 17:13:22.543279 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.543246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s6m42_3ec17f95-3a2f-43d5-85ab-713d39931780/pull/0.log" Jun 11 17:13:22.568945 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.568897 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn_85f4995d-159d-4616-a799-b89ed67e3059/extract/0.log" Jun 11 17:13:22.599506 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.599472 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn_85f4995d-159d-4616-a799-b89ed67e3059/util/0.log" Jun 11 17:13:22.667014 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.666984 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e095wzn_85f4995d-159d-4616-a799-b89ed67e3059/pull/0.log" Jun 11 17:13:22.729040 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.724820 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v_1f46478a-c272-43df-b462-74538b8c662e/extract/0.log" Jun 11 17:13:22.741995 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.741896 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v_1f46478a-c272-43df-b462-74538b8c662e/util/0.log" Jun 11 17:13:22.771595 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.770791 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l6f9v_1f46478a-c272-43df-b462-74538b8c662e/pull/0.log" Jun 11 17:13:22.814604 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.814575 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn_d3e961c0-d07a-4e99-875e-2783076df758/extract/0.log" Jun 11 17:13:22.842999 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.842963 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn_d3e961c0-d07a-4e99-875e-2783076df758/util/0.log" Jun 11 17:13:22.860207 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:22.860171 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcfhn_d3e961c0-d07a-4e99-875e-2783076df758/pull/0.log" Jun 11 17:13:23.088394 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:23.088249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-556869f76-9rmwz_c77d588d-2e56-467d-bd22-440c402b3741/authorino/0.log" Jun 11 17:13:23.132583 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:23.132534 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hgbjz_a09f2301-b847-4466-8afc-18da7b96fe21/manager/0.log" Jun 11 17:13:23.242423 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:23.242384 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bsvpl_28f4f56a-c6a2-4788-9278-c36329634e38/kuadrant-console-plugin/0.log" Jun 11 17:13:23.566961 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:23.566924 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zml45_8a540b2d-69ef-45c9-b021-9ce4fe4624a8/manager/0.log" Jun 11 17:13:25.529365 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:25.529322 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-czml2_bff96e85-e3e3-4afc-af8b-283db4f74654/cluster-monitoring-operator/0.log" Jun 11 17:13:25.729675 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:25.729587 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-7vmpv_6bedfbdc-ca9b-4551-9c86-02b36aa4bacb/monitoring-plugin/0.log" Jun 11 17:13:25.803727 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:25.803691 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67wxg_7aab7579-3ee8-4779-812a-d6ce28489413/node-exporter/0.log" Jun 11 17:13:25.867450 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:25.867405 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67wxg_7aab7579-3ee8-4779-812a-d6ce28489413/kube-rbac-proxy/0.log" Jun 11 17:13:25.896712 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:25.896680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67wxg_7aab7579-3ee8-4779-812a-d6ce28489413/init-textfile/0.log" Jun 11 17:13:26.196431 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.196395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4dcdc_21c9348b-fcbc-429a-9377-46db78ca526f/kube-rbac-proxy-main/0.log" Jun 11 17:13:26.227395 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.227362 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4dcdc_21c9348b-fcbc-429a-9377-46db78ca526f/kube-rbac-proxy-self/0.log" Jun 11 17:13:26.247711 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.247679 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4dcdc_21c9348b-fcbc-429a-9377-46db78ca526f/openshift-state-metrics/0.log" Jun 11 17:13:26.691364 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.691225 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-dgcjq_c9da8a90-8f83-46c5-b97b-601fb60dbd83/prometheus-operator-admission-webhook/0.log" Jun 11 17:13:26.812912 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.812822 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/thanos-query/0.log" Jun 11 17:13:26.833296 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.833264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy-web/0.log" Jun 11 17:13:26.853043 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.853009 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy/0.log" Jun 11 17:13:26.873170 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.873137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/prom-label-proxy/0.log" Jun 11 17:13:26.892339 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.892302 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy-rules/0.log" Jun 11 17:13:26.911548 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:26.911507 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f4698498-j826g_8b60878c-06e1-4c17-a3e6-0487bf412c2d/kube-rbac-proxy-metrics/0.log" Jun 11 17:13:28.782945 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:28.782911 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/1.log" Jun 11 17:13:28.791078 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:28.791048 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-m4b6n_3ff6d341-6054-4478-a54e-e11705d7d80e/console-operator/2.log" Jun 11 17:13:29.322892 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.322863 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57f95876bb-2tbj7_1313ba1c-57cc-4cee-8bf6-3a3e6ee33967/console/0.log" Jun 11 17:13:29.354611 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.354580 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-nv9k6_cbbb80ec-a0a5-41f2-9d6e-58f0c10a731a/download-server/0.log" Jun 11 17:13:29.463326 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.463290 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj"] Jun 11 17:13:29.469431 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.469397 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.477296 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.477258 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj"] Jun 11 17:13:29.563310 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.563267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-lib-modules\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.563310 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.563313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-sys\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.563532 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.563359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-podres\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.563532 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.563420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-proc\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.563642 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.563531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mshpr\" (UniqueName: \"kubernetes.io/projected/390744d5-e4de-41f4-8696-2215c81c31a9-kube-api-access-mshpr\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664449 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshpr\" (UniqueName: \"kubernetes.io/projected/390744d5-e4de-41f4-8696-2215c81c31a9-kube-api-access-mshpr\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664449 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-lib-modules\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664717 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-sys\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664717 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-podres\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664717 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-proc\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664883 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664721 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-lib-modules\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664883 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664795 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-proc\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664883 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664829 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-sys\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.664999 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.664922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/390744d5-e4de-41f4-8696-2215c81c31a9-podres\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.672138 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.672105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mshpr\" (UniqueName: \"kubernetes.io/projected/390744d5-e4de-41f4-8696-2215c81c31a9-kube-api-access-mshpr\") pod \"perf-node-gather-daemonset-h7zwj\" (UID: \"390744d5-e4de-41f4-8696-2215c81c31a9\") " pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:29.795725 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:29.795638 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:30.015505 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:30.008843 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj"] Jun 11 17:13:30.018236 ip-10-0-139-153 kubenswrapper[2563]: W0611 17:13:30.018201 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod390744d5_e4de_41f4_8696_2215c81c31a9.slice/crio-98c83bfcc5df904e4cbf8c1205f3353f813580f98dbca6d4f6c729c2dea65526 WatchSource:0}: Error finding container 98c83bfcc5df904e4cbf8c1205f3353f813580f98dbca6d4f6c729c2dea65526: Status 404 returned error can't find the container with id 98c83bfcc5df904e4cbf8c1205f3353f813580f98dbca6d4f6c729c2dea65526 Jun 11 17:13:30.089522 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:30.089495 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-ch2j9_216e6bf6-c786-4975-8c52-b05af7f42ff3/volume-data-source-validator/0.log" Jun 11 17:13:30.596096 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:30.596055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" event={"ID":"390744d5-e4de-41f4-8696-2215c81c31a9","Type":"ContainerStarted","Data":"a911923ebe9147def203b6d7feeeb0d1c996b9dfd5626b6ef776b00ace772649"} Jun 11 17:13:30.596301 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:30.596121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" event={"ID":"390744d5-e4de-41f4-8696-2215c81c31a9","Type":"ContainerStarted","Data":"98c83bfcc5df904e4cbf8c1205f3353f813580f98dbca6d4f6c729c2dea65526"} Jun 11 17:13:30.596510 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:30.596483 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:30.612043 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:30.611991 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" podStartSLOduration=1.611974324 podStartE2EDuration="1.611974324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:13:30.610447414 +0000 UTC m=+2077.211442171" watchObservedRunningTime="2026-06-11 17:13:30.611974324 +0000 UTC m=+2077.212969108" Jun 11 17:13:31.286570 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:31.286535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbgfv_687074fa-ed83-4c4d-97ba-12c35360082f/dns/0.log" Jun 11 17:13:31.305096 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:31.305062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbgfv_687074fa-ed83-4c4d-97ba-12c35360082f/kube-rbac-proxy/0.log" Jun 11 17:13:31.324901 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:31.324876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5q98_560bde2b-8d7e-4033-b1ec-4b635da8dc3a/dns-node-resolver/0.log" Jun 11 17:13:31.972484 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:31.972445 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrnh6_264a2815-ab69-40c7-bf06-7df68cd63369/node-ca/0.log" Jun 11 17:13:32.850308 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:32.850271 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tlp2x_d6a8199b-f843-409e-bbeb-81eecaee6276/istio-proxy/0.log" Jun 11 17:13:33.187135 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:33.187062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74fb4b67bf-txkdz_be962de3-8e94-4e1c-9e12-ec26d6be919a/router/0.log" Jun 11 17:13:33.758683 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:33.758659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nx2m_b4b0558d-7453-4124-8799-4e62a4780501/serve-healthcheck-canary/0.log" Jun 11 17:13:34.319322 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:34.319287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pnzc6_71aec425-a97e-43a2-a8a1-018d659f1a5c/insights-operator/0.log" Jun 11 17:13:34.321934 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:34.321910 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pnzc6_71aec425-a97e-43a2-a8a1-018d659f1a5c/insights-operator/1.log" Jun 11 17:13:34.416207 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:34.416175 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvhh9_7d801cab-e9c2-4f5e-842e-042ab13068c6/kube-rbac-proxy/0.log" Jun 11 17:13:34.435296 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:34.435267 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvhh9_7d801cab-e9c2-4f5e-842e-042ab13068c6/exporter/0.log" Jun 11 17:13:34.457477 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:34.457427 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvhh9_7d801cab-e9c2-4f5e-842e-042ab13068c6/extractor/0.log" Jun 11 17:13:36.616322 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:36.616288 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4w2bj/perf-node-gather-daemonset-h7zwj" Jun 11 17:13:36.800975 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:36.800934 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cf9999c4-dkpcx_801ea96b-5e02-4a6e-ab07-d7a57ae9f3b7/manager/0.log" Jun 11 17:13:38.322703 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:38.322667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fdcd8fdb-l88w6_f110368b-d149-415b-93c9-95d8b608070f/manager/0.log" Jun 11 17:13:42.640929 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:42.640893 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tlp2x_d6a8199b-f843-409e-bbeb-81eecaee6276/istio-proxy/0.log" Jun 11 17:13:42.937078 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:42.936995 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74fb4b67bf-txkdz_be962de3-8e94-4e1c-9e12-ec26d6be919a/router/0.log" Jun 11 17:13:43.973190 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:43.973154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tlp2x_d6a8199b-f843-409e-bbeb-81eecaee6276/istio-proxy/0.log" Jun 11 17:13:44.272993 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:44.272896 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74fb4b67bf-txkdz_be962de3-8e94-4e1c-9e12-ec26d6be919a/router/0.log" Jun 11 17:13:45.175966 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.175940 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws9fh_c9bd5f50-097b-4bc7-8ffd-d316c446e37b/kube-multus-additional-cni-plugins/0.log" Jun 11 17:13:45.194449 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.194416 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws9fh_c9bd5f50-097b-4bc7-8ffd-d316c446e37b/egress-router-binary-copy/0.log" Jun 11 17:13:45.212207 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.212175 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws9fh_c9bd5f50-097b-4bc7-8ffd-d316c446e37b/cni-plugins/0.log" Jun 11 17:13:45.236638 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.236601 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws9fh_c9bd5f50-097b-4bc7-8ffd-d316c446e37b/bond-cni-plugin/0.log" Jun 11 17:13:45.255415 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.255385 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws9fh_c9bd5f50-097b-4bc7-8ffd-d316c446e37b/routeoverride-cni/0.log" Jun 11 17:13:45.273467 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.273441 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws9fh_c9bd5f50-097b-4bc7-8ffd-d316c446e37b/whereabouts-cni-bincopy/0.log" Jun 11 17:13:45.292308 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.292280 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws9fh_c9bd5f50-097b-4bc7-8ffd-d316c446e37b/whereabouts-cni/0.log" Jun 11 17:13:45.352158 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.352112 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tcwc7_fcd1775b-2f6e-42a9-aa73-1e99b6a6a7f7/kube-multus/0.log" Jun 11 17:13:45.466902 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.466811 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzjhm_30b97202-43bd-411e-b244-7f45861d6056/network-metrics-daemon/0.log" Jun 11 17:13:45.485723 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.485691 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzjhm_30b97202-43bd-411e-b244-7f45861d6056/kube-rbac-proxy/0.log" Jun 11 17:13:45.759509 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:45.759420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tlp2x_d6a8199b-f843-409e-bbeb-81eecaee6276/istio-proxy/0.log" Jun 11 17:13:46.047977 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.047952 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74fb4b67bf-txkdz_be962de3-8e94-4e1c-9e12-ec26d6be919a/router/0.log" Jun 11 17:13:46.873257 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.873226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-controller/0.log" Jun 11 17:13:46.891303 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.891264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/1.log" Jun 11 17:13:46.891303 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.891295 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovn-acl-logging/0.log" Jun 11 17:13:46.913201 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.913177 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/kube-rbac-proxy-node/0.log" Jun 11 17:13:46.935691 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.935655 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 17:13:46.952814 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.952784 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/northd/0.log" Jun 11 17:13:46.981245 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:46.981216 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/nbdb/0.log" Jun 11 17:13:47.002120 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:47.002093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/sbdb/0.log" Jun 11 17:13:47.057153 ip-10-0-139-153 kubenswrapper[2563]: I0611 17:13:47.057084 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rrggx_03728cf9-60c2-4c26-836d-95161beae495/ovnkube-controller/0.log"