Jun 08 18:05:28.916929 ip-10-0-132-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 18:05:28.916942 ip-10-0-132-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 18:05:28.916951 ip-10-0-132-8 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 18:05:28.917158 ip-10-0-132-8 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 18:05:38.988244 ip-10-0-132-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 18:05:38.988258 ip-10-0-132-8 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f1d949368a5245e083df09a19ed2bbc2 -- Jun 08 18:08:18.885159 ip-10-0-132-8 systemd[1]: Starting Kubernetes Kubelet... Jun 08 18:08:19.299128 ip-10-0-132-8 kubenswrapper[2531]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 18:08:19.299128 ip-10-0-132-8 kubenswrapper[2531]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 18:08:19.299128 ip-10-0-132-8 kubenswrapper[2531]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 18:08:19.299128 ip-10-0-132-8 kubenswrapper[2531]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 18:08:19.299128 ip-10-0-132-8 kubenswrapper[2531]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 18:08:19.301502 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.301439 2531 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 18:08:19.305749 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305735 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:08:19.305749 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305749 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305760 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305764 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305767 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305771 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305775 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305778 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305783 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305786 2531 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305789 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305791 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305794 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305797 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305799 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305804 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305807 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305810 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305813 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305816 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:08:19.305813 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305819 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305822 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305825 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305828 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305831 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305834 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305837 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305840 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305842 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305845 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305847 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305850 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305852 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305855 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305857 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305860 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305863 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305865 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305867 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305870 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:08:19.306289 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305873 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305876 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305878 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305880 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305883 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305897 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305900 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305903 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305905 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305908 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305911 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305921 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305924 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305926 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305929 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305932 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305935 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305938 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305940 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305944 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:08:19.306768 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305948 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305951 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305954 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305957 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305959 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305962 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305965 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305968 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305970 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305974 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305978 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305980 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305983 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305986 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305988 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305992 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305994 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305997 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.305999 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306002 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:08:19.307260 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306005 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306007 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306010 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306012 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306015 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306017 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306020 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306023 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306026 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306028 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306031 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306033 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306036 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306039 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306041 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306044 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306047 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306049 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.306052 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307601 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:08:19.307746 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307608 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307611 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307614 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307617 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307620 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307623 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307626 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307629 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307632 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307634 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307637 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307639 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307642 2531 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307645 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307647 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307650 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307652 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307655 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307659 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307662 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:08:19.308250 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307664 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307667 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307669 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307672 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307675 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307677 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307680 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307682 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307685 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307688 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307690 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307693 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307695 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307697 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307700 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307703 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307705 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307708 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307710 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307713 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:08:19.308775 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307716 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307718 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307720 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307723 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307726 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307730 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307733 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307735 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307738 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307740 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307744 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307747 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307750 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307753 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307755 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307758 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307760 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307763 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307766 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307768 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:08:19.309293 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307771 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307773 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307777 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307781 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307784 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307786 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307789 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307791 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307794 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307796 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307799 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307802 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307805 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307808 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307811 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307821 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307825 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307827 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307830 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:08:19.309790 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307833 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307838 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307841 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307845 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307848 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307851 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307854 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307857 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307860 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307862 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307865 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307867 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307870 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307873 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307875 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307878 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307881 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307883 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.307900 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:08:19.310275 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308235 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308239 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308242 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308245 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308248 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308251 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308254 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308257 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308260 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308263 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308265 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308268 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308270 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308273 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308275 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308278 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308281 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308284 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308287 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308290 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:08:19.310739 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308292 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308295 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308297 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308300 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308302 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308305 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308307 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308310 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308312 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308315 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308317 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308320 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308323 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308325 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308328 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308331 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308333 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308336 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308338 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308341 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:08:19.311236 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308344 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308346 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308348 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308351 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308354 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308359 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308362 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308365 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308368 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308371 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308375 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308378 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308380 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308383 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308385 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308388 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308391 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308393 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308396 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:08:19.311718 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308398 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308401 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308404 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308407 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308409 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308411 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308414 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308416 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308419 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308422 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308424 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308427 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308430 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308432 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308435 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308437 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308440 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308442 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308445 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308449 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:08:19.312227 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308452 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308455 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308459 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308462 2531 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308464 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308467 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308470 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308472 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308475 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308478 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308480 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308483 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308486 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308488 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308491 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308493 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308496 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308498 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308501 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.308503 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308572 2531 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 18:08:19.312713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308578 2531 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308584 2531 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308588 2531 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308592 2531 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308596 2531 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308599 2531 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308603 2531 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308606 2531 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308610 2531 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308613 2531 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308616 2531 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308619 2531 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308622 2531 flags.go:64] FLAG: --cgroup-root="" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308625 2531 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308628 2531 flags.go:64] FLAG: --client-ca-file="" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308631 2531 flags.go:64] FLAG: --cloud-provider="external" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308634 2531 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308638 2531 flags.go:64] FLAG: --cluster-domain="" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308641 2531 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308644 2531 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308647 2531 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308650 2531 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308653 2531 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 18:08:19.313242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308656 2531 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308659 2531 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308662 2531 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308665 2531 flags.go:64] FLAG: --contention-profiling="false" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308668 2531 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308671 2531 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308674 2531 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308676 2531 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308680 2531 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308683 2531 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308686 2531 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308689 2531 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308691 2531 flags.go:64] FLAG: --enable-server="true" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308694 2531 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308699 2531 flags.go:64] FLAG: --event-burst="100" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308702 2531 flags.go:64] FLAG: --event-qps="50" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308705 2531 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308707 2531 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308710 2531 flags.go:64] FLAG: --eviction-hard="" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308714 2531 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308716 2531 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308722 2531 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308725 2531 flags.go:64] FLAG: --eviction-soft="" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308728 2531 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308731 2531 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 18:08:19.313827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308734 2531 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308737 2531 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308740 2531 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308742 2531 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308745 2531 flags.go:64] FLAG: --feature-gates="" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308749 2531 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308752 2531 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308755 2531 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308758 2531 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308761 2531 flags.go:64] FLAG: --healthz-port="10248" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308763 2531 flags.go:64] FLAG: --help="false" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308766 2531 flags.go:64] FLAG: --hostname-override="ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308769 2531 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308772 2531 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308775 2531 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308779 2531 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308782 2531 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308785 2531 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308788 2531 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308791 2531 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308794 2531 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308797 2531 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308817 2531 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308821 2531 flags.go:64] FLAG: --kube-reserved="" Jun 08 18:08:19.314543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308826 2531 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308829 2531 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308833 2531 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308836 2531 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308840 2531 flags.go:64] FLAG: --lock-file="" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308843 2531 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308846 2531 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308849 2531 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308854 2531 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308857 2531 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308859 2531 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308862 2531 flags.go:64] FLAG: --logging-format="text" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308865 2531 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308868 2531 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308871 2531 flags.go:64] FLAG: --manifest-url="" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308874 2531 flags.go:64] FLAG: --manifest-url-header="" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308878 2531 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308880 2531 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308884 2531 flags.go:64] FLAG: --max-pods="110" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308904 2531 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308907 2531 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308910 2531 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308913 2531 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308916 2531 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308919 2531 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 18:08:19.315144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308922 2531 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308929 2531 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308932 2531 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308935 2531 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308938 2531 flags.go:64] FLAG: --pod-cidr="" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308941 2531 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308946 2531 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308951 2531 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308954 2531 flags.go:64] FLAG: --pods-per-core="0" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308957 2531 flags.go:64] FLAG: --port="10250" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308960 2531 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308962 2531 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09fb338406bf264ed" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308967 2531 flags.go:64] FLAG: --qos-reserved="" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308970 2531 flags.go:64] FLAG: --read-only-port="10255" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308973 2531 flags.go:64] FLAG: --register-node="true" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308976 2531 flags.go:64] FLAG: --register-with-taints="" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308980 2531 flags.go:64] FLAG: --registry-burst="10" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308983 2531 flags.go:64] FLAG: --registry-qps="5" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308986 2531 flags.go:64] FLAG: --reserved-cpus="" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308988 2531 flags.go:64] FLAG: --reserved-memory="" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308992 2531 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308995 2531 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.308998 2531 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309001 2531 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309003 2531 flags.go:64] FLAG: --runonce="false" Jun 08 18:08:19.315786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309006 2531 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309009 2531 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309012 2531 flags.go:64] FLAG: --seccomp-default="false" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309015 2531 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309018 2531 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309021 2531 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309024 2531 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309027 2531 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309029 2531 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309032 2531 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309035 2531 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309038 2531 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309041 2531 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309043 2531 flags.go:64] FLAG: --system-cgroups="" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309048 2531 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309053 2531 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309055 2531 flags.go:64] FLAG: --tls-cert-file="" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309058 2531 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309062 2531 flags.go:64] FLAG: --tls-min-version="" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309066 2531 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309068 2531 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309071 2531 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309074 2531 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309077 2531 flags.go:64] FLAG: --v="2" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309080 2531 flags.go:64] FLAG: --version="false" Jun 08 18:08:19.316447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309084 2531 flags.go:64] FLAG: --vmodule="" Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309087 2531 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.309091 2531 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309197 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309200 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309203 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309206 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309209 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309213 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309216 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309218 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309221 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309224 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309226 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309229 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309231 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309234 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309236 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309239 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309241 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:08:19.317214 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309244 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309249 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309252 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309255 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309257 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309260 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309263 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309266 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309269 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309271 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309274 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309277 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309279 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309282 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309284 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309287 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309290 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309293 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309295 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309298 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:08:19.318027 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309301 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309304 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309306 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309309 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309312 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309314 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309317 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309319 2531 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309322 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309324 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309327 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309330 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309332 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309337 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309341 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309345 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309348 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309350 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309354 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309357 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:08:19.318825 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309359 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309362 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309365 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309368 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309371 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309373 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309376 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309379 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309383 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309386 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309389 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309391 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309396 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309399 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309402 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309405 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309408 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309411 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309414 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:08:19.319394 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309416 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309419 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309422 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309425 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309428 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309430 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309434 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309437 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309439 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309442 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309444 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309449 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309451 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309454 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309456 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309459 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309461 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309464 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309467 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309469 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:08:19.319873 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309471 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309474 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.309477 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.310206 2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.319315 2531 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.319329 2531 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.320272 2531 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.320280 2531 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320350 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320355 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320358 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320362 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320364 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320367 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:08:19.320373 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320370 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320373 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320376 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320378 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320381 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320384 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320387 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320390 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320392 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320395 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320398 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320400 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320403 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320405 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320407 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320410 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320413 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320415 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320419 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:08:19.320720 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320423 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320426 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320429 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320432 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320435 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320439 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320442 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320445 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320448 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320451 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320454 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320457 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320459 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320462 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320465 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320469 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320471 2531 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320474 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320477 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:08:19.321195 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320480 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320483 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320485 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320488 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320491 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320493 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320496 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320499 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320501 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320504 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320506 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320509 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320511 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320514 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320516 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320519 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320521 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320524 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320526 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320529 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320531 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:08:19.321692 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320534 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320536 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320539 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320542 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320544 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320547 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320549 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320553 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320556 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320559 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320561 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320564 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320566 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320569 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320572 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320575 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320577 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320580 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320582 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320585 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:08:19.322210 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320588 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320591 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320595 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320597 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320600 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320602 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320605 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320608 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320610 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320613 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320615 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320618 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320620 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320623 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:08:19.322700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.320628 2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320749 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320755 2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320758 2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320761 2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320764 2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320767 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320770 2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320773 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320776 2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320779 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320781 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320784 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320787 2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320790 2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320792 2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320796 2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320800 2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320802 2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:08:19.323064 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320805 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320807 2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320810 2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320813 2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320815 2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320818 2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320820 2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320823 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320827 2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320830 2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320833 2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320836 2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320839 2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320842 2531 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320845 2531 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320848 2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320850 2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320853 2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320856 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:08:19.323525 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320859 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320862 2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320865 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320868 2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320870 2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320873 2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320877 2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320880 2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320883 2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320900 2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320903 2531 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320906 2531 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320908 2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320911 2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320913 2531 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320916 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320919 2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320921 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320924 2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:08:19.324087 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320926 2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320929 2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320931 2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320934 2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320937 2531 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320939 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320942 2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320944 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320947 2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320949 2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320952 2531 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320954 2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320957 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320960 2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320962 2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320965 2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320968 2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320970 2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320973 2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320975 2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:08:19.324540 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320978 2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320981 2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320984 2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320987 2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320989 2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320992 2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320994 2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.320997 2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321000 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321003 2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321005 2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321008 2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321010 2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321013 2531 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321015 2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321017 2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321020 2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321023 2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321025 2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321028 2531 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:08:19.325040 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321030 2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:08:19.325550 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321032 2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:08:19.325550 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:19.321035 2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:08:19.325550 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.321039 2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 18:08:19.325550 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.321130 2531 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 18:08:19.325550 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.325141 2531 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 18:08:19.326541 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.326529 2531 server.go:1019] "Starting client certificate rotation" Jun 08 18:08:19.326651 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.326633 2531 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 18:08:19.326700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.326673 2531 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 18:08:19.329376 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.329361 2531 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 18:08:19.330630 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.330601 2531 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 18:08:19.341447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.341434 2531 log.go:25] "Validated CRI v1 runtime API" Jun 08 18:08:19.344027 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.343933 2531 log.go:25] "Validated CRI v1 image API" Jun 08 18:08:19.344842 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.344826 2531 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 18:08:19.348051 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.348029 2531 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83cf041c-4a06-4f81-9c9b-6fa749e5336e:/dev/nvme0n1p4 cfb99a51-44c4-443e-8337-bf6f1e536c4e:/dev/nvme0n1p3] Jun 08 18:08:19.348112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.348051 2531 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 18:08:19.352422 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.352404 2531 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 18:08:19.353921 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.353805 2531 manager.go:216] Machine: {Timestamp:2026-06-08 18:08:19.353346899 +0000 UTC m=+0.352149887 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103441 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25c221ff5d03e7afadfa5d7edca669 SystemUUID:ec25c221-ff5d-03e7-afad-fa5d7edca669 BootID:f1d94936-8a52-45e0-83df-09a19ed2bbc2 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3a:bc:a2:9f:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3a:bc:a2:9f:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:69:25:72:dd:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 18:08:19.353921 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.353915 2531 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 18:08:19.354032 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.353976 2531 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 18:08:19.356878 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.356856 2531 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 18:08:19.357051 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.356880 2531 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 18:08:19.357688 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.357676 2531 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 18:08:19.357739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.357694 2531 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 18:08:19.357739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.357712 2531 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 18:08:19.358479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.358468 2531 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 18:08:19.359370 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.359359 2531 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 18:08:19.362443 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.362429 2531 state_mem.go:36] "Initialized new in-memory state store" Jun 08 18:08:19.362579 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.362567 2531 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 18:08:19.362635 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.362603 2531 kubelet.go:486] "Attempting to sync node with API server" Jun 08 18:08:19.362635 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.362622 2531 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 18:08:19.362719 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.362639 2531 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 18:08:19.362719 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.362652 2531 kubelet.go:398] "Adding apiserver pod source" Jun 08 18:08:19.362719 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.362667 2531 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 18:08:19.363346 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.363322 2531 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 18:08:19.363433 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.363359 2531 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 18:08:19.367185 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.367160 2531 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 18:08:19.369193 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369175 2531 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 18:08:19.369267 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369207 2531 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 18:08:19.369818 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369807 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 18:08:19.369860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369823 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 18:08:19.369860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369829 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 18:08:19.369860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369835 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 18:08:19.369860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369843 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 18:08:19.369860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.369848 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 18:08:19.370172 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.370158 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 18:08:19.370172 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.370168 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 18:08:19.370273 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.370176 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 18:08:19.370273 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.370181 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 18:08:19.370273 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.370189 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 18:08:19.370273 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.370197 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 18:08:19.371445 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.371426 2531 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 18:08:19.371571 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.371557 2531 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 18:08:19.372100 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.372088 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 18:08:19.372133 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.372102 2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 18:08:19.373516 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.373498 2531 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bfjnj" Jun 08 18:08:19.374009 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.373993 2531 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 18:08:19.374875 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.374865 2531 server.go:1268] "Started kubelet" Jun 08 18:08:19.375138 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.375081 2531 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 18:08:19.375235 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.375153 2531 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 18:08:19.375599 ip-10-0-132-8 systemd[1]: Started Kubernetes Kubelet. Jun 08 18:08:19.375948 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.375757 2531 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 18:08:19.377243 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.377229 2531 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 18:08:19.378741 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.378724 2531 server.go:310] "Adding debug handlers to kubelet server" Jun 08 18:08:19.380524 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.380509 2531 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bfjnj" Jun 08 18:08:19.384281 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.384247 2531 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 18:08:19.384870 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.384855 2531 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 18:08:19.384937 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.384859 2531 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 18:08:19.384985 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.384949 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:19.385538 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385520 2531 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 18:08:19.385628 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385539 2531 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 18:08:19.385628 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385554 2531 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 18:08:19.385738 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385671 2531 reconstruct.go:97] "Volume reconstruction finished" Jun 08 18:08:19.385738 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385679 2531 reconciler.go:29] "Reconciler: start to sync state" Jun 08 18:08:19.385861 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385833 2531 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 18:08:19.385861 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385858 2531 factory.go:55] Registering systemd factory Jun 08 18:08:19.386012 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.385870 2531 factory.go:223] Registration of the systemd container factory successfully Jun 08 18:08:19.386519 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.386504 2531 factory.go:153] Registering CRI-O factory Jun 08 18:08:19.386519 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.386521 2531 factory.go:223] Registration of the crio container factory successfully Jun 08 18:08:19.386648 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.386540 2531 factory.go:103] Registering Raw factory Jun 08 18:08:19.386648 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.386556 2531 manager.go:1196] Started watching for new ooms in manager Jun 08 18:08:19.387011 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.386991 2531 manager.go:349] Starting recovery of all containers Jun 08 18:08:19.389703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.389684 2531 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:08:19.392245 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.392225 2531 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-8.ec2.internal\" not found" node="ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.392813 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.392787 2531 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 18:08:19.400228 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.400209 2531 manager.go:354] Recovery completed Jun 08 18:08:19.404304 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.404291 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:08:19.406820 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.406803 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:08:19.406917 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.406830 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:08:19.406917 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.406843 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:08:19.407344 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.407331 2531 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 18:08:19.407386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.407345 2531 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 18:08:19.407386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.407365 2531 state_mem.go:36] "Initialized new in-memory state store" Jun 08 18:08:19.407386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.407347 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:08:19.408063 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.408048 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:08:19.408109 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.408080 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:08:19.408109 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.408095 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:08:19.408642 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.408630 2531 policy_none.go:49] "None policy: Start" Jun 08 18:08:19.408673 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.408647 2531 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 18:08:19.408704 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.408678 2531 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 18:08:19.409755 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.409744 2531 policy_none.go:47] "Start" Jun 08 18:08:19.450418 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.450404 2531 manager.go:337] "Starting Device Plugin manager" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.450431 2531 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.450439 2531 server.go:87] "Starting device plugin registration server" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.450653 2531 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.450665 2531 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.450773 2531 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.450851 2531 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.450864 2531 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.451543 2531 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.451590 2531 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.455690 2531 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.455722 2531 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.455738 2531 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 18:08:19.457542 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.455765 2531 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 18:08:19.457960 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.457653 2531 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:08:19.550934 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.550883 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:08:19.551668 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.551654 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:08:19.551730 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.551678 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:08:19.551730 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.551687 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:08:19.551730 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.551708 2531 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.556214 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.556199 2531 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal"] Jun 08 18:08:19.556285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.556251 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:08:19.556854 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.556841 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:08:19.556947 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.556868 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:08:19.556947 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.556882 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:08:19.558273 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.558258 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:08:19.558399 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.558375 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.558445 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.558407 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:08:19.558932 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.558915 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:08:19.559015 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.558938 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:08:19.559015 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.558949 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:08:19.559378 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.559364 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:08:19.559433 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.559393 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:08:19.559433 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.559430 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:08:19.559959 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.559944 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.560018 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.559968 2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:08:19.560368 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.560355 2531 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.560421 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.560376 2531 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-8.ec2.internal\": node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:19.560618 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.560601 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:08:19.560680 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.560630 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:08:19.560680 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.560643 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:08:19.573877 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.573859 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:19.576394 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.576379 2531 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-8.ec2.internal\" not found" node="ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.580753 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.580739 2531 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-8.ec2.internal\" not found" node="ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.585801 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.585787 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/643268d2da438a719d099cc2c90140a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal\" (UID: \"643268d2da438a719d099cc2c90140a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.585856 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.585808 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/643268d2da438a719d099cc2c90140a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal\" (UID: \"643268d2da438a719d099cc2c90140a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.585856 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.585824 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33ba0c26a87d56d7a7838510bc50fe62-config\") pod \"kube-apiserver-proxy-ip-10-0-132-8.ec2.internal\" (UID: \"33ba0c26a87d56d7a7838510bc50fe62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.674293 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.674277 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:19.686562 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.686543 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/643268d2da438a719d099cc2c90140a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal\" (UID: \"643268d2da438a719d099cc2c90140a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.686642 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.686551 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/643268d2da438a719d099cc2c90140a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal\" (UID: \"643268d2da438a719d099cc2c90140a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.686642 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.686586 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/643268d2da438a719d099cc2c90140a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal\" (UID: \"643268d2da438a719d099cc2c90140a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.686642 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.686614 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33ba0c26a87d56d7a7838510bc50fe62-config\") pod \"kube-apiserver-proxy-ip-10-0-132-8.ec2.internal\" (UID: \"33ba0c26a87d56d7a7838510bc50fe62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.686642 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.686634 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/643268d2da438a719d099cc2c90140a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal\" (UID: \"643268d2da438a719d099cc2c90140a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.686801 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.686693 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33ba0c26a87d56d7a7838510bc50fe62-config\") pod \"kube-apiserver-proxy-ip-10-0-132-8.ec2.internal\" (UID: \"33ba0c26a87d56d7a7838510bc50fe62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.774953 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.774934 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:19.875654 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.875584 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:19.880747 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.880730 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.884765 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:19.884631 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" Jun 08 18:08:19.976387 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:19.976359 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.076919 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.076884 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.177407 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.177352 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.277928 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.277885 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.303130 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:20.303105 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ba0c26a87d56d7a7838510bc50fe62.slice/crio-70f9b2d1fb1268c5ca4f066d1559f3a98237c8b1eec456baf2a16a49c9230cba WatchSource:0}: Error finding container 70f9b2d1fb1268c5ca4f066d1559f3a98237c8b1eec456baf2a16a49c9230cba: Status 404 returned error can't find the container with id 70f9b2d1fb1268c5ca4f066d1559f3a98237c8b1eec456baf2a16a49c9230cba Jun 08 18:08:20.303942 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:20.303921 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643268d2da438a719d099cc2c90140a9.slice/crio-b89a7915e0ef852aa436b98ce90da1a812ed550f8a680aa2e9cb9319bc883cbc WatchSource:0}: Error finding container b89a7915e0ef852aa436b98ce90da1a812ed550f8a680aa2e9cb9319bc883cbc: Status 404 returned error can't find the container with id b89a7915e0ef852aa436b98ce90da1a812ed550f8a680aa2e9cb9319bc883cbc Jun 08 18:08:20.309132 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.309117 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:08:20.326143 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.326122 2531 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 18:08:20.326224 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.326214 2531 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 18:08:20.326277 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.326255 2531 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 18:08:20.378374 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.378353 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.385017 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.384993 2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 18:03:19 +0000 UTC" deadline="2028-01-18 03:57:41.613944598 +0000 UTC" Jun 08 18:08:20.385017 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.385016 2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14121h49m21.228931737s" Jun 08 18:08:20.458547 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.458478 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" event={"ID":"643268d2da438a719d099cc2c90140a9","Type":"ContainerStarted","Data":"b89a7915e0ef852aa436b98ce90da1a812ed550f8a680aa2e9cb9319bc883cbc"} Jun 08 18:08:20.459551 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.459529 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" event={"ID":"33ba0c26a87d56d7a7838510bc50fe62","Type":"ContainerStarted","Data":"70f9b2d1fb1268c5ca4f066d1559f3a98237c8b1eec456baf2a16a49c9230cba"} Jun 08 18:08:20.478655 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.478636 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.579149 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.579125 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.679684 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.679652 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.693669 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.693647 2531 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:08:20.779839 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:20.779768 2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-8.ec2.internal\" not found" Jun 08 18:08:20.781229 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.781209 2531 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:08:20.786180 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.786158 2531 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" Jun 08 18:08:20.796338 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.796318 2531 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 18:08:20.797340 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.797321 2531 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" Jun 08 18:08:20.807011 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:20.806929 2531 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 18:08:21.363696 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.363664 2531 apiserver.go:52] "Watching apiserver" Jun 08 18:08:21.372531 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.372500 2531 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 18:08:21.372962 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.372933 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-dk4x4","openshift-multus/network-metrics-daemon-ctgvc","openshift-network-operator/iptables-alerter-lmplr","openshift-ovn-kubernetes/ovnkube-node-v54ns","kube-system/global-pull-secret-syncer-k8q9j","kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8mxxz","openshift-image-registry/node-ca-fw95n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal","openshift-network-diagnostics/network-check-target-njg9p","kube-system/konnectivity-agent-m2zxd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78","openshift-dns/node-resolver-tc8vp","openshift-multus/multus-additional-cni-plugins-qvhtc"] Jun 08 18:08:21.374417 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.374392 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.375566 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.375542 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.376609 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.376589 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.376728 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.376698 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-78knl\"" Jun 08 18:08:21.376794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.376755 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:08:21.376904 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.376867 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 18:08:21.377612 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.377583 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 18:08:21.377612 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.377607 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 18:08:21.377748 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.377700 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pj2bl\"" Jun 08 18:08:21.378338 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.378316 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.378632 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.378605 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:08:21.379319 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.379000 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 18:08:21.379319 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.379132 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 18:08:21.379319 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.379209 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lb2sz\"" Jun 08 18:08:21.379512 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.379434 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.379558 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.379508 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:21.380437 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.380419 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 18:08:21.380645 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.380630 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 18:08:21.380723 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.380649 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 18:08:21.381311 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.380875 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 18:08:21.381311 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.381062 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.381311 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.381083 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 18:08:21.381311 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.381099 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 18:08:21.381311 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.381107 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9qgvn\"" Jun 08 18:08:21.382529 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.382509 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.383658 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.383360 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 18:08:21.383658 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.383390 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 18:08:21.383658 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.383450 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qdlbd\"" Jun 08 18:08:21.383658 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.383560 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 18:08:21.383658 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.383588 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 18:08:21.383998 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.383982 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 18:08:21.384066 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.384058 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.384554 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.384536 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 18:08:21.384645 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.384536 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hqkpr\"" Jun 08 18:08:21.384723 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.384702 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 18:08:21.384834 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.384807 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 18:08:21.385467 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.385128 2531 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 18:08:21.385557 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.385497 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:21.385603 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.385568 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:21.386044 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.386024 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x4dxg\"" Jun 08 18:08:21.386128 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.386039 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 18:08:21.387169 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.387153 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:21.387244 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.387210 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:21.388558 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.388541 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.390148 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.390133 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.390828 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.390606 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 18:08:21.390828 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.390728 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tk8z2\"" Jun 08 18:08:21.390963 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.390918 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 18:08:21.392423 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.392405 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 18:08:21.392623 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.392602 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.393170 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lw687\"" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.393184 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394515 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-cni-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394556 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-cni-bin\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394584 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk6f7\" (UniqueName: \"kubernetes.io/projected/918fabd2-131a-4c30-a0be-23ed41a28250-kube-api-access-bk6f7\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394614 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysctl-d\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394647 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-host\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394685 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-cni-binary-copy\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394715 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-cni-multus\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394742 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9a78d84-1392-4435-8891-c0cf1da0bcbc-tmp-dir\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394775 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-system-cni-dir\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394811 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cnibin\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394843 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394877 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-kubelet\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394924 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-var-lib-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394953 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-etc-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.395406 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.394989 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395026 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-ovn\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395081 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-tmp\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395111 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vphng\" (UniqueName: \"kubernetes.io/projected/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-kube-api-access-vphng\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395145 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395177 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9a78d84-1392-4435-8891-c0cf1da0bcbc-hosts-file\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395205 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-slash\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395239 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395262 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysctl-conf\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395295 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-daemon-config\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395314 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-etc-kubernetes\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395343 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-netns\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395372 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395871 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt2hc\" (UniqueName: \"kubernetes.io/projected/b19a021f-4a9c-4916-89c4-de834fc39272-kube-api-access-vt2hc\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.395937 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/918fabd2-131a-4c30-a0be-23ed41a28250-host\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396021 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:21.396361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396055 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-multus-certs\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396086 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb2ln\" (UniqueName: \"kubernetes.io/projected/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-kube-api-access-xb2ln\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396115 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27296c21-bf10-4c2f-9e4c-911663217049-iptables-alerter-script\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396143 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-systemd\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396198 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-run-ovn-kubernetes\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396232 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysconfig\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396286 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mxrs\" (UniqueName: \"kubernetes.io/projected/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-kube-api-access-9mxrs\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396340 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhlsf\" (UniqueName: \"kubernetes.io/projected/27296c21-bf10-4c2f-9e4c-911663217049-kube-api-access-dhlsf\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396380 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-run\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396475 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f922831-b683-4553-becb-f80585a93c86-kubelet-config\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396518 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396596 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-log-socket\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396630 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-cni-netd\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396675 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-ovnkube-config\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396724 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-ovnkube-script-lib\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.396822 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/918fabd2-131a-4c30-a0be-23ed41a28250-serviceca\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397285 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-kubernetes\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397321 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-os-release\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397349 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvv9\" (UniqueName: \"kubernetes.io/projected/c9a78d84-1392-4435-8891-c0cf1da0bcbc-kube-api-access-bzvv9\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397372 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-node-log\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397414 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-env-overrides\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397436 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-849wp\" (UniqueName: \"kubernetes.io/projected/14579ca1-7421-48ac-9bb5-400c85bd214a-kube-api-access-849wp\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397472 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-sys\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397512 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-socket-dir-parent\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397555 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-k8s-cni-cncf-io\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397580 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-conf-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397604 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27296c21-bf10-4c2f-9e4c-911663217049-host-slash\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397625 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-var-lib-kubelet\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397646 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-tuned\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397675 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-system-cni-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397708 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-kubelet\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397748 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-systemd-units\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.397794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397785 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-run-netns\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397809 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14579ca1-7421-48ac-9bb5-400c85bd214a-ovn-node-metrics-cert\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397833 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-os-release\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397854 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397879 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-cnibin\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397915 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-modprobe-d\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397936 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-lib-modules\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397956 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f922831-b683-4553-becb-f80585a93c86-dbus\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.397977 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-hostroot\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.398011 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.398031 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-cni-bin\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.398780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.398065 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-systemd\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.399354 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.399051 2531 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 18:08:21.419175 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.419137 2531 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8zcc2" Jun 08 18:08:21.427767 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.427746 2531 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8zcc2" Jun 08 18:08:21.467503 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.467483 2531 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:08:21.486696 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.486675 2531 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 18:08:21.498931 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.498911 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-multus-certs\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.499025 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.498938 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2ln\" (UniqueName: \"kubernetes.io/projected/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-kube-api-access-xb2ln\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.499025 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.498960 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27296c21-bf10-4c2f-9e4c-911663217049-iptables-alerter-script\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.499025 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.498984 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-systemd\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499025 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499001 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-run-ovn-kubernetes\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499225 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499037 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-systemd\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499225 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499033 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-multus-certs\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.499225 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499135 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysconfig\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.499225 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499165 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mxrs\" (UniqueName: \"kubernetes.io/projected/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-kube-api-access-9mxrs\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.499225 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499167 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-run-ovn-kubernetes\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499225 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499191 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.499225 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499225 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysconfig\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499236 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhlsf\" (UniqueName: \"kubernetes.io/projected/27296c21-bf10-4c2f-9e4c-911663217049-kube-api-access-dhlsf\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499261 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-run\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499287 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f922831-b683-4553-becb-f80585a93c86-kubelet-config\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499330 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499343 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f922831-b683-4553-becb-f80585a93c86-kubelet-config\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499376 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-etc-selinux\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499403 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-log-socket\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.499434 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499450 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-log-socket\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499457 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-run\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499494 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-cni-netd\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499533 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-cni-netd\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.499567 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.499544 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret podName:7f922831-b683-4553-becb-f80585a93c86 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:21.999491478 +0000 UTC m=+2.998294470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret") pod "global-pull-secret-syncer-k8q9j" (UID: "7f922831-b683-4553-becb-f80585a93c86") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499581 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-ovnkube-config\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499598 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27296c21-bf10-4c2f-9e4c-911663217049-iptables-alerter-script\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499618 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-ovnkube-script-lib\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499644 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/918fabd2-131a-4c30-a0be-23ed41a28250-serviceca\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499683 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-kubernetes\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499720 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-os-release\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499744 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvv9\" (UniqueName: \"kubernetes.io/projected/c9a78d84-1392-4435-8891-c0cf1da0bcbc-kube-api-access-bzvv9\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499767 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-kubernetes\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499767 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-node-log\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499816 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-env-overrides\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499842 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-849wp\" (UniqueName: \"kubernetes.io/projected/14579ca1-7421-48ac-9bb5-400c85bd214a-kube-api-access-849wp\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499848 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-node-log\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499866 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-sys\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499818 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-os-release\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499921 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-socket-dir-parent\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499975 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-k8s-cni-cncf-io\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.499999 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-conf-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.500195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500024 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27296c21-bf10-4c2f-9e4c-911663217049-host-slash\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500033 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-sys\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500050 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-var-lib-kubelet\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500082 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-k8s-cni-cncf-io\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500075 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-tuned\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500125 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-sys-fs\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500138 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27296c21-bf10-4c2f-9e4c-911663217049-host-slash\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500152 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-system-cni-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500159 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-ovnkube-config\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500186 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-conf-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500178 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-kubelet\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500221 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-systemd-units\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500237 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-system-cni-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500236 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-socket-dir-parent\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500245 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-run-netns\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500281 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-var-lib-kubelet\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500290 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-kubelet\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500283 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14579ca1-7421-48ac-9bb5-400c85bd214a-ovn-node-metrics-cert\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501056 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500327 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-os-release\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500337 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-systemd-units\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500354 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500342 2531 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500386 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-registration-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500394 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-os-release\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500412 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-cnibin\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500436 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-modprobe-d\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500467 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-lib-modules\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500490 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f922831-b683-4553-becb-f80585a93c86-dbus\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500515 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a37c70e-2811-469f-94d5-5ce997c8885e-agent-certs\") pod \"konnectivity-agent-m2zxd\" (UID: \"4a37c70e-2811-469f-94d5-5ce997c8885e\") " pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500539 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-hostroot\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500582 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/918fabd2-131a-4c30-a0be-23ed41a28250-serviceca\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500583 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500626 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500631 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-cni-bin\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500664 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-systemd\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500710 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a37c70e-2811-469f-94d5-5ce997c8885e-konnectivity-ca\") pod \"konnectivity-agent-m2zxd\" (UID: \"4a37c70e-2811-469f-94d5-5ce997c8885e\") " pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.501881 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500739 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-cni-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500745 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-modprobe-d\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500767 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-cni-bin\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500817 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-run-netns\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500827 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-systemd\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500835 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500842 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-env-overrides\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500824 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-lib-modules\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500856 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14579ca1-7421-48ac-9bb5-400c85bd214a-ovnkube-script-lib\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500865 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk6f7\" (UniqueName: \"kubernetes.io/projected/918fabd2-131a-4c30-a0be-23ed41a28250-kube-api-access-bk6f7\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500906 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-cni-bin\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500924 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-hostroot\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500930 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-cni-bin\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500956 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f922831-b683-4553-becb-f80585a93c86-dbus\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500961 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-cnibin\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.500989 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-cni-dir\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501022 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysctl-d\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501045 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-host\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.502729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501081 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-cni-binary-copy\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501122 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-cni-multus\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501148 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9a78d84-1392-4435-8891-c0cf1da0bcbc-tmp-dir\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501163 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysctl-d\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501203 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-system-cni-dir\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501212 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-host\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501215 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-cni-multus\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501227 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cnibin\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501252 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501266 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-system-cni-dir\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501276 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-kubelet\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501303 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-var-lib-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501312 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cnibin\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501328 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-etc-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501354 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501377 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-var-lib-kubelet\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501381 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-device-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.503637 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501404 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-ovn\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501423 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-etc-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501427 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-tmp\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501451 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vphng\" (UniqueName: \"kubernetes.io/projected/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-kube-api-access-vphng\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501464 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-var-lib-openvswitch\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501476 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501486 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9a78d84-1392-4435-8891-c0cf1da0bcbc-tmp-dir\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501503 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9a78d84-1392-4435-8891-c0cf1da0bcbc-hosts-file\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501531 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-slash\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501556 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501581 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysctl-conf\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501593 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-cni-binary-copy\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501605 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hlq6\" (UniqueName: \"kubernetes.io/projected/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-kube-api-access-9hlq6\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501643 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-slash\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501643 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-daemon-config\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501666 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501698 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-etc-kubernetes\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.504381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501725 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-socket-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501743 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501750 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-netns\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501774 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501781 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-sysctl-conf\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501794 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-etc-kubernetes\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501798 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt2hc\" (UniqueName: \"kubernetes.io/projected/b19a021f-4a9c-4916-89c4-de834fc39272-kube-api-access-vt2hc\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501843 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9a78d84-1392-4435-8891-c0cf1da0bcbc-hosts-file\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501507 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14579ca1-7421-48ac-9bb5-400c85bd214a-run-ovn\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501874 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/918fabd2-131a-4c30-a0be-23ed41a28250-host\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.501947 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-host-run-netns\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.502007 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.502014 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.502057 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:22.00204122 +0000 UTC m=+3.000844191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.502073 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/918fabd2-131a-4c30-a0be-23ed41a28250-host\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.502081 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.502110 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-multus-daemon-config\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.505059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.502522 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.505609 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.504462 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-tmp\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.505609 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.504553 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-etc-tuned\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.505609 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.504619 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14579ca1-7421-48ac-9bb5-400c85bd214a-ovn-node-metrics-cert\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.510426 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.510401 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:08:21.510426 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.510427 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:08:21.510574 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.510441 2531 projected.go:196] Error preparing data for projected volume kube-api-access-rg8hg for pod openshift-network-diagnostics/network-check-target-njg9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:21.510574 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:21.510489 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg podName:4b11cfac-d0b9-4f60-9b27-66a12310147c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:22.010472863 +0000 UTC m=+3.009275849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rg8hg" (UniqueName: "kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg") pod "network-check-target-njg9p" (UID: "4b11cfac-d0b9-4f60-9b27-66a12310147c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:21.510699 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.510685 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mxrs\" (UniqueName: \"kubernetes.io/projected/0f2532f5-e06b-4a0b-84d8-ac54315c3a1b-kube-api-access-9mxrs\") pod \"multus-additional-cni-plugins-qvhtc\" (UID: \"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b\") " pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.510876 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.510835 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvv9\" (UniqueName: \"kubernetes.io/projected/c9a78d84-1392-4435-8891-c0cf1da0bcbc-kube-api-access-bzvv9\") pod \"node-resolver-tc8vp\" (UID: \"c9a78d84-1392-4435-8891-c0cf1da0bcbc\") " pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.510972 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.510922 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2ln\" (UniqueName: \"kubernetes.io/projected/f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f-kube-api-access-xb2ln\") pod \"multus-dk4x4\" (UID: \"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f\") " pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.511215 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.511195 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhlsf\" (UniqueName: \"kubernetes.io/projected/27296c21-bf10-4c2f-9e4c-911663217049-kube-api-access-dhlsf\") pod \"iptables-alerter-lmplr\" (UID: \"27296c21-bf10-4c2f-9e4c-911663217049\") " pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.512457 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.512434 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-849wp\" (UniqueName: \"kubernetes.io/projected/14579ca1-7421-48ac-9bb5-400c85bd214a-kube-api-access-849wp\") pod \"ovnkube-node-v54ns\" (UID: \"14579ca1-7421-48ac-9bb5-400c85bd214a\") " pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.513120 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.513100 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk6f7\" (UniqueName: \"kubernetes.io/projected/918fabd2-131a-4c30-a0be-23ed41a28250-kube-api-access-bk6f7\") pod \"node-ca-fw95n\" (UID: \"918fabd2-131a-4c30-a0be-23ed41a28250\") " pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.513208 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.513176 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vphng\" (UniqueName: \"kubernetes.io/projected/8e3411aa-16d5-4c3a-add6-fc7b16514f1b-kube-api-access-vphng\") pod \"tuned-8mxxz\" (UID: \"8e3411aa-16d5-4c3a-add6-fc7b16514f1b\") " pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.513279 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.513260 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt2hc\" (UniqueName: \"kubernetes.io/projected/b19a021f-4a9c-4916-89c4-de834fc39272-kube-api-access-vt2hc\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:21.603064 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603036 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603083 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-etc-selinux\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603116 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-sys-fs\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603132 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603142 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-registration-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603182 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-registration-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603190 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a37c70e-2811-469f-94d5-5ce997c8885e-agent-certs\") pod \"konnectivity-agent-m2zxd\" (UID: \"4a37c70e-2811-469f-94d5-5ce997c8885e\") " pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603217 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a37c70e-2811-469f-94d5-5ce997c8885e-konnectivity-ca\") pod \"konnectivity-agent-m2zxd\" (UID: \"4a37c70e-2811-469f-94d5-5ce997c8885e\") " pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603247 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-device-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603247 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-etc-selinux\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603276 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hlq6\" (UniqueName: \"kubernetes.io/projected/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-kube-api-access-9hlq6\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603294 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-socket-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603304 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-device-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603251 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-sys-fs\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603450 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-socket-dir\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.603830 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.603776 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a37c70e-2811-469f-94d5-5ce997c8885e-konnectivity-ca\") pod \"konnectivity-agent-m2zxd\" (UID: \"4a37c70e-2811-469f-94d5-5ce997c8885e\") " pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.605726 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.605706 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a37c70e-2811-469f-94d5-5ce997c8885e-agent-certs\") pod \"konnectivity-agent-m2zxd\" (UID: \"4a37c70e-2811-469f-94d5-5ce997c8885e\") " pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.611652 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.611622 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hlq6\" (UniqueName: \"kubernetes.io/projected/d7ae2003-0e30-4e2a-b097-c101ed08bbdb-kube-api-access-9hlq6\") pod \"aws-ebs-csi-driver-node-6lk78\" (UID: \"d7ae2003-0e30-4e2a-b097-c101ed08bbdb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.687490 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.687433 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" Jun 08 18:08:21.694961 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.694939 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc8vp" Jun 08 18:08:21.704445 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.704426 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmplr" Jun 08 18:08:21.710090 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.710070 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:21.715798 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.715767 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" Jun 08 18:08:21.722405 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.722387 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fw95n" Jun 08 18:08:21.727930 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.727909 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dk4x4" Jun 08 18:08:21.733336 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.733321 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:21.737903 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.737875 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" Jun 08 18:08:21.772158 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:21.772134 2531 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:08:22.006707 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.006642 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:22.006707 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.006695 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:22.006928 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.006801 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:22.006928 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.006859 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:23.006844891 +0000 UTC m=+4.005647875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:22.006928 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.006801 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:22.006928 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.006914 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret podName:7f922831-b683-4553-becb-f80585a93c86 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:23.006903701 +0000 UTC m=+4.005706671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret") pod "global-pull-secret-syncer-k8q9j" (UID: "7f922831-b683-4553-becb-f80585a93c86") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:22.093431 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.093407 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4305c9c_ac5e_4c4a_b86e_b0af5e5d884f.slice/crio-0cdcfc7c5978993cf5d2e3805d12ef331dc5d8a4531ac56214dc653d443f560d WatchSource:0}: Error finding container 0cdcfc7c5978993cf5d2e3805d12ef331dc5d8a4531ac56214dc653d443f560d: Status 404 returned error can't find the container with id 0cdcfc7c5978993cf5d2e3805d12ef331dc5d8a4531ac56214dc653d443f560d Jun 08 18:08:22.097306 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.097277 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a78d84_1392_4435_8891_c0cf1da0bcbc.slice/crio-4c8b8efdd7c0ca3428b30bb489f3a48643b4a2a3af89888c5bda0dcb78e914c1 WatchSource:0}: Error finding container 4c8b8efdd7c0ca3428b30bb489f3a48643b4a2a3af89888c5bda0dcb78e914c1: Status 404 returned error can't find the container with id 4c8b8efdd7c0ca3428b30bb489f3a48643b4a2a3af89888c5bda0dcb78e914c1 Jun 08 18:08:22.098948 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.098801 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918fabd2_131a_4c30_a0be_23ed41a28250.slice/crio-eada9ee7821b5eb5d6e85a925f7ba6f44b508ecb59ec7ccf853aa396656aa078 WatchSource:0}: Error finding container eada9ee7821b5eb5d6e85a925f7ba6f44b508ecb59ec7ccf853aa396656aa078: Status 404 returned error can't find the container with id eada9ee7821b5eb5d6e85a925f7ba6f44b508ecb59ec7ccf853aa396656aa078 Jun 08 18:08:22.099321 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.099296 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2532f5_e06b_4a0b_84d8_ac54315c3a1b.slice/crio-a040c2e6af52364e11cebf24debf42ee66c828e9c3e4362f78f95a606cfec87a WatchSource:0}: Error finding container a040c2e6af52364e11cebf24debf42ee66c828e9c3e4362f78f95a606cfec87a: Status 404 returned error can't find the container with id a040c2e6af52364e11cebf24debf42ee66c828e9c3e4362f78f95a606cfec87a Jun 08 18:08:22.101295 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.100948 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14579ca1_7421_48ac_9bb5_400c85bd214a.slice/crio-e5ff5c681ea9d7fdbc06e15f66e956c555511e6bfc390f7276c9c01028fa833e WatchSource:0}: Error finding container e5ff5c681ea9d7fdbc06e15f66e956c555511e6bfc390f7276c9c01028fa833e: Status 404 returned error can't find the container with id e5ff5c681ea9d7fdbc06e15f66e956c555511e6bfc390f7276c9c01028fa833e Jun 08 18:08:22.101837 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.101754 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ae2003_0e30_4e2a_b097_c101ed08bbdb.slice/crio-03521de16cfa48b80872f7d0e630df59b682a1cca50e58d61aa42543e306cb69 WatchSource:0}: Error finding container 03521de16cfa48b80872f7d0e630df59b682a1cca50e58d61aa42543e306cb69: Status 404 returned error can't find the container with id 03521de16cfa48b80872f7d0e630df59b682a1cca50e58d61aa42543e306cb69 Jun 08 18:08:22.102551 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.102504 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27296c21_bf10_4c2f_9e4c_911663217049.slice/crio-74787764a39d6fb271121bc1b759ead43cae38a9ef8c673bed958fda49fc896e WatchSource:0}: Error finding container 74787764a39d6fb271121bc1b759ead43cae38a9ef8c673bed958fda49fc896e: Status 404 returned error can't find the container with id 74787764a39d6fb271121bc1b759ead43cae38a9ef8c673bed958fda49fc896e Jun 08 18:08:22.103733 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:22.103624 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3411aa_16d5_4c3a_add6_fc7b16514f1b.slice/crio-b206ded002393610e04225f30bf677277451589822ae23e3e39028c99419f9e7 WatchSource:0}: Error finding container b206ded002393610e04225f30bf677277451589822ae23e3e39028c99419f9e7: Status 404 returned error can't find the container with id b206ded002393610e04225f30bf677277451589822ae23e3e39028c99419f9e7 Jun 08 18:08:22.107617 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.107441 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:22.107617 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.107540 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:08:22.107617 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.107551 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:08:22.107617 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.107560 2531 projected.go:196] Error preparing data for projected volume kube-api-access-rg8hg for pod openshift-network-diagnostics/network-check-target-njg9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:22.107617 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:22.107601 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg podName:4b11cfac-d0b9-4f60-9b27-66a12310147c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:23.107588787 +0000 UTC m=+4.106391758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg8hg" (UniqueName: "kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg") pod "network-check-target-njg9p" (UID: "4b11cfac-d0b9-4f60-9b27-66a12310147c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:22.430077 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.430035 2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 18:03:21 +0000 UTC" deadline="2027-11-04 06:57:30.919183407 +0000 UTC" Jun 08 18:08:22.430077 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.430069 2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12324h49m8.489119164s" Jun 08 18:08:22.464539 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.464445 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" event={"ID":"8e3411aa-16d5-4c3a-add6-fc7b16514f1b","Type":"ContainerStarted","Data":"b206ded002393610e04225f30bf677277451589822ae23e3e39028c99419f9e7"} Jun 08 18:08:22.467466 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.467440 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmplr" event={"ID":"27296c21-bf10-4c2f-9e4c-911663217049","Type":"ContainerStarted","Data":"74787764a39d6fb271121bc1b759ead43cae38a9ef8c673bed958fda49fc896e"} Jun 08 18:08:22.470220 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.470189 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerStarted","Data":"a040c2e6af52364e11cebf24debf42ee66c828e9c3e4362f78f95a606cfec87a"} Jun 08 18:08:22.472078 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.472054 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fw95n" event={"ID":"918fabd2-131a-4c30-a0be-23ed41a28250","Type":"ContainerStarted","Data":"eada9ee7821b5eb5d6e85a925f7ba6f44b508ecb59ec7ccf853aa396656aa078"} Jun 08 18:08:22.474108 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.474084 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc8vp" event={"ID":"c9a78d84-1392-4435-8891-c0cf1da0bcbc","Type":"ContainerStarted","Data":"4c8b8efdd7c0ca3428b30bb489f3a48643b4a2a3af89888c5bda0dcb78e914c1"} Jun 08 18:08:22.478511 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.478482 2531 generic.go:356] "Generic (PLEG): container finished" podID="643268d2da438a719d099cc2c90140a9" containerID="aabac1f66eaed463e8f33c43484406c4110bfaf962061bec76000e71880ab55b" exitCode=0 Jun 08 18:08:22.478603 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.478557 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" event={"ID":"643268d2da438a719d099cc2c90140a9","Type":"ContainerDied","Data":"aabac1f66eaed463e8f33c43484406c4110bfaf962061bec76000e71880ab55b"} Jun 08 18:08:22.482364 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.481807 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" event={"ID":"33ba0c26a87d56d7a7838510bc50fe62","Type":"ContainerStarted","Data":"b3ef9a8874432c1fd6a258275b0c2431f3d12eaf76e6b135a61590bfeb6b173d"} Jun 08 18:08:22.489425 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.488656 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" event={"ID":"d7ae2003-0e30-4e2a-b097-c101ed08bbdb","Type":"ContainerStarted","Data":"03521de16cfa48b80872f7d0e630df59b682a1cca50e58d61aa42543e306cb69"} Jun 08 18:08:22.498929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.494319 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"e5ff5c681ea9d7fdbc06e15f66e956c555511e6bfc390f7276c9c01028fa833e"} Jun 08 18:08:22.498929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.498351 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dk4x4" event={"ID":"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f","Type":"ContainerStarted","Data":"0cdcfc7c5978993cf5d2e3805d12ef331dc5d8a4531ac56214dc653d443f560d"} Jun 08 18:08:22.502557 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:22.501416 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m2zxd" event={"ID":"4a37c70e-2811-469f-94d5-5ce997c8885e","Type":"ContainerStarted","Data":"eb46618acb57641fbe2c57d7922c4b5dd3bea89324657d924bffdd8fb42a8d8a"} Jun 08 18:08:23.015226 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.014880 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:23.015226 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.014979 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:23.015226 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.015018 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:23.015226 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.015089 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:23.015226 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.015094 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret podName:7f922831-b683-4553-becb-f80585a93c86 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:25.015071927 +0000 UTC m=+6.013874912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret") pod "global-pull-secret-syncer-k8q9j" (UID: "7f922831-b683-4553-becb-f80585a93c86") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:23.015226 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.015149 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:25.015134346 +0000 UTC m=+6.013937323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:23.115981 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.115940 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:23.116153 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.116125 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:08:23.116153 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.116144 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:08:23.116260 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.116158 2531 projected.go:196] Error preparing data for projected volume kube-api-access-rg8hg for pod openshift-network-diagnostics/network-check-target-njg9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:23.116260 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.116217 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg podName:4b11cfac-d0b9-4f60-9b27-66a12310147c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:25.116199613 +0000 UTC m=+6.115002587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg8hg" (UniqueName: "kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg") pod "network-check-target-njg9p" (UID: "4b11cfac-d0b9-4f60-9b27-66a12310147c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:23.430689 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.430578 2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 18:03:21 +0000 UTC" deadline="2028-02-08 07:51:06.133632716 +0000 UTC" Jun 08 18:08:23.430689 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.430641 2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14629h42m42.702995989s" Jun 08 18:08:23.457030 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.457006 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:23.457166 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.457124 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:23.457527 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.457508 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:23.457619 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.457601 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:23.457691 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.457678 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:23.457784 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:23.457766 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:23.524389 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.524356 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" event={"ID":"643268d2da438a719d099cc2c90140a9","Type":"ContainerStarted","Data":"7e565d30e7350b0ab7a67bea205f220ac82a123a2b4e42ec410d45a9d496acc4"} Jun 08 18:08:23.541283 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:23.541179 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-8.ec2.internal" podStartSLOduration=3.54116072 podStartE2EDuration="3.54116072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:22.510199657 +0000 UTC m=+3.509002652" watchObservedRunningTime="2026-06-08 18:08:23.54116072 +0000 UTC m=+4.539963715" Jun 08 18:08:25.031739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:25.031028 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:25.031739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:25.031098 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:25.031739 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.031256 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:25.031739 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.031316 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret podName:7f922831-b683-4553-becb-f80585a93c86 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.03129779 +0000 UTC m=+10.030100772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret") pod "global-pull-secret-syncer-k8q9j" (UID: "7f922831-b683-4553-becb-f80585a93c86") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:25.031739 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.031386 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:25.031739 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.031423 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.031410628 +0000 UTC m=+10.030213614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:25.132589 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:25.132050 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:25.132589 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.132192 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:08:25.132589 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.132213 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:08:25.132589 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.132226 2531 projected.go:196] Error preparing data for projected volume kube-api-access-rg8hg for pod openshift-network-diagnostics/network-check-target-njg9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:25.132589 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.132279 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg podName:4b11cfac-d0b9-4f60-9b27-66a12310147c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.132261112 +0000 UTC m=+10.131064097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg8hg" (UniqueName: "kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg") pod "network-check-target-njg9p" (UID: "4b11cfac-d0b9-4f60-9b27-66a12310147c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:25.456873 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:25.456655 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:25.456873 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.456805 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:25.456873 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:25.456855 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:25.457142 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.456965 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:25.457142 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:25.457011 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:25.457142 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:25.457075 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:27.456300 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:27.456265 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:27.456300 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:27.456291 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:27.456786 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:27.456389 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:27.456786 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:27.456452 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:27.456786 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:27.456540 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:27.456786 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:27.456618 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:29.062088 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:29.061773 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:29.062088 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:29.061842 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:29.062088 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.061925 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:29.062088 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.061996 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:29.062088 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.061998 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:37.061974591 +0000 UTC m=+18.060777581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:29.062088 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.062068 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret podName:7f922831-b683-4553-becb-f80585a93c86 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:37.062049608 +0000 UTC m=+18.060852585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret") pod "global-pull-secret-syncer-k8q9j" (UID: "7f922831-b683-4553-becb-f80585a93c86") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:29.163044 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:29.162923 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:29.163203 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.163076 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:08:29.163203 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.163094 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:08:29.163203 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.163105 2531 projected.go:196] Error preparing data for projected volume kube-api-access-rg8hg for pod openshift-network-diagnostics/network-check-target-njg9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:29.163203 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.163169 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg podName:4b11cfac-d0b9-4f60-9b27-66a12310147c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:37.163151415 +0000 UTC m=+18.161954409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg8hg" (UniqueName: "kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg") pod "network-check-target-njg9p" (UID: "4b11cfac-d0b9-4f60-9b27-66a12310147c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:29.457324 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:29.457257 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:29.457487 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.457370 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:29.458189 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:29.457693 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:29.458189 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.457784 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:29.458189 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:29.457926 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:29.458189 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:29.458015 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:31.456242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:31.456209 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:31.456650 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:31.456214 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:31.456650 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:31.456316 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:31.456650 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:31.456337 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:31.456650 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:31.456448 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:31.456650 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:31.456572 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:33.460936 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:33.460908 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:33.461355 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:33.460952 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:33.461355 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:33.461042 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:33.461449 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:33.461379 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:33.461523 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:33.461496 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:33.461618 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:33.461590 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:35.456945 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:35.456913 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:35.457338 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:35.456919 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:35.457338 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:35.457008 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:35.457338 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:35.457033 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:35.457338 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:35.457118 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:35.457338 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:35.457180 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:37.130203 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:37.130168 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:37.130765 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:37.130217 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:37.130765 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.130271 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:37.130765 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.130332 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:37.130765 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.130344 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:53.130324436 +0000 UTC m=+34.129127424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:37.130765 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.130370 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret podName:7f922831-b683-4553-becb-f80585a93c86 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:53.130358561 +0000 UTC m=+34.129161533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret") pod "global-pull-secret-syncer-k8q9j" (UID: "7f922831-b683-4553-becb-f80585a93c86") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:37.230678 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:37.230641 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:37.230828 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.230806 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:08:37.230876 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.230833 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:08:37.230876 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.230847 2531 projected.go:196] Error preparing data for projected volume kube-api-access-rg8hg for pod openshift-network-diagnostics/network-check-target-njg9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:37.230966 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.230914 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg podName:4b11cfac-d0b9-4f60-9b27-66a12310147c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:53.230883653 +0000 UTC m=+34.229686646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg8hg" (UniqueName: "kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg") pod "network-check-target-njg9p" (UID: "4b11cfac-d0b9-4f60-9b27-66a12310147c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:37.457097 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:37.456989 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:37.457097 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:37.456999 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:37.457301 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.457111 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:37.457301 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:37.456989 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:37.457301 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.457189 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:37.457301 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:37.457233 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:39.457586 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:39.457554 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:39.458059 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:39.457657 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:39.458059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:39.457664 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:39.458059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:39.457696 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:39.458059 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:39.457799 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:39.458059 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:39.457915 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:41.456379 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.456236 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:41.456929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.456236 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:41.456929 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:41.456459 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:41.456929 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:41.456552 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:41.456929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.456311 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:41.456929 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:41.456660 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:41.558210 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.558183 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc8vp" event={"ID":"c9a78d84-1392-4435-8891-c0cf1da0bcbc","Type":"ContainerStarted","Data":"4dcc844450b6691fe45c9c3811c718b5d41cd7bd8e3112220aac6efdb9b46017"} Jun 08 18:08:41.559663 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.559643 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" event={"ID":"d7ae2003-0e30-4e2a-b097-c101ed08bbdb","Type":"ContainerStarted","Data":"521591fcb03e30e1ef912a5dbf54739edda52db015f0de823c7fd8521c992b5b"} Jun 08 18:08:41.562073 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.562054 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"4a7d689157b7714ca1f897f2a776305ad8e19e5f04e2f492c0f035bca3fc908b"} Jun 08 18:08:41.562155 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.562119 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"d35fa0267bb4bd4c421a71c4f30135081581cac7a03ef043d8792003e3557c6d"} Jun 08 18:08:41.562209 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.562169 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"394de6e8d1dd9a8221c2ea4374ebc23b3236eca896fc3df8b665d0467f58743d"} Jun 08 18:08:41.562250 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.562218 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"a46d347bcde2b87b326cbb90f16f688f318aacf689b7fb905b4ec0e0a95ae4a3"} Jun 08 18:08:41.563333 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.563312 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dk4x4" event={"ID":"f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f","Type":"ContainerStarted","Data":"8f7269ab6034fa518d02786a05e2f900725677a30ea884aafb410b7bbcd6779c"} Jun 08 18:08:41.564574 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.564554 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m2zxd" event={"ID":"4a37c70e-2811-469f-94d5-5ce997c8885e","Type":"ContainerStarted","Data":"6d2d0af2f7e252f27700b67c9c6fb4f632ab74e89d7536faa0edc1892dd47a62"} Jun 08 18:08:41.565823 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.565799 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" event={"ID":"8e3411aa-16d5-4c3a-add6-fc7b16514f1b","Type":"ContainerStarted","Data":"f9808171e412a986b552d224eb2156679edbf17c40891fafd6f58b043e24e672"} Jun 08 18:08:41.567047 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.567028 2531 generic.go:356] "Generic (PLEG): container finished" podID="0f2532f5-e06b-4a0b-84d8-ac54315c3a1b" containerID="1ef2e4acce1fcd6d150f05eec3873bf9b4e956a3ce84a92b70a7d85d142b72f9" exitCode=0 Jun 08 18:08:41.567117 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.567085 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerDied","Data":"1ef2e4acce1fcd6d150f05eec3873bf9b4e956a3ce84a92b70a7d85d142b72f9"} Jun 08 18:08:41.568387 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.568368 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fw95n" event={"ID":"918fabd2-131a-4c30-a0be-23ed41a28250","Type":"ContainerStarted","Data":"cec4faab7d22ecce22ebcba55d7132aa4f0ceb7fde1523d3cb47d1b583c83774"} Jun 08 18:08:41.572941 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.572909 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-8.ec2.internal" podStartSLOduration=21.572875062 podStartE2EDuration="21.572875062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:23.541789822 +0000 UTC m=+4.540592815" watchObservedRunningTime="2026-06-08 18:08:41.572875062 +0000 UTC m=+22.571678056" Jun 08 18:08:41.573123 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.573103 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tc8vp" podStartSLOduration=3.652615705 podStartE2EDuration="22.573097083s" totalImagesPullingTime="18.920481378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:41.572455111 +0000 UTC m=+22.571258100" watchObservedRunningTime="2026-06-08 18:08:41.573097083 +0000 UTC m=+22.571900069" Jun 08 18:08:41.593411 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.593351 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8mxxz" podStartSLOduration=3.675060691 podStartE2EDuration="22.593339315s" totalImagesPullingTime="18.918278624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:41.592865275 +0000 UTC m=+22.591668258" watchObservedRunningTime="2026-06-08 18:08:41.593339315 +0000 UTC m=+22.592142309" Jun 08 18:08:41.648691 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.648658 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dk4x4" podStartSLOduration=3.681678524 podStartE2EDuration="22.648647029s" totalImagesPullingTime="18.966968505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:41.633959548 +0000 UTC m=+22.632762541" watchObservedRunningTime="2026-06-08 18:08:41.648647029 +0000 UTC m=+22.647450023" Jun 08 18:08:41.649062 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.649036 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fw95n" podStartSLOduration=3.7310877099999997 podStartE2EDuration="22.649029744s" totalImagesPullingTime="18.917942034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:41.648463334 +0000 UTC m=+22.647266326" watchObservedRunningTime="2026-06-08 18:08:41.649029744 +0000 UTC m=+22.647832761" Jun 08 18:08:41.662279 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.662249 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m2zxd" podStartSLOduration=12.156974893 podStartE2EDuration="22.662237895s" totalImagesPullingTime="10.505263002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:41.662046294 +0000 UTC m=+22.660849288" watchObservedRunningTime="2026-06-08 18:08:41.662237895 +0000 UTC m=+22.661040887" Jun 08 18:08:41.668794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:41.668777 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:42.545745 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.545606 2531 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 18:08:42.572495 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.572465 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmplr" event={"ID":"27296c21-bf10-4c2f-9e4c-911663217049","Type":"ContainerStarted","Data":"9aa654a43488f434eb8608152fc1cbd5385c3814365db48ef99a505680282778"} Jun 08 18:08:42.574679 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.574652 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" event={"ID":"d7ae2003-0e30-4e2a-b097-c101ed08bbdb","Type":"ContainerStarted","Data":"de18c370fb92128ade8876cfb03f0c5c68fc6efc53ec69e5950902ad08e0cebb"} Jun 08 18:08:42.578101 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.578077 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"572a2988834741aa320e0c52193fac3d828cc14db5bfd1b5173f1c3a2652ac88"} Jun 08 18:08:42.578197 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.578163 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"8ac78043fae61c29c60b9a1dde9699e41b17650dbd8c8392433372265b41fbc6"} Jun 08 18:08:42.586845 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.586800 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lmplr" podStartSLOduration=4.672554852 podStartE2EDuration="23.58678738s" totalImagesPullingTime="18.914232528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:42.586625534 +0000 UTC m=+23.585428527" watchObservedRunningTime="2026-06-08 18:08:42.58678738 +0000 UTC m=+23.585590372" Jun 08 18:08:42.605472 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.605419 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:42.606077 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:42.606058 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:43.456703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.456680 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:43.456831 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:43.456798 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:43.456978 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.456956 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:43.457154 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:43.457132 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:43.457217 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.457201 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:43.457312 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:43.457294 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:43.463763 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.463695 2531 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T18:08:42.545741047Z","UUID":"809bca0f-cf3c-4b2f-89a8-7c2518ae3f8e","Handler":null,"Name":"","Endpoint":""} Jun 08 18:08:43.464948 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.464931 2531 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 18:08:43.465041 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.464970 2531 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 18:08:43.581811 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.581774 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" event={"ID":"d7ae2003-0e30-4e2a-b097-c101ed08bbdb","Type":"ContainerStarted","Data":"732d264a7fbdf453c0762cc0389cf7cff5c97f027c32d55c06de3eff5b196400"} Jun 08 18:08:43.582488 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.582470 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m2zxd" Jun 08 18:08:43.598358 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:43.598320 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lk78" podStartSLOduration=3.786558969 podStartE2EDuration="24.598303162s" totalImagesPullingTime="20.811744193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:43.59821596 +0000 UTC m=+24.597018954" watchObservedRunningTime="2026-06-08 18:08:43.598303162 +0000 UTC m=+24.597106137" Jun 08 18:08:44.588367 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:44.588329 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"90299156e5b6572322615dd7c606ed2ca391ddbc9b33e3aeb734062680499d4b"} Jun 08 18:08:45.456121 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:45.456085 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:45.456121 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:45.456099 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:45.456354 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:45.456203 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:45.456354 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:45.456271 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:45.456354 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:45.456289 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:45.456514 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:45.456371 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:47.457019 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:47.456986 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:47.457019 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:47.456986 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:47.457586 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:47.457179 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:47.457586 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:47.457169 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:47.457586 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:47.457284 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:47.457586 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:47.457359 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:48.599469 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:48.599437 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" event={"ID":"14579ca1-7421-48ac-9bb5-400c85bd214a","Type":"ContainerStarted","Data":"31caef8c8593c3ea6c8c2280d9a32c57bd9ea6077ab414f7d2379a47b9dab15e"} Jun 08 18:08:48.599988 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:48.599717 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:48.601498 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:48.601476 2531 generic.go:356] "Generic (PLEG): container finished" podID="0f2532f5-e06b-4a0b-84d8-ac54315c3a1b" containerID="8a842538062fc73d782b8738a5c313968c79129ea07485000cd0b0212a932611" exitCode=0 Jun 08 18:08:48.601582 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:48.601510 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerDied","Data":"8a842538062fc73d782b8738a5c313968c79129ea07485000cd0b0212a932611"} Jun 08 18:08:48.614939 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:48.614922 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:48.626902 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:48.626850 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" podStartSLOduration=10.563767485 podStartE2EDuration="29.626838958s" totalImagesPullingTime="19.063071473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:48.625143409 +0000 UTC m=+29.623946402" watchObservedRunningTime="2026-06-08 18:08:48.626838958 +0000 UTC m=+29.625641951" Jun 08 18:08:49.456968 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.456815 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:49.457080 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.456882 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:49.457080 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:49.457043 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:49.457176 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:49.457140 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:49.457176 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.456947 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:49.457280 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:49.457257 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:49.563245 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.563220 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njg9p"] Jun 08 18:08:49.569956 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.569936 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ctgvc"] Jun 08 18:08:49.574930 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.574910 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k8q9j"] Jun 08 18:08:49.606479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.606454 2531 generic.go:356] "Generic (PLEG): container finished" podID="0f2532f5-e06b-4a0b-84d8-ac54315c3a1b" containerID="0b54e83877d3ce30a9ef33a4d656a066b6688865a6834effbe40abed89d5aadc" exitCode=0 Jun 08 18:08:49.606819 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.606539 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:49.606819 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.606564 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerDied","Data":"0b54e83877d3ce30a9ef33a4d656a066b6688865a6834effbe40abed89d5aadc"} Jun 08 18:08:49.606819 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:49.606674 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:49.606975 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.606815 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:49.606975 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:49.606947 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:49.607088 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.607061 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:49.607631 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:49.607608 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:49.607728 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.607641 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:49.607728 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.607688 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:49.622028 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:49.622009 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:08:51.456839 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:51.456805 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:51.457476 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:51.456808 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:51.457476 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:51.456915 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:51.457476 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:51.457003 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:51.457476 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:51.456814 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:51.457476 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:51.457083 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:51.612273 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:51.612238 2531 generic.go:356] "Generic (PLEG): container finished" podID="0f2532f5-e06b-4a0b-84d8-ac54315c3a1b" containerID="e427bbba0d8e526d4b395c11dd03a962be020ef6c715c8aa7f294d6d0a07b439" exitCode=0 Jun 08 18:08:51.612395 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:51.612318 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerDied","Data":"e427bbba0d8e526d4b395c11dd03a962be020ef6c715c8aa7f294d6d0a07b439"} Jun 08 18:08:53.149217 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:53.149188 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:53.149665 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:53.149239 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:53.149665 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.149296 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:53.149665 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.149342 2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:53.149665 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.149367 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:09:25.149342738 +0000 UTC m=+66.148145723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:08:53.149665 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.149395 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret podName:7f922831-b683-4553-becb-f80585a93c86 nodeName:}" failed. No retries permitted until 2026-06-08 18:09:25.14937833 +0000 UTC m=+66.148181302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret") pod "global-pull-secret-syncer-k8q9j" (UID: "7f922831-b683-4553-becb-f80585a93c86") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:08:53.250070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:53.250040 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:53.250210 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.250187 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:08:53.250210 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.250203 2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:08:53.250210 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.250212 2531 projected.go:196] Error preparing data for projected volume kube-api-access-rg8hg for pod openshift-network-diagnostics/network-check-target-njg9p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:53.250354 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.250262 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg podName:4b11cfac-d0b9-4f60-9b27-66a12310147c nodeName:}" failed. No retries permitted until 2026-06-08 18:09:25.250245003 +0000 UTC m=+66.249047976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg8hg" (UniqueName: "kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg") pod "network-check-target-njg9p" (UID: "4b11cfac-d0b9-4f60-9b27-66a12310147c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:08:53.456994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:53.456879 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:53.456994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:53.456906 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:53.457188 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:53.457009 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:53.457188 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.457010 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njg9p" podUID="4b11cfac-d0b9-4f60-9b27-66a12310147c" Jun 08 18:08:53.457188 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.457135 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8q9j" podUID="7f922831-b683-4553-becb-f80585a93c86" Jun 08 18:08:53.457324 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:53.457244 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:08:54.873964 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.873939 2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-8.ec2.internal" event="NodeReady" Jun 08 18:08:54.874492 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.874042 2531 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 18:08:54.924172 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.924140 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6972p"] Jun 08 18:08:54.926663 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.926646 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6972p" Jun 08 18:08:54.928707 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.928687 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ghqwp"] Jun 08 18:08:54.929127 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.929108 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdrdq\"" Jun 08 18:08:54.929505 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.929483 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 18:08:54.929739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.929721 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 18:08:54.930495 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.930474 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:54.932903 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.932875 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 18:08:54.933369 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.933222 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 18:08:54.933369 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.933317 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-czn8q\"" Jun 08 18:08:54.934844 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.934823 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 18:08:54.939755 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.939733 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6972p"] Jun 08 18:08:54.944556 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:54.944405 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghqwp"] Jun 08 18:08:55.063086 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.063058 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5644w\" (UniqueName: \"kubernetes.io/projected/d659592b-318f-4546-b13b-34d9ae0e99f6-kube-api-access-5644w\") pod \"ingress-canary-ghqwp\" (UID: \"d659592b-318f-4546-b13b-34d9ae0e99f6\") " pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:55.063246 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.063094 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1aef15f4-46bd-4fc0-b279-91d04b397685-config-volume\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.063246 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.063115 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xldxn\" (UniqueName: \"kubernetes.io/projected/1aef15f4-46bd-4fc0-b279-91d04b397685-kube-api-access-xldxn\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.063365 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.063251 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aef15f4-46bd-4fc0-b279-91d04b397685-tmp-dir\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.063365 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.063302 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d659592b-318f-4546-b13b-34d9ae0e99f6-cert\") pod \"ingress-canary-ghqwp\" (UID: \"d659592b-318f-4546-b13b-34d9ae0e99f6\") " pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:55.063365 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.063333 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.164504 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.164435 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aef15f4-46bd-4fc0-b279-91d04b397685-tmp-dir\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.164504 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.164484 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d659592b-318f-4546-b13b-34d9ae0e99f6-cert\") pod \"ingress-canary-ghqwp\" (UID: \"d659592b-318f-4546-b13b-34d9ae0e99f6\") " pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:55.164712 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.164616 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.164712 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.164668 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5644w\" (UniqueName: \"kubernetes.io/projected/d659592b-318f-4546-b13b-34d9ae0e99f6-kube-api-access-5644w\") pod \"ingress-canary-ghqwp\" (UID: \"d659592b-318f-4546-b13b-34d9ae0e99f6\") " pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:55.164712 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:55.164704 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:55.164851 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:55.164767 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:55.664749034 +0000 UTC m=+36.663552024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:08:55.164851 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.164705 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1aef15f4-46bd-4fc0-b279-91d04b397685-config-volume\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.164851 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.164803 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xldxn\" (UniqueName: \"kubernetes.io/projected/1aef15f4-46bd-4fc0-b279-91d04b397685-kube-api-access-xldxn\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.164851 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.164824 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aef15f4-46bd-4fc0-b279-91d04b397685-tmp-dir\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.165384 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.165351 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1aef15f4-46bd-4fc0-b279-91d04b397685-config-volume\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.169834 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.169813 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d659592b-318f-4546-b13b-34d9ae0e99f6-cert\") pod \"ingress-canary-ghqwp\" (UID: \"d659592b-318f-4546-b13b-34d9ae0e99f6\") " pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:55.175512 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.175494 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xldxn\" (UniqueName: \"kubernetes.io/projected/1aef15f4-46bd-4fc0-b279-91d04b397685-kube-api-access-xldxn\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.176441 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.176421 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5644w\" (UniqueName: \"kubernetes.io/projected/d659592b-318f-4546-b13b-34d9ae0e99f6-kube-api-access-5644w\") pod \"ingress-canary-ghqwp\" (UID: \"d659592b-318f-4546-b13b-34d9ae0e99f6\") " pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:55.246534 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.246514 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghqwp" Jun 08 18:08:55.456530 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.456450 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:08:55.456530 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.456486 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:08:55.456735 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.456450 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:08:55.459441 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.459367 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 18:08:55.459441 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.459392 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 18:08:55.459441 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.459402 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hjxk\"" Jun 08 18:08:55.459681 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.459663 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 18:08:55.460420 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.460404 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gzst\"" Jun 08 18:08:55.460509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.460444 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 18:08:55.669263 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.669227 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:55.669437 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:55.669378 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:55.669525 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:55.669452 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:56.669431422 +0000 UTC m=+37.668234392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:08:55.954495 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:55.954185 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghqwp"] Jun 08 18:08:55.957506 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:08:55.957475 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd659592b_318f_4546_b13b_34d9ae0e99f6.slice/crio-f2dd9a505d3499440fea636fc83df1e2cd46bd2e035c14dbe1eb6e14bd3626f6 WatchSource:0}: Error finding container f2dd9a505d3499440fea636fc83df1e2cd46bd2e035c14dbe1eb6e14bd3626f6: Status 404 returned error can't find the container with id f2dd9a505d3499440fea636fc83df1e2cd46bd2e035c14dbe1eb6e14bd3626f6 Jun 08 18:08:56.624004 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:56.623967 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghqwp" event={"ID":"d659592b-318f-4546-b13b-34d9ae0e99f6","Type":"ContainerStarted","Data":"f2dd9a505d3499440fea636fc83df1e2cd46bd2e035c14dbe1eb6e14bd3626f6"} Jun 08 18:08:56.626792 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:56.626767 2531 generic.go:356] "Generic (PLEG): container finished" podID="0f2532f5-e06b-4a0b-84d8-ac54315c3a1b" containerID="831895349e47e3563eef6e1ee1eff767405c92ac1a4ba13adbbcd01274cb5f78" exitCode=0 Jun 08 18:08:56.626921 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:56.626811 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerDied","Data":"831895349e47e3563eef6e1ee1eff767405c92ac1a4ba13adbbcd01274cb5f78"} Jun 08 18:08:56.676720 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:56.676686 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:56.676954 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:56.676879 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:56.677029 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:56.676958 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:58.676939332 +0000 UTC m=+39.675742304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:08:57.631079 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:57.630834 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghqwp" event={"ID":"d659592b-318f-4546-b13b-34d9ae0e99f6","Type":"ContainerStarted","Data":"f10f4cc4eac9a524039f9cd6d027884f585ebb2f1bd59ccf318a50b6b2448310"} Jun 08 18:08:57.634016 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:57.633987 2531 generic.go:356] "Generic (PLEG): container finished" podID="0f2532f5-e06b-4a0b-84d8-ac54315c3a1b" containerID="dc4b2e8c5f3a3c7c1968991e49c2eb9b97e100ccbdc38b36e934985397fac3ab" exitCode=0 Jun 08 18:08:57.634149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:57.634054 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerDied","Data":"dc4b2e8c5f3a3c7c1968991e49c2eb9b97e100ccbdc38b36e934985397fac3ab"} Jun 08 18:08:57.676785 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:57.676677 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ghqwp" podStartSLOduration=2.178838873 podStartE2EDuration="3.676660938s" totalImagesPullingTime="1.497822065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:57.650385815 +0000 UTC m=+38.649188808" watchObservedRunningTime="2026-06-08 18:08:57.676660938 +0000 UTC m=+38.675463931" Jun 08 18:08:58.639978 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:58.639947 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" event={"ID":"0f2532f5-e06b-4a0b-84d8-ac54315c3a1b","Type":"ContainerStarted","Data":"d91bfba6883f6b5b9be9672e55f471e0591d875b2d517a5e94a97c6e915b49c0"} Jun 08 18:08:58.662780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:58.662736 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qvhtc" podStartSLOduration=8.400995195 podStartE2EDuration="39.662721897s" totalImagesPullingTime="31.261726702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:58.661328243 +0000 UTC m=+39.660131246" watchObservedRunningTime="2026-06-08 18:08:58.662721897 +0000 UTC m=+39.661524887" Jun 08 18:08:58.691711 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:08:58.691683 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:08:58.691847 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:58.691828 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:58.691925 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:08:58.691914 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:09:02.691880207 +0000 UTC m=+43.690683177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:09:00.488607 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.488577 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx"] Jun 08 18:09:00.538349 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.538327 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx"] Jun 08 18:09:00.538469 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.538408 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.540869 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.540839 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 18:09:00.541000 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.540957 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 18:09:00.541468 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.541451 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 18:09:00.541544 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.541494 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 18:09:00.704367 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.704339 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7afd015-1bf5-422a-b892-c453b13c4004-tmp\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.704481 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.704415 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f7afd015-1bf5-422a-b892-c453b13c4004-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.704481 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.704434 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84mk8\" (UniqueName: \"kubernetes.io/projected/f7afd015-1bf5-422a-b892-c453b13c4004-kube-api-access-84mk8\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.805645 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.805595 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f7afd015-1bf5-422a-b892-c453b13c4004-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.805645 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.805622 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84mk8\" (UniqueName: \"kubernetes.io/projected/f7afd015-1bf5-422a-b892-c453b13c4004-kube-api-access-84mk8\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.805778 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.805646 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7afd015-1bf5-422a-b892-c453b13c4004-tmp\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.805989 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.805973 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7afd015-1bf5-422a-b892-c453b13c4004-tmp\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.809657 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.809637 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f7afd015-1bf5-422a-b892-c453b13c4004-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.813365 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.813343 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84mk8\" (UniqueName: \"kubernetes.io/projected/f7afd015-1bf5-422a-b892-c453b13c4004-kube-api-access-84mk8\") pod \"klusterlet-addon-workmgr-7fb7c6b48f-vpkjx\" (UID: \"f7afd015-1bf5-422a-b892-c453b13c4004\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.847299 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.847280 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:00.983438 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:00.983412 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx"] Jun 08 18:09:00.986520 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:09:00.986496 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7afd015_1bf5_422a_b892_c453b13c4004.slice/crio-b738ba68b4f8cb8da9915f1076def785d97f134206e50578ed09cc63bf471a41 WatchSource:0}: Error finding container b738ba68b4f8cb8da9915f1076def785d97f134206e50578ed09cc63bf471a41: Status 404 returned error can't find the container with id b738ba68b4f8cb8da9915f1076def785d97f134206e50578ed09cc63bf471a41 Jun 08 18:09:01.647077 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:01.647049 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" event={"ID":"f7afd015-1bf5-422a-b892-c453b13c4004","Type":"ContainerStarted","Data":"b738ba68b4f8cb8da9915f1076def785d97f134206e50578ed09cc63bf471a41"} Jun 08 18:09:02.721962 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:02.721930 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:09:02.722384 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:02.722057 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:09:02.722384 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:02.722120 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:09:10.722103821 +0000 UTC m=+51.720906792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:09:05.657648 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:05.657614 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" event={"ID":"f7afd015-1bf5-422a-b892-c453b13c4004","Type":"ContainerStarted","Data":"9b91789cbd9eba6f00f8156a6f4746c09f8b03740255d71180bf46fa61a27e54"} Jun 08 18:09:05.658063 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:05.657826 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:05.659096 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:05.659068 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:09:05.693363 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:05.693323 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" podStartSLOduration=1.216136167 podStartE2EDuration="5.693309829s" totalImagesPullingTime="4.477173662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:09:05.673921594 +0000 UTC m=+46.672724587" watchObservedRunningTime="2026-06-08 18:09:05.693309829 +0000 UTC m=+46.692112813" Jun 08 18:09:10.778095 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:10.778058 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:09:10.778575 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:10.778205 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:09:10.778575 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:10.778268 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:09:26.778251452 +0000 UTC m=+67.777054423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:09:21.622450 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:21.622420 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v54ns" Jun 08 18:09:25.169368 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.169318 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:09:25.169794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.169393 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:09:25.172831 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.172804 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 18:09:25.173059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.173044 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 18:09:25.180103 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:25.180079 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 18:09:25.180184 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:25.180163 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:10:29.18014401 +0000 UTC m=+130.178946981 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : secret "metrics-daemon-secret" not found Jun 08 18:09:25.182338 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.182310 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f922831-b683-4553-becb-f80585a93c86-original-pull-secret\") pod \"global-pull-secret-syncer-k8q9j\" (UID: \"7f922831-b683-4553-becb-f80585a93c86\") " pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:09:25.269780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.269748 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:09:25.272729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.272705 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 18:09:25.282674 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.282646 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 18:09:25.292828 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.292800 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg8hg\" (UniqueName: \"kubernetes.io/projected/4b11cfac-d0b9-4f60-9b27-66a12310147c-kube-api-access-rg8hg\") pod \"network-check-target-njg9p\" (UID: \"4b11cfac-d0b9-4f60-9b27-66a12310147c\") " pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:09:25.468134 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.468071 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8q9j" Jun 08 18:09:25.482655 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.482634 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hjxk\"" Jun 08 18:09:25.490915 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.490885 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:09:25.618001 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.617974 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k8q9j"] Jun 08 18:09:25.620561 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:09:25.620524 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f922831_b683_4553_becb_f80585a93c86.slice/crio-bbf2e499622c56fcd47f3763569b3132f27b9f8640c06ac64d65a932e039373d WatchSource:0}: Error finding container bbf2e499622c56fcd47f3763569b3132f27b9f8640c06ac64d65a932e039373d: Status 404 returned error can't find the container with id bbf2e499622c56fcd47f3763569b3132f27b9f8640c06ac64d65a932e039373d Jun 08 18:09:25.640665 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.640643 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njg9p"] Jun 08 18:09:25.642974 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:09:25.642956 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b11cfac_d0b9_4f60_9b27_66a12310147c.slice/crio-ae693a390c9466a9246546641ea0f2af9d47e2c8b1fe262ae38d66bb1280b4fd WatchSource:0}: Error finding container ae693a390c9466a9246546641ea0f2af9d47e2c8b1fe262ae38d66bb1280b4fd: Status 404 returned error can't find the container with id ae693a390c9466a9246546641ea0f2af9d47e2c8b1fe262ae38d66bb1280b4fd Jun 08 18:09:25.703351 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.703320 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njg9p" event={"ID":"4b11cfac-d0b9-4f60-9b27-66a12310147c","Type":"ContainerStarted","Data":"ae693a390c9466a9246546641ea0f2af9d47e2c8b1fe262ae38d66bb1280b4fd"} Jun 08 18:09:25.704385 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:25.704365 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k8q9j" event={"ID":"7f922831-b683-4553-becb-f80585a93c86","Type":"ContainerStarted","Data":"bbf2e499622c56fcd47f3763569b3132f27b9f8640c06ac64d65a932e039373d"} Jun 08 18:09:26.781533 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:26.781488 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:09:26.781971 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:26.781667 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:09:26.781971 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:26.781739 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:09:58.781719 +0000 UTC m=+99.780521987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:09:30.719263 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:30.719226 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njg9p" event={"ID":"4b11cfac-d0b9-4f60-9b27-66a12310147c","Type":"ContainerStarted","Data":"6595af658a8bc5ab718005b1f046433ef938bd9eed318373dc967b2c8f387143"} Jun 08 18:09:30.719705 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:30.719353 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:09:30.720900 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:30.720861 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k8q9j" event={"ID":"7f922831-b683-4553-becb-f80585a93c86","Type":"ContainerStarted","Data":"a630334ec33e73edfab90280338cd1157b825762e9eafb61401c506a0c376607"} Jun 08 18:09:30.737372 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:30.737326 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-njg9p" podStartSLOduration=67.349636574 podStartE2EDuration="1m11.737311506s" totalImagesPullingTime="4.387674932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:09:30.736711991 +0000 UTC m=+71.735514983" watchObservedRunningTime="2026-06-08 18:09:30.737311506 +0000 UTC m=+71.736114502" Jun 08 18:09:30.753024 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:30.752949 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k8q9j" podStartSLOduration=67.340299469 podStartE2EDuration="1m11.752937159s" totalImagesPullingTime="4.41263769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:09:30.752815857 +0000 UTC m=+71.751618865" watchObservedRunningTime="2026-06-08 18:09:30.752937159 +0000 UTC m=+71.751740149" Jun 08 18:09:58.877123 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:09:58.877088 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:09:58.877602 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:58.877207 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:09:58.877602 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:09:58.877257 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:02.877244167 +0000 UTC m=+163.876047137 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:10:01.725676 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:10:01.725643 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-njg9p" Jun 08 18:10:29.268749 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:10:29.268699 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:10:29.269284 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:10:29.268827 2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 18:10:29.269284 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:10:29.268918 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs podName:b19a021f-4a9c-4916-89c4-de834fc39272 nodeName:}" failed. No retries permitted until 2026-06-08 18:12:31.26888427 +0000 UTC m=+252.267687241 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs") pod "network-metrics-daemon-ctgvc" (UID: "b19a021f-4a9c-4916-89c4-de834fc39272") : secret "metrics-daemon-secret" not found Jun 08 18:10:57.939292 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:10:57.939255 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6972p" podUID="1aef15f4-46bd-4fc0-b279-91d04b397685" Jun 08 18:10:58.474997 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:10:58.474950 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ctgvc" podUID="b19a021f-4a9c-4916-89c4-de834fc39272" Jun 08 18:10:58.921281 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:10:58.921257 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6972p" Jun 08 18:11:02.881667 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:02.881630 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:11:02.882208 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:02.881762 2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:11:02.882208 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:02.881822 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls podName:1aef15f4-46bd-4fc0-b279-91d04b397685 nodeName:}" failed. No retries permitted until 2026-06-08 18:13:04.881805479 +0000 UTC m=+285.880608450 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls") pod "dns-default-6972p" (UID: "1aef15f4-46bd-4fc0-b279-91d04b397685") : secret "dns-default-metrics-tls" not found Jun 08 18:11:05.938059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:05.937989 2531 generic.go:356] "Generic (PLEG): container finished" podID="f7afd015-1bf5-422a-b892-c453b13c4004" containerID="9b91789cbd9eba6f00f8156a6f4746c09f8b03740255d71180bf46fa61a27e54" exitCode=1 Jun 08 18:11:05.938354 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:05.938061 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" event={"ID":"f7afd015-1bf5-422a-b892-c453b13c4004","Type":"ContainerDied","Data":"9b91789cbd9eba6f00f8156a6f4746c09f8b03740255d71180bf46fa61a27e54"} Jun 08 18:11:05.938393 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:05.938355 2531 scope.go:117] "RemoveContainer" containerID="9b91789cbd9eba6f00f8156a6f4746c09f8b03740255d71180bf46fa61a27e54" Jun 08 18:11:06.941691 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:06.941654 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" event={"ID":"f7afd015-1bf5-422a-b892-c453b13c4004","Type":"ContainerStarted","Data":"764d40f97e8b271bb8ccdeba4f06c76d31df526a6dc0c70ebdf7af6e02a223f8"} Jun 08 18:11:06.942193 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:06.941982 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:11:06.942545 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:06.942524 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:11:13.456450 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:13.456419 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:11:32.982731 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.982696 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb"] Jun 08 18:11:32.984396 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.984377 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:32.987079 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.987044 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 18:11:32.987199 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.987092 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2snl5\"" Jun 08 18:11:32.987739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.987711 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:11:32.987824 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.987771 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 18:11:32.988480 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.988435 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 18:11:32.989339 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.989316 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b8ff49454-cfzzs"] Jun 08 18:11:32.991104 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.991085 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:32.994446 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.994426 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 18:11:32.994908 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.994879 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lkmgz\"" Jun 08 18:11:32.995760 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.995742 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 18:11:32.995805 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:32.995742 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 18:11:33.000983 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.000965 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 18:11:33.002217 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.002194 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb"] Jun 08 18:11:33.040884 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.040302 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8ff49454-cfzzs"] Jun 08 18:11:33.073116 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.073093 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2759a52-72d2-4522-8472-b521452005e7-config\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.073206 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.073135 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2759a52-72d2-4522-8472-b521452005e7-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.073206 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.073152 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn44r\" (UniqueName: \"kubernetes.io/projected/e2759a52-72d2-4522-8472-b521452005e7-kube-api-access-dn44r\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.153373 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.153245 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9"] Jun 08 18:11:33.155159 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.155139 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-88s76"] Jun 08 18:11:33.155261 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.155243 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" Jun 08 18:11:33.156656 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.156638 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-dc4f597c9-ndwsz"] Jun 08 18:11:33.156769 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.156749 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" Jun 08 18:11:33.158339 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.158322 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.158858 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.158839 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xb6bg\"" Jun 08 18:11:33.159124 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.159109 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q9849\"" Jun 08 18:11:33.159445 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.159431 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:11:33.159577 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.159563 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 18:11:33.162308 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.162284 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 18:11:33.162453 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.162438 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vh6c7\"" Jun 08 18:11:33.162631 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.162618 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 18:11:33.162709 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.162675 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 18:11:33.163332 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.163317 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 18:11:33.163857 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.163845 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 18:11:33.164130 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.164115 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 18:11:33.171818 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.171799 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9"] Jun 08 18:11:33.172646 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.172583 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-88s76"] Jun 08 18:11:33.173700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.173678 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2759a52-72d2-4522-8472-b521452005e7-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.173804 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.173716 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn44r\" (UniqueName: \"kubernetes.io/projected/e2759a52-72d2-4522-8472-b521452005e7-kube-api-access-dn44r\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.173804 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.173690 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dc4f597c9-ndwsz"] Jun 08 18:11:33.173929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.173867 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-installation-pull-secrets\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.173996 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.173938 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-certificates\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.173996 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.173989 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-trusted-ca\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.174108 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.174016 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-bound-sa-token\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.174108 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.174043 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh7bn\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-kube-api-access-gh7bn\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.174108 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.174090 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2759a52-72d2-4522-8472-b521452005e7-config\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.174257 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.174140 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-image-registry-private-configuration\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.174257 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.174237 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.174364 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.174273 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1f0b545-0d46-4e32-a448-0409cdbbd372-ca-trust-extracted\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.174980 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.174643 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e2759a52-72d2-4522-8472-b521452005e7-config\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.176365 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.176339 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e2759a52-72d2-4522-8472-b521452005e7-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.190492 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.190471 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9"] Jun 08 18:11:33.192404 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.192388 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:33.192529 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.192508 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn44r\" (UniqueName: \"kubernetes.io/projected/e2759a52-72d2-4522-8472-b521452005e7-kube-api-access-dn44r\") pod \"service-ca-operator-6bc5ff68f5-b6qpb\" (UID: \"e2759a52-72d2-4522-8472-b521452005e7\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.195799 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.195775 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kkq47\"" Jun 08 18:11:33.196125 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.196106 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 18:11:33.196251 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.196196 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 18:11:33.206944 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.206921 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9"] Jun 08 18:11:33.275287 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275240 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1f0b545-0d46-4e32-a448-0409cdbbd372-ca-trust-extracted\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275287 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275267 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9f4g\" (UniqueName: \"kubernetes.io/projected/111698bf-c87a-4ba7-b95e-8cd003d5b568-kube-api-access-j9f4g\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.275287 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275286 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-default-certificate\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.275450 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275307 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-certificates\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275450 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275324 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-trusted-ca\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275450 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275365 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-stats-auth\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.275450 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275419 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-image-registry-private-configuration\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275610 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275461 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275610 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275505 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh7bn\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-kube-api-access-gh7bn\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275610 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275532 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-installation-pull-secrets\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275610 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275558 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.275610 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275585 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-bound-sa-token\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275610 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.275605 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:11:33.275924 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.275624 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8ff49454-cfzzs: secret "image-registry-tls" not found Jun 08 18:11:33.275924 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275634 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pkhs\" (UniqueName: \"kubernetes.io/projected/05e931e6-5e1d-4055-8d20-7fbadf0deef7-kube-api-access-7pkhs\") pod \"network-check-source-dbd9cf844-88s76\" (UID: \"05e931e6-5e1d-4055-8d20-7fbadf0deef7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" Jun 08 18:11:33.275924 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275665 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.275924 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.275681 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls podName:c1f0b545-0d46-4e32-a448-0409cdbbd372 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:33.77566245 +0000 UTC m=+194.774465421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls") pod "image-registry-6b8ff49454-cfzzs" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372") : secret "image-registry-tls" not found Jun 08 18:11:33.275924 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275703 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1f0b545-0d46-4e32-a448-0409cdbbd372-ca-trust-extracted\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.275924 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275714 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rnpj\" (UniqueName: \"kubernetes.io/projected/756049c9-e141-4ef0-8d55-da30efe78648-kube-api-access-7rnpj\") pod \"volume-data-source-validator-78dd696465-sjkn9\" (UID: \"756049c9-e141-4ef0-8d55-da30efe78648\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" Jun 08 18:11:33.276149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.275996 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-certificates\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.276470 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.276447 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-trusted-ca\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.277766 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.277745 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-installation-pull-secrets\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.277812 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.277796 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-image-registry-private-configuration\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.288970 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.288944 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-bound-sa-token\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.289113 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.289094 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh7bn\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-kube-api-access-gh7bn\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.293828 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.293812 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" Jun 08 18:11:33.376423 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376395 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e020b91-3e70-420f-a376-93eeb0a6c2a3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:33.376532 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376434 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.376532 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376511 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkhs\" (UniqueName: \"kubernetes.io/projected/05e931e6-5e1d-4055-8d20-7fbadf0deef7-kube-api-access-7pkhs\") pod \"network-check-source-dbd9cf844-88s76\" (UID: \"05e931e6-5e1d-4055-8d20-7fbadf0deef7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" Jun 08 18:11:33.376607 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376542 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.376607 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.376550 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 18:11:33.376607 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.376600 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:33.876585602 +0000 UTC m=+194.875388577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : secret "router-metrics-certs-default" not found Jun 08 18:11:33.376720 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376646 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rnpj\" (UniqueName: \"kubernetes.io/projected/756049c9-e141-4ef0-8d55-da30efe78648-kube-api-access-7rnpj\") pod \"volume-data-source-validator-78dd696465-sjkn9\" (UID: \"756049c9-e141-4ef0-8d55-da30efe78648\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" Jun 08 18:11:33.376720 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376682 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4g\" (UniqueName: \"kubernetes.io/projected/111698bf-c87a-4ba7-b95e-8cd003d5b568-kube-api-access-j9f4g\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.376720 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376709 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-default-certificate\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.376865 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376734 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:33.376865 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.376759 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:33.876738329 +0000 UTC m=+194.875541314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : configmap references non-existent config key: service-ca.crt Jun 08 18:11:33.376992 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.376918 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-stats-auth\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.378970 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.378949 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-default-certificate\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.379336 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.379311 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-stats-auth\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.385743 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.385716 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9f4g\" (UniqueName: \"kubernetes.io/projected/111698bf-c87a-4ba7-b95e-8cd003d5b568-kube-api-access-j9f4g\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.386538 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.386516 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pkhs\" (UniqueName: \"kubernetes.io/projected/05e931e6-5e1d-4055-8d20-7fbadf0deef7-kube-api-access-7pkhs\") pod \"network-check-source-dbd9cf844-88s76\" (UID: \"05e931e6-5e1d-4055-8d20-7fbadf0deef7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" Jun 08 18:11:33.386613 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.386558 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rnpj\" (UniqueName: \"kubernetes.io/projected/756049c9-e141-4ef0-8d55-da30efe78648-kube-api-access-7rnpj\") pod \"volume-data-source-validator-78dd696465-sjkn9\" (UID: \"756049c9-e141-4ef0-8d55-da30efe78648\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" Jun 08 18:11:33.408518 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.408498 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb"] Jun 08 18:11:33.411583 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:11:33.411560 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2759a52_72d2_4522_8472_b521452005e7.slice/crio-f94916e8e89e2e9b31584c080f737f05e96abceef2eb875b7277591e5cd151e9 WatchSource:0}: Error finding container f94916e8e89e2e9b31584c080f737f05e96abceef2eb875b7277591e5cd151e9: Status 404 returned error can't find the container with id f94916e8e89e2e9b31584c080f737f05e96abceef2eb875b7277591e5cd151e9 Jun 08 18:11:33.465190 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.465171 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" Jun 08 18:11:33.471359 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.471342 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" Jun 08 18:11:33.478097 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.478079 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:33.478165 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.478131 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e020b91-3e70-420f-a376-93eeb0a6c2a3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:33.478248 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.478228 2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:33.478304 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.478294 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert podName:5e020b91-3e70-420f-a376-93eeb0a6c2a3 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:33.978272404 +0000 UTC m=+194.977075379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-46fg9" (UID: "5e020b91-3e70-420f-a376-93eeb0a6c2a3") : secret "networking-console-plugin-cert" not found Jun 08 18:11:33.478705 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.478683 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e020b91-3e70-420f-a376-93eeb0a6c2a3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:33.582416 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.582292 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9"] Jun 08 18:11:33.584433 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:11:33.584406 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756049c9_e141_4ef0_8d55_da30efe78648.slice/crio-83fe0c4c661d6de19414abb31ee7a149a95f48711ee74acb8c7e9c42d91677f3 WatchSource:0}: Error finding container 83fe0c4c661d6de19414abb31ee7a149a95f48711ee74acb8c7e9c42d91677f3: Status 404 returned error can't find the container with id 83fe0c4c661d6de19414abb31ee7a149a95f48711ee74acb8c7e9c42d91677f3 Jun 08 18:11:33.600121 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.600099 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-88s76"] Jun 08 18:11:33.602346 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:11:33.602325 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e931e6_5e1d_4055_8d20_7fbadf0deef7.slice/crio-ce33069644a8068ad751fe305c2423dc60ec59ff26c6bec99c72366f67ec5907 WatchSource:0}: Error finding container ce33069644a8068ad751fe305c2423dc60ec59ff26c6bec99c72366f67ec5907: Status 404 returned error can't find the container with id ce33069644a8068ad751fe305c2423dc60ec59ff26c6bec99c72366f67ec5907 Jun 08 18:11:33.781542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.781515 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:33.781675 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.781630 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:11:33.781675 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.781641 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8ff49454-cfzzs: secret "image-registry-tls" not found Jun 08 18:11:33.781763 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.781681 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls podName:c1f0b545-0d46-4e32-a448-0409cdbbd372 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:34.781668465 +0000 UTC m=+195.780471436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls") pod "image-registry-6b8ff49454-cfzzs" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372") : secret "image-registry-tls" not found Jun 08 18:11:33.882584 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.882560 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.882686 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.882625 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:33.882749 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.882701 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 18:11:33.882803 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.882770 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:34.882751689 +0000 UTC m=+195.881554678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : secret "router-metrics-certs-default" not found Jun 08 18:11:33.882803 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.882792 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:34.882781721 +0000 UTC m=+195.881584699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : configmap references non-existent config key: service-ca.crt Jun 08 18:11:33.983694 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:33.983664 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:33.984078 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.983801 2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:33.984078 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:33.983860 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert podName:5e020b91-3e70-420f-a376-93eeb0a6c2a3 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:34.983842259 +0000 UTC m=+195.982645245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-46fg9" (UID: "5e020b91-3e70-420f-a376-93eeb0a6c2a3") : secret "networking-console-plugin-cert" not found Jun 08 18:11:34.011824 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.011798 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" event={"ID":"756049c9-e141-4ef0-8d55-da30efe78648","Type":"ContainerStarted","Data":"83fe0c4c661d6de19414abb31ee7a149a95f48711ee74acb8c7e9c42d91677f3"} Jun 08 18:11:34.013207 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.013143 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" event={"ID":"e2759a52-72d2-4522-8472-b521452005e7","Type":"ContainerStarted","Data":"f94916e8e89e2e9b31584c080f737f05e96abceef2eb875b7277591e5cd151e9"} Jun 08 18:11:34.014740 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.014719 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" event={"ID":"05e931e6-5e1d-4055-8d20-7fbadf0deef7","Type":"ContainerStarted","Data":"b3570c2721b6d62d307245d3f7c97eac426bd7308880b7497699dbe7eb532ec7"} Jun 08 18:11:34.014846 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.014759 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" event={"ID":"05e931e6-5e1d-4055-8d20-7fbadf0deef7","Type":"ContainerStarted","Data":"ce33069644a8068ad751fe305c2423dc60ec59ff26c6bec99c72366f67ec5907"} Jun 08 18:11:34.029138 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.029088 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-88s76" podStartSLOduration=1.029071357 podStartE2EDuration="1.029071357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:11:34.027390417 +0000 UTC m=+195.026193412" watchObservedRunningTime="2026-06-08 18:11:34.029071357 +0000 UTC m=+195.027874351" Jun 08 18:11:34.790979 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.790942 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:34.791162 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.791125 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:11:34.791162 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.791145 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8ff49454-cfzzs: secret "image-registry-tls" not found Jun 08 18:11:34.791285 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.791213 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls podName:c1f0b545-0d46-4e32-a448-0409cdbbd372 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:36.791192801 +0000 UTC m=+197.789995791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls") pod "image-registry-6b8ff49454-cfzzs" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372") : secret "image-registry-tls" not found Jun 08 18:11:34.891502 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.891467 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:34.891662 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.891591 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:34.891718 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.891667 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:36.891641478 +0000 UTC m=+197.890444466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : configmap references non-existent config key: service-ca.crt Jun 08 18:11:34.891772 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.891717 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 18:11:34.891826 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.891774 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:36.891757858 +0000 UTC m=+197.890560835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : secret "router-metrics-certs-default" not found Jun 08 18:11:34.991990 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:34.991959 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:34.992362 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.992129 2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:34.992362 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:34.992199 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert podName:5e020b91-3e70-420f-a376-93eeb0a6c2a3 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:36.99218432 +0000 UTC m=+197.990987292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-46fg9" (UID: "5e020b91-3e70-420f-a376-93eeb0a6c2a3") : secret "networking-console-plugin-cert" not found Jun 08 18:11:36.023321 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:36.023288 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" event={"ID":"756049c9-e141-4ef0-8d55-da30efe78648","Type":"ContainerStarted","Data":"34e83217de880e4ac18c046b7df7edcbf1e47e40442a711958917e8cbbb924bc"} Jun 08 18:11:36.024814 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:36.024785 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" event={"ID":"e2759a52-72d2-4522-8472-b521452005e7","Type":"ContainerStarted","Data":"bf5f6efdf7f910f51f3d0b201e551804bc8cbe90285a60c5489aca0946cc23a0"} Jun 08 18:11:36.042342 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:36.042299 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-sjkn9" podStartSLOduration=1.032068924 podStartE2EDuration="3.042287383s" totalImagesPullingTime="2.010218459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:11:36.041371176 +0000 UTC m=+197.040174169" watchObservedRunningTime="2026-06-08 18:11:36.042287383 +0000 UTC m=+197.041090376" Jun 08 18:11:36.054478 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:36.054436 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" podStartSLOduration=1.8651244340000002 podStartE2EDuration="4.05442381s" totalImagesPullingTime="2.189299376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:11:36.054174736 +0000 UTC m=+197.052977727" watchObservedRunningTime="2026-06-08 18:11:36.05442381 +0000 UTC m=+197.053226803" Jun 08 18:11:36.805481 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:36.805450 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:36.805632 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:36.805586 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:11:36.805632 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:36.805604 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8ff49454-cfzzs: secret "image-registry-tls" not found Jun 08 18:11:36.805708 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:36.805655 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls podName:c1f0b545-0d46-4e32-a448-0409cdbbd372 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:40.805640186 +0000 UTC m=+201.804443161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls") pod "image-registry-6b8ff49454-cfzzs" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372") : secret "image-registry-tls" not found Jun 08 18:11:36.906204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:36.906169 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:36.906335 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:36.906312 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:40.906297384 +0000 UTC m=+201.905100360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : configmap references non-existent config key: service-ca.crt Jun 08 18:11:36.906381 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:36.906350 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:36.906449 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:36.906437 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 18:11:36.906481 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:36.906473 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:40.906463697 +0000 UTC m=+201.905266667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : secret "router-metrics-certs-default" not found Jun 08 18:11:37.006748 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:37.006726 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:37.006875 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:37.006858 2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:37.006937 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:37.006924 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert podName:5e020b91-3e70-420f-a376-93eeb0a6c2a3 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:41.0069113 +0000 UTC m=+202.005714271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-46fg9" (UID: "5e020b91-3e70-420f-a376-93eeb0a6c2a3") : secret "networking-console-plugin-cert" not found Jun 08 18:11:40.260196 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:40.260162 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc8vp_c9a78d84-1392-4435-8891-c0cf1da0bcbc/dns-node-resolver/0.log" Jun 08 18:11:40.832864 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:40.832830 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:40.833063 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:40.832998 2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:11:40.833063 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:40.833015 2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8ff49454-cfzzs: secret "image-registry-tls" not found Jun 08 18:11:40.833181 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:40.833073 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls podName:c1f0b545-0d46-4e32-a448-0409cdbbd372 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:48.833053526 +0000 UTC m=+209.831856497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls") pod "image-registry-6b8ff49454-cfzzs" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372") : secret "image-registry-tls" not found Jun 08 18:11:40.933677 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:40.933646 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:40.933810 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:40.933696 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:40.933810 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:40.933790 2531 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 18:11:40.933884 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:40.933830 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:48.933816866 +0000 UTC m=+209.932619838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : configmap references non-existent config key: service-ca.crt Jun 08 18:11:40.933884 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:40.933847 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:48.933839905 +0000 UTC m=+209.932642877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : secret "router-metrics-certs-default" not found Jun 08 18:11:41.033986 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:41.033956 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:41.034104 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:41.034088 2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:41.034158 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:41.034145 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert podName:5e020b91-3e70-420f-a376-93eeb0a6c2a3 nodeName:}" failed. No retries permitted until 2026-06-08 18:11:49.034129226 +0000 UTC m=+210.032932197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-46fg9" (UID: "5e020b91-3e70-420f-a376-93eeb0a6c2a3") : secret "networking-console-plugin-cert" not found Jun 08 18:11:41.260205 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:41.260184 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fw95n_918fabd2-131a-4c30-a0be-23ed41a28250/node-ca/0.log" Jun 08 18:11:41.859487 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:41.859457 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghqwp_d659592b-318f-4546-b13b-34d9ae0e99f6/serve-healthcheck-canary/0.log" Jun 08 18:11:48.894724 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:48.894686 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:48.897080 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:48.897058 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"image-registry-6b8ff49454-cfzzs\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:48.901905 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:48.901873 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:48.995506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:48.995448 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:48.995650 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:48.995536 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:48.996171 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:48.995718 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle podName:111698bf-c87a-4ba7-b95e-8cd003d5b568 nodeName:}" failed. No retries permitted until 2026-06-08 18:12:04.995698438 +0000 UTC m=+225.994501426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle") pod "router-default-dc4f597c9-ndwsz" (UID: "111698bf-c87a-4ba7-b95e-8cd003d5b568") : configmap references non-existent config key: service-ca.crt Jun 08 18:11:48.998426 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:48.998400 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/111698bf-c87a-4ba7-b95e-8cd003d5b568-metrics-certs\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:11:49.027780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:49.027754 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8ff49454-cfzzs"] Jun 08 18:11:49.030462 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:11:49.030435 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f0b545_0d46_4e32_a448_0409cdbbd372.slice/crio-d99505c0a5ba7f63c3a08fa9d146faa8a9f041162712da7d67dbb8646e0bae35 WatchSource:0}: Error finding container d99505c0a5ba7f63c3a08fa9d146faa8a9f041162712da7d67dbb8646e0bae35: Status 404 returned error can't find the container with id d99505c0a5ba7f63c3a08fa9d146faa8a9f041162712da7d67dbb8646e0bae35 Jun 08 18:11:49.066217 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:49.066192 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" event={"ID":"c1f0b545-0d46-4e32-a448-0409cdbbd372","Type":"ContainerStarted","Data":"d99505c0a5ba7f63c3a08fa9d146faa8a9f041162712da7d67dbb8646e0bae35"} Jun 08 18:11:49.096009 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:49.095981 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:11:49.096125 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:49.096110 2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:49.096178 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:11:49.096169 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert podName:5e020b91-3e70-420f-a376-93eeb0a6c2a3 nodeName:}" failed. No retries permitted until 2026-06-08 18:12:05.096153179 +0000 UTC m=+226.094956165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-46fg9" (UID: "5e020b91-3e70-420f-a376-93eeb0a6c2a3") : secret "networking-console-plugin-cert" not found Jun 08 18:11:50.070210 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:50.070177 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" event={"ID":"c1f0b545-0d46-4e32-a448-0409cdbbd372","Type":"ContainerStarted","Data":"d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28"} Jun 08 18:11:50.070554 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:50.070231 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:11:50.090846 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:50.090801 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" podStartSLOduration=18.090786867 podStartE2EDuration="18.090786867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:11:50.09010639 +0000 UTC m=+211.088909383" watchObservedRunningTime="2026-06-08 18:11:50.090786867 +0000 UTC m=+211.089589859" Jun 08 18:11:59.255961 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.255928 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-l86gj"] Jun 08 18:11:59.260945 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.260924 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lltvp"] Jun 08 18:11:59.261092 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.261071 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-l86gj" Jun 08 18:11:59.265864 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.265255 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 18:11:59.265864 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.265657 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 18:11:59.266668 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.266051 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-txkzm\"" Jun 08 18:11:59.266668 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.266413 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.270951 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.270931 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b8ff49454-cfzzs"] Jun 08 18:11:59.276751 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.276732 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 18:11:59.276862 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.276758 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 18:11:59.277075 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.277057 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 18:11:59.279137 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.279115 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-l86gj"] Jun 08 18:11:59.279609 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.279588 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 18:11:59.279882 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.279863 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6scsw\"" Jun 08 18:11:59.296332 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.296312 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lltvp"] Jun 08 18:11:59.369208 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.369151 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-data-volume\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.369208 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.369181 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.369208 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.369200 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-crio-socket\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.369352 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.369222 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbztf\" (UniqueName: \"kubernetes.io/projected/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-kube-api-access-pbztf\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.369352 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.369316 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.369352 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.369343 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmlqx\" (UniqueName: \"kubernetes.io/projected/32b04dfa-12c3-4e69-880c-c91eafa6031e-kube-api-access-zmlqx\") pod \"downloads-6657875f97-l86gj\" (UID: \"32b04dfa-12c3-4e69-880c-c91eafa6031e\") " pod="openshift-console/downloads-6657875f97-l86gj" Jun 08 18:11:59.469921 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.469900 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.470038 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.469930 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-crio-socket\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.470038 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.469971 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbztf\" (UniqueName: \"kubernetes.io/projected/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-kube-api-access-pbztf\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.470038 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.470012 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-crio-socket\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.470038 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.470036 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.470264 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.470064 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmlqx\" (UniqueName: \"kubernetes.io/projected/32b04dfa-12c3-4e69-880c-c91eafa6031e-kube-api-access-zmlqx\") pod \"downloads-6657875f97-l86gj\" (UID: \"32b04dfa-12c3-4e69-880c-c91eafa6031e\") " pod="openshift-console/downloads-6657875f97-l86gj" Jun 08 18:11:59.470264 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.470101 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-data-volume\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.470425 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.470403 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-data-volume\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.470514 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.470455 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.472384 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.472359 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.478200 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.478178 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmlqx\" (UniqueName: \"kubernetes.io/projected/32b04dfa-12c3-4e69-880c-c91eafa6031e-kube-api-access-zmlqx\") pod \"downloads-6657875f97-l86gj\" (UID: \"32b04dfa-12c3-4e69-880c-c91eafa6031e\") " pod="openshift-console/downloads-6657875f97-l86gj" Jun 08 18:11:59.478536 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.478519 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbztf\" (UniqueName: \"kubernetes.io/projected/bdd45eda-ac8b-41e5-a0cb-133fae85b0c0-kube-api-access-pbztf\") pod \"insights-runtime-extractor-lltvp\" (UID: \"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0\") " pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.575340 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.575313 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-l86gj" Jun 08 18:11:59.580435 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.580416 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lltvp" Jun 08 18:11:59.706191 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.706162 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-l86gj"] Jun 08 18:11:59.709361 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:11:59.709331 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b04dfa_12c3_4e69_880c_c91eafa6031e.slice/crio-f137fa52e384d8a904d2f48d407cf90bdb0e0aa876d0ffe6cdba1ed903a07215 WatchSource:0}: Error finding container f137fa52e384d8a904d2f48d407cf90bdb0e0aa876d0ffe6cdba1ed903a07215: Status 404 returned error can't find the container with id f137fa52e384d8a904d2f48d407cf90bdb0e0aa876d0ffe6cdba1ed903a07215 Jun 08 18:11:59.735100 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:11:59.735082 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lltvp"] Jun 08 18:11:59.736844 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:11:59.736828 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd45eda_ac8b_41e5_a0cb_133fae85b0c0.slice/crio-06425dd0895ecf8964d7ee7c21d98f1d1438ead097f2c66acdbf26c8d61b6e90 WatchSource:0}: Error finding container 06425dd0895ecf8964d7ee7c21d98f1d1438ead097f2c66acdbf26c8d61b6e90: Status 404 returned error can't find the container with id 06425dd0895ecf8964d7ee7c21d98f1d1438ead097f2c66acdbf26c8d61b6e90 Jun 08 18:12:00.103752 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:00.103721 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lltvp" event={"ID":"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0","Type":"ContainerStarted","Data":"637724a668daaebd5a7b4c31b77417aea89d33778c7ae66fa098ac1abaccf963"} Jun 08 18:12:00.103914 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:00.103776 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lltvp" event={"ID":"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0","Type":"ContainerStarted","Data":"06425dd0895ecf8964d7ee7c21d98f1d1438ead097f2c66acdbf26c8d61b6e90"} Jun 08 18:12:00.104834 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:00.104816 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-l86gj" event={"ID":"32b04dfa-12c3-4e69-880c-c91eafa6031e","Type":"ContainerStarted","Data":"f137fa52e384d8a904d2f48d407cf90bdb0e0aa876d0ffe6cdba1ed903a07215"} Jun 08 18:12:01.111128 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:01.111094 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lltvp" event={"ID":"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0","Type":"ContainerStarted","Data":"22fd7c1c85721a25ece1e2de39f60cf988bdb403690146ee3c1f2458d814515a"} Jun 08 18:12:03.120124 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:03.120085 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lltvp" event={"ID":"bdd45eda-ac8b-41e5-a0cb-133fae85b0c0","Type":"ContainerStarted","Data":"97abbba2d755d646bcc19048b7d7a1e69081ffb76107cf130f9b0c4d0806fe6c"} Jun 08 18:12:03.140734 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:03.140689 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lltvp" podStartSLOduration=1.7286826880000001 podStartE2EDuration="4.140675191s" totalImagesPullingTime="2.411992503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:11:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:03.139729349 +0000 UTC m=+224.138532342" watchObservedRunningTime="2026-06-08 18:12:03.140675191 +0000 UTC m=+224.139478162" Jun 08 18:12:05.014378 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.014347 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:12:05.014882 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.014863 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/111698bf-c87a-4ba7-b95e-8cd003d5b568-service-ca-bundle\") pod \"router-default-dc4f597c9-ndwsz\" (UID: \"111698bf-c87a-4ba7-b95e-8cd003d5b568\") " pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:12:05.114867 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.114833 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:12:05.117436 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.117403 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e020b91-3e70-420f-a376-93eeb0a6c2a3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-46fg9\" (UID: \"5e020b91-3e70-420f-a376-93eeb0a6c2a3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:12:05.278184 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.278123 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:12:05.303983 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.303964 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" Jun 08 18:12:05.427368 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.427340 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dc4f597c9-ndwsz"] Jun 08 18:12:05.429880 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:05.429850 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111698bf_c87a_4ba7_b95e_8cd003d5b568.slice/crio-f73a7706281a606bb560772f266780f5d467ab1adf43dca0b53c3832b69307d6 WatchSource:0}: Error finding container f73a7706281a606bb560772f266780f5d467ab1adf43dca0b53c3832b69307d6: Status 404 returned error can't find the container with id f73a7706281a606bb560772f266780f5d467ab1adf43dca0b53c3832b69307d6 Jun 08 18:12:05.447825 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:05.447801 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9"] Jun 08 18:12:05.450562 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:05.450535 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e020b91_3e70_420f_a376_93eeb0a6c2a3.slice/crio-e71c3c4399ea545cd966861b540fe2ad1b8109930f1e97082b9ccdb13a08b3f9 WatchSource:0}: Error finding container e71c3c4399ea545cd966861b540fe2ad1b8109930f1e97082b9ccdb13a08b3f9: Status 404 returned error can't find the container with id e71c3c4399ea545cd966861b540fe2ad1b8109930f1e97082b9ccdb13a08b3f9 Jun 08 18:12:06.132264 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:06.132227 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" event={"ID":"5e020b91-3e70-420f-a376-93eeb0a6c2a3","Type":"ContainerStarted","Data":"e71c3c4399ea545cd966861b540fe2ad1b8109930f1e97082b9ccdb13a08b3f9"} Jun 08 18:12:06.134478 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:06.134411 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" event={"ID":"111698bf-c87a-4ba7-b95e-8cd003d5b568","Type":"ContainerStarted","Data":"29f1fdc7646417ec298414a41971c2660e112a8e138c90d1ca1b3e6fa0597588"} Jun 08 18:12:06.134478 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:06.134451 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" event={"ID":"111698bf-c87a-4ba7-b95e-8cd003d5b568","Type":"ContainerStarted","Data":"f73a7706281a606bb560772f266780f5d467ab1adf43dca0b53c3832b69307d6"} Jun 08 18:12:06.155490 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:06.155447 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" podStartSLOduration=33.155433205 podStartE2EDuration="33.155433205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:06.154290389 +0000 UTC m=+227.153093382" watchObservedRunningTime="2026-06-08 18:12:06.155433205 +0000 UTC m=+227.154236196" Jun 08 18:12:06.278957 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:06.278924 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:12:06.281542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:06.281520 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:12:07.140182 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:07.140148 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" event={"ID":"5e020b91-3e70-420f-a376-93eeb0a6c2a3","Type":"ContainerStarted","Data":"d2d9f82b8940cde16deecdaed7f48c3b6d006a8cf84d8f6d10959645d4b771bd"} Jun 08 18:12:07.140831 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:07.140486 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:12:07.141774 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:07.141751 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-dc4f597c9-ndwsz" Jun 08 18:12:07.157426 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:07.157377 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-46fg9" podStartSLOduration=32.897795215 podStartE2EDuration="34.157360307s" totalImagesPullingTime="1.259565092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:07.155862172 +0000 UTC m=+228.154665164" watchObservedRunningTime="2026-06-08 18:12:07.157360307 +0000 UTC m=+228.156163301" Jun 08 18:12:09.276090 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:09.276044 2531 patch_prober.go:28] interesting pod/image-registry-6b8ff49454-cfzzs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 18:12:09.276526 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:09.276116 2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" podUID="c1f0b545-0d46-4e32-a448-0409cdbbd372" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:12:12.004507 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.004474 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg"] Jun 08 18:12:12.008485 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.008455 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.012305 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.012276 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 18:12:12.012456 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.012314 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 18:12:12.012456 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.012328 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8qjzs\"" Jun 08 18:12:12.012456 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.012342 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 18:12:12.012720 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.012702 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 18:12:12.012798 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.012777 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 18:12:12.016125 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.016103 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg"] Jun 08 18:12:12.069551 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.069526 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.069719 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.069573 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmtj\" (UniqueName: \"kubernetes.io/projected/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-kube-api-access-pkmtj\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.069719 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.069632 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.069835 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.069749 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.170856 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.170821 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmtj\" (UniqueName: \"kubernetes.io/projected/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-kube-api-access-pkmtj\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.171009 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.170872 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.171009 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.170918 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.171009 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.170961 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.171187 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:12:12.171169 2531 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 08 18:12:12.171263 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:12:12.171252 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-tls podName:23a59b1d-6236-424e-b1b3-76fa75ebb3c5 nodeName:}" failed. No retries permitted until 2026-06-08 18:12:12.671232166 +0000 UTC m=+233.670035146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-mp2zg" (UID: "23a59b1d-6236-424e-b1b3-76fa75ebb3c5") : secret "prometheus-operator-tls" not found Jun 08 18:12:12.171773 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.171740 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.173559 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.173531 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.182294 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.182266 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmtj\" (UniqueName: \"kubernetes.io/projected/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-kube-api-access-pkmtj\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.674774 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.674743 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.676957 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.676930 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a59b1d-6236-424e-b1b3-76fa75ebb3c5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mp2zg\" (UID: \"23a59b1d-6236-424e-b1b3-76fa75ebb3c5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:12.921559 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:12.921525 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" Jun 08 18:12:13.052885 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:13.052860 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg"] Jun 08 18:12:19.275442 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:19.275409 2531 patch_prober.go:28] interesting pod/image-registry-6b8ff49454-cfzzs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 18:12:19.275920 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:19.275470 2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" podUID="c1f0b545-0d46-4e32-a448-0409cdbbd372" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:12:19.828099 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:19.828052 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a59b1d_6236_424e_b1b3_76fa75ebb3c5.slice/crio-b66b30a09ef6be0f339e0d5f4ef084436d119ea4f3d5ea0e109db0bf4a3e0cc5 WatchSource:0}: Error finding container b66b30a09ef6be0f339e0d5f4ef084436d119ea4f3d5ea0e109db0bf4a3e0cc5: Status 404 returned error can't find the container with id b66b30a09ef6be0f339e0d5f4ef084436d119ea4f3d5ea0e109db0bf4a3e0cc5 Jun 08 18:12:20.185358 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:20.185295 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" event={"ID":"23a59b1d-6236-424e-b1b3-76fa75ebb3c5","Type":"ContainerStarted","Data":"b66b30a09ef6be0f339e0d5f4ef084436d119ea4f3d5ea0e109db0bf4a3e0cc5"} Jun 08 18:12:20.187179 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:20.187144 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-l86gj" event={"ID":"32b04dfa-12c3-4e69-880c-c91eafa6031e","Type":"ContainerStarted","Data":"fb034a0125b83c34dae195c28710a821c52f67046127c661336375c5b8f762cc"} Jun 08 18:12:20.187416 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:20.187397 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-l86gj" Jun 08 18:12:20.200240 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:20.200217 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-l86gj" Jun 08 18:12:20.206041 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:20.205997 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-l86gj" podStartSLOduration=1.023117531 podStartE2EDuration="21.205983742s" totalImagesPullingTime="20.182866211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:20.204117591 +0000 UTC m=+241.202920587" watchObservedRunningTime="2026-06-08 18:12:20.205983742 +0000 UTC m=+241.204786735" Jun 08 18:12:22.197499 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:22.197442 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" event={"ID":"23a59b1d-6236-424e-b1b3-76fa75ebb3c5","Type":"ContainerStarted","Data":"8f0b49f96bd45c2a3fa2b53ac0bfe1c5d460be280879e35635fba6b63bfd892d"} Jun 08 18:12:22.197970 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:22.197570 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" event={"ID":"23a59b1d-6236-424e-b1b3-76fa75ebb3c5","Type":"ContainerStarted","Data":"3da8477289d430de921192790fca97ea8829f6ea61c722cffbf71324f44ccf12"} Jun 08 18:12:22.213013 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:22.212968 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mp2zg" podStartSLOduration=9.598998451 podStartE2EDuration="11.212953869s" totalImagesPullingTime="1.613955418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:22.212796714 +0000 UTC m=+243.211599708" watchObservedRunningTime="2026-06-08 18:12:22.212953869 +0000 UTC m=+243.211756918" Jun 08 18:12:24.291753 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.291710 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" podUID="c1f0b545-0d46-4e32-a448-0409cdbbd372" containerName="registry" containerID="cri-o://d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28" gracePeriod=30 Jun 08 18:12:24.300317 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.300290 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq"] Jun 08 18:12:24.336050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.335977 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq"] Jun 08 18:12:24.336050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.336030 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6jtt4"] Jun 08 18:12:24.336213 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.336111 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.338589 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.338567 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 18:12:24.338683 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.338567 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 18:12:24.338683 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.338568 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dfnvn\"" Jun 08 18:12:24.363597 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.363573 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.366240 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.366204 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghvp2\"" Jun 08 18:12:24.366335 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.366259 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 18:12:24.366660 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.366639 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 18:12:24.366725 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.366699 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 18:12:24.466545 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466513 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.466700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466577 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-tls\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.466700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466605 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-wtmp\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.466700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466660 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a874e7e-6bad-4cea-8249-ba9af63129cc-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.466850 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466709 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44b141da-2219-415e-aa79-ca02bac365ae-metrics-client-ca\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.466850 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466738 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4nw5\" (UniqueName: \"kubernetes.io/projected/7a874e7e-6bad-4cea-8249-ba9af63129cc-kube-api-access-g4nw5\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.466850 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466780 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a874e7e-6bad-4cea-8249-ba9af63129cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.466850 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466814 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.467070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466884 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgnxl\" (UniqueName: \"kubernetes.io/projected/44b141da-2219-415e-aa79-ca02bac365ae-kube-api-access-xgnxl\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.467070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466935 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-root\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.467070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.466972 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a874e7e-6bad-4cea-8249-ba9af63129cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.467070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.467007 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-sys\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.467070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.467027 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-textfile\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568086 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568015 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44b141da-2219-415e-aa79-ca02bac365ae-metrics-client-ca\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568086 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568072 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4nw5\" (UniqueName: \"kubernetes.io/projected/7a874e7e-6bad-4cea-8249-ba9af63129cc-kube-api-access-g4nw5\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.568276 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568119 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a874e7e-6bad-4cea-8249-ba9af63129cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.568276 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568154 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568276 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568193 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgnxl\" (UniqueName: \"kubernetes.io/projected/44b141da-2219-415e-aa79-ca02bac365ae-kube-api-access-xgnxl\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568276 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568215 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-root\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568276 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568249 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a874e7e-6bad-4cea-8249-ba9af63129cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.568276 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568275 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-sys\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568570 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568300 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-textfile\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568570 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568329 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568570 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568354 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-tls\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568570 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568374 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-wtmp\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.568570 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568419 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a874e7e-6bad-4cea-8249-ba9af63129cc-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.568760 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.568665 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44b141da-2219-415e-aa79-ca02bac365ae-metrics-client-ca\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.569012 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-sys\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.569017 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-textfile\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:12:24.569126 2531 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.569172 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a874e7e-6bad-4cea-8249-ba9af63129cc-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:12:24.569180 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-tls podName:44b141da-2219-415e-aa79-ca02bac365ae nodeName:}" failed. No retries permitted until 2026-06-08 18:12:25.06916146 +0000 UTC m=+246.067964456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-tls") pod "node-exporter-6jtt4" (UID: "44b141da-2219-415e-aa79-ca02bac365ae") : secret "node-exporter-tls" not found Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.569261 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.569317 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-wtmp\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.569386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.569321 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44b141da-2219-415e-aa79-ca02bac365ae-root\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.574402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.572275 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a874e7e-6bad-4cea-8249-ba9af63129cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.574402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.572345 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a874e7e-6bad-4cea-8249-ba9af63129cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.574402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.572865 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.574402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.573175 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:12:24.576530 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.576487 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4nw5\" (UniqueName: \"kubernetes.io/projected/7a874e7e-6bad-4cea-8249-ba9af63129cc-kube-api-access-g4nw5\") pod \"openshift-state-metrics-65f78d5c66-zvqvq\" (UID: \"7a874e7e-6bad-4cea-8249-ba9af63129cc\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.577696 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.577672 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgnxl\" (UniqueName: \"kubernetes.io/projected/44b141da-2219-415e-aa79-ca02bac365ae-kube-api-access-xgnxl\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:24.668878 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.668850 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-installation-pull-secrets\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669017 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.668906 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669017 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.668961 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-image-registry-private-configuration\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669017 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.668993 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-trusted-ca\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669170 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.669029 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1f0b545-0d46-4e32-a448-0409cdbbd372-ca-trust-extracted\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669170 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.669056 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-bound-sa-token\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669170 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.669096 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-certificates\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669170 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.669133 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh7bn\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-kube-api-access-gh7bn\") pod \"c1f0b545-0d46-4e32-a448-0409cdbbd372\" (UID: \"c1f0b545-0d46-4e32-a448-0409cdbbd372\") " Jun 08 18:12:24.669590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.669556 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:12:24.670070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.670026 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:12:24.671631 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.671568 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:12:24.671631 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.671572 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:12:24.671783 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.671635 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-kube-api-access-gh7bn" (OuterVolumeSpecName: "kube-api-access-gh7bn") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "kube-api-access-gh7bn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:12:24.672561 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.672531 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:12:24.672696 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.672679 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:12:24.681676 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.681655 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f0b545-0d46-4e32-a448-0409cdbbd372-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c1f0b545-0d46-4e32-a448-0409cdbbd372" (UID: "c1f0b545-0d46-4e32-a448-0409cdbbd372"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:12:24.690871 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.690847 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770718 2531 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-image-registry-private-configuration\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770753 2531 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-trusted-ca\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770769 2531 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1f0b545-0d46-4e32-a448-0409cdbbd372-ca-trust-extracted\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770783 2531 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-bound-sa-token\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770797 2531 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-certificates\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770811 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh7bn\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-kube-api-access-gh7bn\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770823 2531 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1f0b545-0d46-4e32-a448-0409cdbbd372-installation-pull-secrets\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.770860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.770836 2531 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1f0b545-0d46-4e32-a448-0409cdbbd372-registry-tls\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:12:24.852624 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:24.852599 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq"] Jun 08 18:12:24.855395 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:24.855367 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a874e7e_6bad_4cea_8249_ba9af63129cc.slice/crio-759c40bd0662dd28bd97141745690c43f4499130ce3cc5a7c825dfaf24452128 WatchSource:0}: Error finding container 759c40bd0662dd28bd97141745690c43f4499130ce3cc5a7c825dfaf24452128: Status 404 returned error can't find the container with id 759c40bd0662dd28bd97141745690c43f4499130ce3cc5a7c825dfaf24452128 Jun 08 18:12:25.072267 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.072235 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-tls\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:25.074612 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.074591 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44b141da-2219-415e-aa79-ca02bac365ae-node-exporter-tls\") pod \"node-exporter-6jtt4\" (UID: \"44b141da-2219-415e-aa79-ca02bac365ae\") " pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:25.213939 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.213855 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" event={"ID":"7a874e7e-6bad-4cea-8249-ba9af63129cc","Type":"ContainerStarted","Data":"3c698051a92f7a2c10d2cc006d830b326d9590b6cc090956874ec3a26a42a6e6"} Jun 08 18:12:25.213939 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.213936 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" event={"ID":"7a874e7e-6bad-4cea-8249-ba9af63129cc","Type":"ContainerStarted","Data":"dd2d971baa5d6a9856869666e2a98cc934dd3381e745c5effea62987b6451f49"} Jun 08 18:12:25.214127 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.213965 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" event={"ID":"7a874e7e-6bad-4cea-8249-ba9af63129cc","Type":"ContainerStarted","Data":"759c40bd0662dd28bd97141745690c43f4499130ce3cc5a7c825dfaf24452128"} Jun 08 18:12:25.215227 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.215197 2531 generic.go:356] "Generic (PLEG): container finished" podID="c1f0b545-0d46-4e32-a448-0409cdbbd372" containerID="d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28" exitCode=0 Jun 08 18:12:25.215346 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.215250 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" Jun 08 18:12:25.215346 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.215283 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" event={"ID":"c1f0b545-0d46-4e32-a448-0409cdbbd372","Type":"ContainerDied","Data":"d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28"} Jun 08 18:12:25.215346 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.215326 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8ff49454-cfzzs" event={"ID":"c1f0b545-0d46-4e32-a448-0409cdbbd372","Type":"ContainerDied","Data":"d99505c0a5ba7f63c3a08fa9d146faa8a9f041162712da7d67dbb8646e0bae35"} Jun 08 18:12:25.215498 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.215353 2531 scope.go:117] "RemoveContainer" containerID="d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28" Jun 08 18:12:25.226185 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.226160 2531 scope.go:117] "RemoveContainer" containerID="d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28" Jun 08 18:12:25.226946 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:12:25.226869 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28\": container with ID starting with d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28 not found: ID does not exist" containerID="d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28" Jun 08 18:12:25.227047 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.226976 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28"} err="failed to get container status \"d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28\": rpc error: code = NotFound desc = could not find container \"d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28\": container with ID starting with d0d20da472a92e76a2098680f6ae127359b8285517c29f61e787405731bf0b28 not found: ID does not exist" Jun 08 18:12:25.243697 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.243670 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b8ff49454-cfzzs"] Jun 08 18:12:25.245707 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.245686 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b8ff49454-cfzzs"] Jun 08 18:12:25.297329 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.297301 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6jtt4" Jun 08 18:12:25.321092 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:25.321060 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b141da_2219_415e_aa79_ca02bac365ae.slice/crio-529551a6bcbe865a6f952da5c886f2099f851b1e6b078019b26e5500968e7604 WatchSource:0}: Error finding container 529551a6bcbe865a6f952da5c886f2099f851b1e6b078019b26e5500968e7604: Status 404 returned error can't find the container with id 529551a6bcbe865a6f952da5c886f2099f851b1e6b078019b26e5500968e7604 Jun 08 18:12:25.461595 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:25.461561 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1f0b545-0d46-4e32-a448-0409cdbbd372" path="/var/lib/kubelet/pods/c1f0b545-0d46-4e32-a448-0409cdbbd372/volumes" Jun 08 18:12:26.222410 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:26.222369 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jtt4" event={"ID":"44b141da-2219-415e-aa79-ca02bac365ae","Type":"ContainerStarted","Data":"529551a6bcbe865a6f952da5c886f2099f851b1e6b078019b26e5500968e7604"} Jun 08 18:12:28.232481 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.232443 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" event={"ID":"7a874e7e-6bad-4cea-8249-ba9af63129cc","Type":"ContainerStarted","Data":"4ab9747961f93f4adf902b4a903c9a8e5221ede79719928e54c3b2dfd29428d8"} Jun 08 18:12:28.234339 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.234313 2531 generic.go:356] "Generic (PLEG): container finished" podID="44b141da-2219-415e-aa79-ca02bac365ae" containerID="345bb75092b02799b303f3a3c99a1ea892319306273a811583b153610f8821bc" exitCode=0 Jun 08 18:12:28.234472 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.234354 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jtt4" event={"ID":"44b141da-2219-415e-aa79-ca02bac365ae","Type":"ContainerDied","Data":"345bb75092b02799b303f3a3c99a1ea892319306273a811583b153610f8821bc"} Jun 08 18:12:28.251101 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.251061 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zvqvq" podStartSLOduration=2.247519074 podStartE2EDuration="4.25104646s" totalImagesPullingTime="2.003527386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:28.249213328 +0000 UTC m=+249.248016321" watchObservedRunningTime="2026-06-08 18:12:28.25104646 +0000 UTC m=+249.249849455" Jun 08 18:12:28.637713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.637669 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cd795b4d-q2t8z"] Jun 08 18:12:28.638091 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.638071 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1f0b545-0d46-4e32-a448-0409cdbbd372" containerName="registry" Jun 08 18:12:28.638091 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.638091 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1f0b545-0d46-4e32-a448-0409cdbbd372" containerName="registry" Jun 08 18:12:28.638275 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.638173 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1f0b545-0d46-4e32-a448-0409cdbbd372" containerName="registry" Jun 08 18:12:28.660253 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.660227 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd795b4d-q2t8z"] Jun 08 18:12:28.660378 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.660356 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.662957 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.662916 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 18:12:28.663119 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.663094 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2fgbqrsgjj3bi\"" Jun 08 18:12:28.663233 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.663171 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 08 18:12:28.663307 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.663259 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 08 18:12:28.663307 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.663102 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n8ldj\"" Jun 08 18:12:28.663443 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.663370 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 08 18:12:28.801956 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.801925 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-metrics-server-audit-profiles\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.802088 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.801984 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-secret-metrics-server-client-certs\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.802088 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.802051 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62pk9\" (UniqueName: \"kubernetes.io/projected/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-kube-api-access-62pk9\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.802185 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.802114 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-client-ca-bundle\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.802185 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.802149 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-secret-metrics-server-tls\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.802263 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.802205 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-audit-log\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.802297 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.802270 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903118 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903056 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-secret-metrics-server-client-certs\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903118 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903095 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62pk9\" (UniqueName: \"kubernetes.io/projected/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-kube-api-access-62pk9\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903137 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-client-ca-bundle\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903164 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-secret-metrics-server-tls\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903199 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-audit-log\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903243 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903275 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-metrics-server-audit-profiles\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.903692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.903663 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-audit-log\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.904136 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.904109 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.904322 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.904301 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-metrics-server-audit-profiles\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.905535 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.905508 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-secret-metrics-server-client-certs\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.905614 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.905572 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-client-ca-bundle\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.905614 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.905596 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-secret-metrics-server-tls\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.911753 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.911733 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62pk9\" (UniqueName: \"kubernetes.io/projected/dc8967cf-4811-4ad1-88aa-ea2cbb529f45-kube-api-access-62pk9\") pod \"metrics-server-7cd795b4d-q2t8z\" (UID: \"dc8967cf-4811-4ad1-88aa-ea2cbb529f45\") " pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:28.971232 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:28.971209 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:29.141752 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.141724 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq"] Jun 08 18:12:29.146235 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:29.146210 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8967cf_4811_4ad1_88aa_ea2cbb529f45.slice/crio-8c931d3f43f946c2810cf324ef451aa49b2d97590717c60c636959e363d5b5aa WatchSource:0}: Error finding container 8c931d3f43f946c2810cf324ef451aa49b2d97590717c60c636959e363d5b5aa: Status 404 returned error can't find the container with id 8c931d3f43f946c2810cf324ef451aa49b2d97590717c60c636959e363d5b5aa Jun 08 18:12:29.171063 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.170998 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd795b4d-q2t8z"] Jun 08 18:12:29.171063 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.171044 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq"] Jun 08 18:12:29.171218 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.171130 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:29.174340 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.174323 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vlwzv\"" Jun 08 18:12:29.175132 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.175116 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 18:12:29.201007 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.200988 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69cdc5b95c-w7bq9"] Jun 08 18:12:29.219916 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.219878 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cdc5b95c-w7bq9"] Jun 08 18:12:29.220024 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.219969 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.222377 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.222349 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 18:12:29.222588 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.222568 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 18:12:29.222937 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.222917 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5mf6x\"" Jun 08 18:12:29.223143 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.223120 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 18:12:29.223143 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.223133 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 18:12:29.223274 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.223152 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 18:12:29.228642 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.228624 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 18:12:29.239610 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.239581 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jtt4" event={"ID":"44b141da-2219-415e-aa79-ca02bac365ae","Type":"ContainerStarted","Data":"7b6f8156b51171a3edbfc0d7f3b2af84e99c6941439c5f3cf960f07a7e76e008"} Jun 08 18:12:29.239975 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.239624 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jtt4" event={"ID":"44b141da-2219-415e-aa79-ca02bac365ae","Type":"ContainerStarted","Data":"50a3a60ff984acf0a1842ca2810aae7ff217cc54890012222f6788a6064875c9"} Jun 08 18:12:29.240788 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.240772 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" event={"ID":"dc8967cf-4811-4ad1-88aa-ea2cbb529f45","Type":"ContainerStarted","Data":"8c931d3f43f946c2810cf324ef451aa49b2d97590717c60c636959e363d5b5aa"} Jun 08 18:12:29.260799 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.260761 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6jtt4" podStartSLOduration=3.35954399 podStartE2EDuration="5.260748666s" totalImagesPullingTime="1.781534684s" totalInitContainerRuntime="119.669992ms" isStatefulPod=true podCreationTimestamp="2026-06-08 18:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:29.25930144 +0000 UTC m=+250.258104433" watchObservedRunningTime="2026-06-08 18:12:29.260748666 +0000 UTC m=+250.259551658" Jun 08 18:12:29.307203 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307180 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-console-config\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.307297 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307215 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptj4m\" (UniqueName: \"kubernetes.io/projected/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-kube-api-access-ptj4m\") pod \"monitoring-plugin-76b68cc874-qrmfq\" (UID: \"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:29.307297 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307236 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-serving-cert\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.307297 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307254 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gw6r\" (UniqueName: \"kubernetes.io/projected/4902e200-b943-4638-ae19-bca3980d934b-kube-api-access-2gw6r\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.307422 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307315 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qrmfq\" (UID: \"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:29.307422 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307343 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-service-ca\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.307422 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307361 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-trusted-ca-bundle\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.307422 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307418 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-oauth-serving-cert\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.307546 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.307441 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-oauth-config\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.408095 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408075 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptj4m\" (UniqueName: \"kubernetes.io/projected/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-kube-api-access-ptj4m\") pod \"monitoring-plugin-76b68cc874-qrmfq\" (UID: \"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:29.408194 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408104 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-serving-cert\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.408194 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408143 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gw6r\" (UniqueName: \"kubernetes.io/projected/4902e200-b943-4638-ae19-bca3980d934b-kube-api-access-2gw6r\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.408506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408488 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qrmfq\" (UID: \"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:29.408604 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408518 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-service-ca\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.408604 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408543 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-trusted-ca-bundle\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.408604 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:12:29.408575 2531 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 18:12:29.408758 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:12:29.408629 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-monitoring-plugin-cert podName:48fd8a57-cbdb-4b6e-9962-cbe9f567de3c nodeName:}" failed. No retries permitted until 2026-06-08 18:12:29.908607631 +0000 UTC m=+250.907410606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-qrmfq" (UID: "48fd8a57-cbdb-4b6e-9962-cbe9f567de3c") : secret "monitoring-plugin-cert" not found Jun 08 18:12:29.408758 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408723 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-oauth-serving-cert\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.408935 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.408915 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-oauth-config\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.409025 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.409005 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-console-config\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.409378 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.409354 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-service-ca\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.409378 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.409366 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-oauth-serving-cert\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.409583 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.409565 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-console-config\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.409783 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.409766 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-trusted-ca-bundle\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.410678 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.410658 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-serving-cert\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.411025 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.411010 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-oauth-config\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.419226 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.419204 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gw6r\" (UniqueName: \"kubernetes.io/projected/4902e200-b943-4638-ae19-bca3980d934b-kube-api-access-2gw6r\") pod \"console-69cdc5b95c-w7bq9\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.419363 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.419347 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptj4m\" (UniqueName: \"kubernetes.io/projected/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-kube-api-access-ptj4m\") pod \"monitoring-plugin-76b68cc874-qrmfq\" (UID: \"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:29.530568 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.530522 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:29.670323 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.670297 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cdc5b95c-w7bq9"] Jun 08 18:12:29.673202 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:29.673176 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4902e200_b943_4638_ae19_bca3980d934b.slice/crio-0854116ed7eaeb1c3f1726622b972d4bb72b60a1b75af0131a6607d6840791de WatchSource:0}: Error finding container 0854116ed7eaeb1c3f1726622b972d4bb72b60a1b75af0131a6607d6840791de: Status 404 returned error can't find the container with id 0854116ed7eaeb1c3f1726622b972d4bb72b60a1b75af0131a6607d6840791de Jun 08 18:12:29.914284 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.914253 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qrmfq\" (UID: \"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:29.916816 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:29.916792 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48fd8a57-cbdb-4b6e-9962-cbe9f567de3c-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qrmfq\" (UID: \"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:30.080175 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:30.080155 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:30.226192 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:30.226046 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq"] Jun 08 18:12:30.228617 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:30.228591 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fd8a57_cbdb_4b6e_9962_cbe9f567de3c.slice/crio-9d0d0ac01e537c3a1e63d4aef873ee97b2b2e235e8bdc0f730358b5ff4ce9732 WatchSource:0}: Error finding container 9d0d0ac01e537c3a1e63d4aef873ee97b2b2e235e8bdc0f730358b5ff4ce9732: Status 404 returned error can't find the container with id 9d0d0ac01e537c3a1e63d4aef873ee97b2b2e235e8bdc0f730358b5ff4ce9732 Jun 08 18:12:30.246419 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:30.246390 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdc5b95c-w7bq9" event={"ID":"4902e200-b943-4638-ae19-bca3980d934b","Type":"ContainerStarted","Data":"0854116ed7eaeb1c3f1726622b972d4bb72b60a1b75af0131a6607d6840791de"} Jun 08 18:12:30.248958 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:30.248925 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" event={"ID":"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c","Type":"ContainerStarted","Data":"9d0d0ac01e537c3a1e63d4aef873ee97b2b2e235e8bdc0f730358b5ff4ce9732"} Jun 08 18:12:31.328683 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:31.328649 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:12:31.331110 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:31.331088 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b19a021f-4a9c-4916-89c4-de834fc39272-metrics-certs\") pod \"network-metrics-daemon-ctgvc\" (UID: \"b19a021f-4a9c-4916-89c4-de834fc39272\") " pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:12:31.460011 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:31.459983 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gzst\"" Jun 08 18:12:31.467962 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:31.467936 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ctgvc" Jun 08 18:12:31.711671 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:31.711626 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ctgvc"] Jun 08 18:12:32.260885 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:32.260787 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" event={"ID":"dc8967cf-4811-4ad1-88aa-ea2cbb529f45","Type":"ContainerStarted","Data":"34a99f8ec0c2e2dd239aee1523c4e652ecc5edb9470602154251eecefb59eeb6"} Jun 08 18:12:32.285538 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:32.285490 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" podStartSLOduration=1.8606776219999999 podStartE2EDuration="4.285474158s" totalImagesPullingTime="2.424796536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:32.284520878 +0000 UTC m=+253.283323872" watchObservedRunningTime="2026-06-08 18:12:32.285474158 +0000 UTC m=+253.284277151" Jun 08 18:12:32.934207 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:12:32.934168 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19a021f_4a9c_4916_89c4_de834fc39272.slice/crio-b59800a11b6fc5ada6b4f1f89824c7c726bb82f7e3c827f54f9a63897c5af92f WatchSource:0}: Error finding container b59800a11b6fc5ada6b4f1f89824c7c726bb82f7e3c827f54f9a63897c5af92f: Status 404 returned error can't find the container with id b59800a11b6fc5ada6b4f1f89824c7c726bb82f7e3c827f54f9a63897c5af92f Jun 08 18:12:33.265168 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:33.265096 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctgvc" event={"ID":"b19a021f-4a9c-4916-89c4-de834fc39272","Type":"ContainerStarted","Data":"b59800a11b6fc5ada6b4f1f89824c7c726bb82f7e3c827f54f9a63897c5af92f"} Jun 08 18:12:34.270410 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:34.270371 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdc5b95c-w7bq9" event={"ID":"4902e200-b943-4638-ae19-bca3980d934b","Type":"ContainerStarted","Data":"2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b"} Jun 08 18:12:34.271762 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:34.271735 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" event={"ID":"48fd8a57-cbdb-4b6e-9962-cbe9f567de3c","Type":"ContainerStarted","Data":"f0ecd074dd4f1b7daf3e95288caff224b282899faa6104c322bdf9ce48a5a77d"} Jun 08 18:12:34.271929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:34.271912 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:34.276781 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:34.276763 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" Jun 08 18:12:34.287759 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:34.287725 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69cdc5b95c-w7bq9" podStartSLOduration=1.182078023 podStartE2EDuration="5.287712287s" totalImagesPullingTime="4.105634264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:34.286657263 +0000 UTC m=+255.285460257" watchObservedRunningTime="2026-06-08 18:12:34.287712287 +0000 UTC m=+255.286515280" Jun 08 18:12:34.300403 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:34.300365 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrmfq" podStartSLOduration=1.746947659 podStartE2EDuration="5.300354161s" totalImagesPullingTime="3.553406502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:34.299731282 +0000 UTC m=+255.298534267" watchObservedRunningTime="2026-06-08 18:12:34.300354161 +0000 UTC m=+255.299157154" Jun 08 18:12:35.278029 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:35.277988 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctgvc" event={"ID":"b19a021f-4a9c-4916-89c4-de834fc39272","Type":"ContainerStarted","Data":"2e02bc412a74528f7b7d3d1a8febe234ff2ec9ee09181a657beb269d47ea16b3"} Jun 08 18:12:35.278459 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:35.278050 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ctgvc" event={"ID":"b19a021f-4a9c-4916-89c4-de834fc39272","Type":"ContainerStarted","Data":"2efc5eedf182bfc88959523de2a8cc2e5616548f4126bcea0496a0fd0730f070"} Jun 08 18:12:35.296154 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:35.296110 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ctgvc" podStartSLOduration=254.583657192 podStartE2EDuration="4m16.296094539s" totalImagesPullingTime="1.712437347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:35.294476684 +0000 UTC m=+256.293279677" watchObservedRunningTime="2026-06-08 18:12:35.296094539 +0000 UTC m=+256.294897531" Jun 08 18:12:39.531328 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:39.531298 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:39.531772 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:39.531347 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:12:39.532781 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:39.532755 2531 patch_prober.go:28] interesting pod/console-69cdc5b95c-w7bq9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 08 18:12:39.532931 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:39.532798 2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69cdc5b95c-w7bq9" podUID="4902e200-b943-4638-ae19-bca3980d934b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 08 18:12:48.971759 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:48.971727 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:48.972141 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:48.971787 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:12:49.531667 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:49.531634 2531 patch_prober.go:28] interesting pod/console-69cdc5b95c-w7bq9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 08 18:12:49.531830 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:49.531682 2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69cdc5b95c-w7bq9" podUID="4902e200-b943-4638-ae19-bca3980d934b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 08 18:12:57.358521 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:57.358480 2531 generic.go:356] "Generic (PLEG): container finished" podID="e2759a52-72d2-4522-8472-b521452005e7" containerID="bf5f6efdf7f910f51f3d0b201e551804bc8cbe90285a60c5489aca0946cc23a0" exitCode=0 Jun 08 18:12:57.358958 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:57.358553 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" event={"ID":"e2759a52-72d2-4522-8472-b521452005e7","Type":"ContainerDied","Data":"bf5f6efdf7f910f51f3d0b201e551804bc8cbe90285a60c5489aca0946cc23a0"} Jun 08 18:12:57.358958 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:57.358864 2531 scope.go:117] "RemoveContainer" containerID="bf5f6efdf7f910f51f3d0b201e551804bc8cbe90285a60c5489aca0946cc23a0" Jun 08 18:12:58.364192 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:58.364155 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b6qpb" event={"ID":"e2759a52-72d2-4522-8472-b521452005e7","Type":"ContainerStarted","Data":"6b933a49b1d76579d15906fd5cd2c342cd93f6fbe3217677d9149c56313f5cfd"} Jun 08 18:12:59.531392 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:59.531312 2531 patch_prober.go:28] interesting pod/console-69cdc5b95c-w7bq9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 08 18:12:59.531392 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:12:59.531355 2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69cdc5b95c-w7bq9" podUID="4902e200-b943-4638-ae19-bca3980d934b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 08 18:13:01.921677 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:13:01.921633 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6972p" podUID="1aef15f4-46bd-4fc0-b279-91d04b397685" Jun 08 18:13:02.378762 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:02.378737 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6972p" Jun 08 18:13:04.953402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:04.953371 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:13:04.955763 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:04.955738 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aef15f4-46bd-4fc0-b279-91d04b397685-metrics-tls\") pod \"dns-default-6972p\" (UID: \"1aef15f4-46bd-4fc0-b279-91d04b397685\") " pod="openshift-dns/dns-default-6972p" Jun 08 18:13:05.081849 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:05.081822 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdrdq\"" Jun 08 18:13:05.089968 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:05.089949 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6972p" Jun 08 18:13:05.226444 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:05.226423 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6972p"] Jun 08 18:13:05.228185 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:13:05.228162 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aef15f4_46bd_4fc0_b279_91d04b397685.slice/crio-ffad015749dd0207598d321814409c9d9252ed62f763931fd4437d1ecc43169f WatchSource:0}: Error finding container ffad015749dd0207598d321814409c9d9252ed62f763931fd4437d1ecc43169f: Status 404 returned error can't find the container with id ffad015749dd0207598d321814409c9d9252ed62f763931fd4437d1ecc43169f Jun 08 18:13:05.390807 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:05.390771 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6972p" event={"ID":"1aef15f4-46bd-4fc0-b279-91d04b397685","Type":"ContainerStarted","Data":"ffad015749dd0207598d321814409c9d9252ed62f763931fd4437d1ecc43169f"} Jun 08 18:13:06.396963 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:06.396927 2531 generic.go:356] "Generic (PLEG): container finished" podID="f7afd015-1bf5-422a-b892-c453b13c4004" containerID="764d40f97e8b271bb8ccdeba4f06c76d31df526a6dc0c70ebdf7af6e02a223f8" exitCode=1 Jun 08 18:13:06.397413 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:06.397002 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" event={"ID":"f7afd015-1bf5-422a-b892-c453b13c4004","Type":"ContainerDied","Data":"764d40f97e8b271bb8ccdeba4f06c76d31df526a6dc0c70ebdf7af6e02a223f8"} Jun 08 18:13:06.397413 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:06.397063 2531 scope.go:117] "RemoveContainer" containerID="9b91789cbd9eba6f00f8156a6f4746c09f8b03740255d71180bf46fa61a27e54" Jun 08 18:13:06.397413 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:06.397380 2531 scope.go:117] "RemoveContainer" containerID="764d40f97e8b271bb8ccdeba4f06c76d31df526a6dc0c70ebdf7af6e02a223f8" Jun 08 18:13:06.397598 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:13:06.397571 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fb7c6b48f-vpkjx_open-cluster-management-agent-addon(f7afd015-1bf5-422a-b892-c453b13c4004)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" podUID="f7afd015-1bf5-422a-b892-c453b13c4004" Jun 08 18:13:06.942906 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:06.942862 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:13:07.402285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:07.402234 2531 scope.go:117] "RemoveContainer" containerID="764d40f97e8b271bb8ccdeba4f06c76d31df526a6dc0c70ebdf7af6e02a223f8" Jun 08 18:13:07.402597 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:13:07.402429 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fb7c6b48f-vpkjx_open-cluster-management-agent-addon(f7afd015-1bf5-422a-b892-c453b13c4004)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" podUID="f7afd015-1bf5-422a-b892-c453b13c4004" Jun 08 18:13:07.403326 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:07.403307 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6972p" event={"ID":"1aef15f4-46bd-4fc0-b279-91d04b397685","Type":"ContainerStarted","Data":"dec7a215e33dc4e221bda6d45425a33ab68ec9d0443b1dcdbc62311b6b7a1cf4"} Jun 08 18:13:08.408511 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:08.408475 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6972p" event={"ID":"1aef15f4-46bd-4fc0-b279-91d04b397685","Type":"ContainerStarted","Data":"6bb70e7742bb082fc45418428f3c6bc7587063b619e081982a42212e302396bb"} Jun 08 18:13:08.408874 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:08.408609 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6972p" Jun 08 18:13:08.425317 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:08.425273 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6972p" podStartSLOduration=252.508130469 podStartE2EDuration="4m14.42525615s" totalImagesPullingTime="1.917125681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:13:08.424267258 +0000 UTC m=+289.423070251" watchObservedRunningTime="2026-06-08 18:13:08.42525615 +0000 UTC m=+289.424059142" Jun 08 18:13:08.976992 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:08.976963 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:13:08.980819 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:08.980798 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cd795b4d-q2t8z" Jun 08 18:13:09.535349 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:09.535321 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:13:09.538953 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:09.538932 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:13:10.847999 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:10.847962 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:13:10.848475 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:10.848402 2531 scope.go:117] "RemoveContainer" containerID="764d40f97e8b271bb8ccdeba4f06c76d31df526a6dc0c70ebdf7af6e02a223f8" Jun 08 18:13:10.848596 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:13:10.848573 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fb7c6b48f-vpkjx_open-cluster-management-agent-addon(f7afd015-1bf5-422a-b892-c453b13c4004)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" podUID="f7afd015-1bf5-422a-b892-c453b13c4004" Jun 08 18:13:18.414105 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:18.414073 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6972p" Jun 08 18:13:19.413687 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:19.413664 2531 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 18:13:23.456318 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:23.456285 2531 scope.go:117] "RemoveContainer" containerID="764d40f97e8b271bb8ccdeba4f06c76d31df526a6dc0c70ebdf7af6e02a223f8" Jun 08 18:13:24.472682 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:24.472648 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" event={"ID":"f7afd015-1bf5-422a-b892-c453b13c4004","Type":"ContainerStarted","Data":"08b81c3958595f27e3e1379bf034b1336b520e61d82210cfd36cd2bf7e7110d1"} Jun 08 18:13:24.473121 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:24.472911 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:13:24.474479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:24.474456 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fb7c6b48f-vpkjx" Jun 08 18:13:48.770185 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.770146 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-585c86fb59-twnf9"] Jun 08 18:13:48.773108 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.773092 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.775480 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.775458 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jnm9q\"" Jun 08 18:13:48.776149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.775737 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 18:13:48.776908 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.775841 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 18:13:48.776908 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.776517 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 18:13:48.776908 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.776737 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 18:13:48.776908 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.776086 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 18:13:48.781086 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.780796 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 18:13:48.785281 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.785258 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-585c86fb59-twnf9"] Jun 08 18:13:48.845090 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845061 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.845205 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845101 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.845205 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845158 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-secret-telemeter-client\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.845205 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845190 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-federate-client-tls\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.845308 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845246 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npk6b\" (UniqueName: \"kubernetes.io/projected/7aea3699-3b83-4629-a9ae-9e19d78206dc-kube-api-access-npk6b\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.845308 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845284 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-telemeter-client-tls\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.845308 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845302 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-metrics-client-ca\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.845398 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.845321 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-serving-certs-ca-bundle\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.945858 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.945834 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-secret-telemeter-client\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.945986 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.945862 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-federate-client-tls\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.945986 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.945884 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npk6b\" (UniqueName: \"kubernetes.io/projected/7aea3699-3b83-4629-a9ae-9e19d78206dc-kube-api-access-npk6b\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.946057 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946015 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-telemeter-client-tls\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.946103 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946053 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-metrics-client-ca\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.946138 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946100 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-serving-certs-ca-bundle\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.946138 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946130 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.946233 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946173 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.946841 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946817 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-metrics-client-ca\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.946953 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946842 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-serving-certs-ca-bundle\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.947016 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.946993 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aea3699-3b83-4629-a9ae-9e19d78206dc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.948619 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.948586 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.948703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.948596 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-telemeter-client-tls\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.948764 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.948747 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-federate-client-tls\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.948801 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.948773 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aea3699-3b83-4629-a9ae-9e19d78206dc-secret-telemeter-client\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:48.956197 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:48.956181 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npk6b\" (UniqueName: \"kubernetes.io/projected/7aea3699-3b83-4629-a9ae-9e19d78206dc-kube-api-access-npk6b\") pod \"telemeter-client-585c86fb59-twnf9\" (UID: \"7aea3699-3b83-4629-a9ae-9e19d78206dc\") " pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:49.084096 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:49.084044 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" Jun 08 18:13:49.219426 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:49.219399 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-585c86fb59-twnf9"] Jun 08 18:13:49.220811 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:13:49.220781 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aea3699_3b83_4629_a9ae_9e19d78206dc.slice/crio-92719b7c01614a73bc27c72fe13a16de236480f8a4100a13d963e6faabce7bdc WatchSource:0}: Error finding container 92719b7c01614a73bc27c72fe13a16de236480f8a4100a13d963e6faabce7bdc: Status 404 returned error can't find the container with id 92719b7c01614a73bc27c72fe13a16de236480f8a4100a13d963e6faabce7bdc Jun 08 18:13:49.222654 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:49.222639 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:13:49.563853 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:49.563818 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" event={"ID":"7aea3699-3b83-4629-a9ae-9e19d78206dc","Type":"ContainerStarted","Data":"92719b7c01614a73bc27c72fe13a16de236480f8a4100a13d963e6faabce7bdc"} Jun 08 18:13:52.575779 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:52.575700 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" event={"ID":"7aea3699-3b83-4629-a9ae-9e19d78206dc","Type":"ContainerStarted","Data":"0d6240b26a15b53cc8746ae76a62e84d9c935ac2ad4360c07a162c03fc5dfa09"} Jun 08 18:13:53.581009 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:53.580933 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" event={"ID":"7aea3699-3b83-4629-a9ae-9e19d78206dc","Type":"ContainerStarted","Data":"4df89689c28875c1ed1a8768c0bd726f5d3339af627d3700e94ad26966509b7c"} Jun 08 18:13:53.581009 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:53.580999 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" event={"ID":"7aea3699-3b83-4629-a9ae-9e19d78206dc","Type":"ContainerStarted","Data":"4ac6c9d82cb634af16ac6ae13f03d10f563388d2be30cff3c404de8e13883b22"} Jun 08 18:13:53.602659 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:53.602619 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-585c86fb59-twnf9" podStartSLOduration=1.601967125 podStartE2EDuration="5.602606089s" totalImagesPullingTime="4.000638964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:13:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:13:53.602157919 +0000 UTC m=+334.600960914" watchObservedRunningTime="2026-06-08 18:13:53.602606089 +0000 UTC m=+334.601409081" Jun 08 18:13:54.327325 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.327290 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6846cc6868-9ll6m"] Jun 08 18:13:54.330526 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.330511 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.348214 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.348188 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6846cc6868-9ll6m"] Jun 08 18:13:54.385480 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.385456 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgwlk\" (UniqueName: \"kubernetes.io/projected/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-kube-api-access-dgwlk\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.385569 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.385485 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-serving-cert\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.385569 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.385519 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-oauth-serving-cert\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.385569 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.385560 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-trusted-ca-bundle\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.385703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.385589 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-service-ca\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.385703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.385606 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-oauth-config\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.385703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.385626 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-config\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.486901 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.486868 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgwlk\" (UniqueName: \"kubernetes.io/projected/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-kube-api-access-dgwlk\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.486994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.486912 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-serving-cert\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.486994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.486947 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-oauth-serving-cert\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.486994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.486966 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-trusted-ca-bundle\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.486994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.486984 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-service-ca\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.487176 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.487001 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-oauth-config\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.487176 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.487015 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-config\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.487727 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.487698 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-oauth-serving-cert\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.487823 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.487792 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-service-ca\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.487823 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.487815 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-config\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.487989 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.487938 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-trusted-ca-bundle\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.489445 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.489419 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-serving-cert\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.489532 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.489474 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-oauth-config\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.495134 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.495114 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgwlk\" (UniqueName: \"kubernetes.io/projected/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-kube-api-access-dgwlk\") pod \"console-6846cc6868-9ll6m\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.639742 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.639719 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:13:54.764168 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:54.764071 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6846cc6868-9ll6m"] Jun 08 18:13:54.766229 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:13:54.766187 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325d2c4e_9180_4a4d_ba5d_5aad33f1c77d.slice/crio-fb3d8c458a4f8db2609781591f6041eec630a4a381d5d4342c3e9ced8c37d0c3 WatchSource:0}: Error finding container fb3d8c458a4f8db2609781591f6041eec630a4a381d5d4342c3e9ced8c37d0c3: Status 404 returned error can't find the container with id fb3d8c458a4f8db2609781591f6041eec630a4a381d5d4342c3e9ced8c37d0c3 Jun 08 18:13:55.591345 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:55.591313 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6846cc6868-9ll6m" event={"ID":"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d","Type":"ContainerStarted","Data":"e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa"} Jun 08 18:13:55.591497 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:55.591367 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6846cc6868-9ll6m" event={"ID":"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d","Type":"ContainerStarted","Data":"fb3d8c458a4f8db2609781591f6041eec630a4a381d5d4342c3e9ced8c37d0c3"} Jun 08 18:13:55.612235 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:13:55.612187 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6846cc6868-9ll6m" podStartSLOduration=1.612171925 podStartE2EDuration="1.612171925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:13:55.611253528 +0000 UTC m=+336.610056521" watchObservedRunningTime="2026-06-08 18:13:55.612171925 +0000 UTC m=+336.610974917" Jun 08 18:14:04.639956 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:04.639920 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:14:04.640465 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:04.639975 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:14:04.645031 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:04.645007 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:14:05.639251 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.639222 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:14:05.684576 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.684545 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cdc5b95c-w7bq9"] Jun 08 18:14:05.803937 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.803851 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f985b8db-mrxxj"] Jun 08 18:14:05.807335 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.807318 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.817364 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.817343 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f985b8db-mrxxj"] Jun 08 18:14:05.870501 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.870476 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-trusted-ca-bundle\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.870590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.870512 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-config\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.870590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.870539 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-service-ca\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.870590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.870559 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-oauth-config\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.870692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.870598 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-oauth-serving-cert\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.870692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.870621 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6gzq\" (UniqueName: \"kubernetes.io/projected/792bf476-8efe-4b02-848b-c1976ecaa7ea-kube-api-access-w6gzq\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.870692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.870644 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-serving-cert\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971131 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971079 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-trusted-ca-bundle\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971131 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971108 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-config\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971244 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971137 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-service-ca\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971244 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971167 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-oauth-config\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971244 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971192 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-oauth-serving-cert\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971384 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971247 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6gzq\" (UniqueName: \"kubernetes.io/projected/792bf476-8efe-4b02-848b-c1976ecaa7ea-kube-api-access-w6gzq\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971384 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971288 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-serving-cert\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.971878 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971855 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-service-ca\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.972050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.971911 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-config\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.972050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.972043 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-trusted-ca-bundle\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.972181 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.972022 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-oauth-serving-cert\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.973585 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.973563 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-oauth-config\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.973692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.973675 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-serving-cert\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:05.979153 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:05.979136 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6gzq\" (UniqueName: \"kubernetes.io/projected/792bf476-8efe-4b02-848b-c1976ecaa7ea-kube-api-access-w6gzq\") pod \"console-56f985b8db-mrxxj\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:06.116622 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:06.116603 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:06.241761 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:06.241735 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f985b8db-mrxxj"] Jun 08 18:14:06.243461 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:14:06.243435 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792bf476_8efe_4b02_848b_c1976ecaa7ea.slice/crio-342156cfc6dbb06b29c0651d4e4d1e3d49a29360e0b276cc6662ecb49865afc4 WatchSource:0}: Error finding container 342156cfc6dbb06b29c0651d4e4d1e3d49a29360e0b276cc6662ecb49865afc4: Status 404 returned error can't find the container with id 342156cfc6dbb06b29c0651d4e4d1e3d49a29360e0b276cc6662ecb49865afc4 Jun 08 18:14:06.637242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:06.637205 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f985b8db-mrxxj" event={"ID":"792bf476-8efe-4b02-848b-c1976ecaa7ea","Type":"ContainerStarted","Data":"5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e"} Jun 08 18:14:06.637436 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:06.637263 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f985b8db-mrxxj" event={"ID":"792bf476-8efe-4b02-848b-c1976ecaa7ea","Type":"ContainerStarted","Data":"342156cfc6dbb06b29c0651d4e4d1e3d49a29360e0b276cc6662ecb49865afc4"} Jun 08 18:14:06.655193 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:06.655148 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56f985b8db-mrxxj" podStartSLOduration=1.655133169 podStartE2EDuration="1.655133169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:14:06.653774836 +0000 UTC m=+347.652577831" watchObservedRunningTime="2026-06-08 18:14:06.655133169 +0000 UTC m=+347.653936161" Jun 08 18:14:16.117214 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:16.117179 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:16.117603 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:16.117235 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:16.121885 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:16.121863 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:16.686451 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:16.686424 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:14:16.742944 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:16.742910 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6846cc6868-9ll6m"] Jun 08 18:14:30.709232 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:30.709154 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69cdc5b95c-w7bq9" podUID="4902e200-b943-4638-ae19-bca3980d934b" containerName="console" containerID="cri-o://2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b" gracePeriod=15 Jun 08 18:14:30.953760 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:30.953739 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:14:31.051698 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.051636 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-console-config\") pod \"4902e200-b943-4638-ae19-bca3980d934b\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " Jun 08 18:14:31.051698 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.051666 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-oauth-serving-cert\") pod \"4902e200-b943-4638-ae19-bca3980d934b\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " Jun 08 18:14:31.051698 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.051698 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-oauth-config\") pod \"4902e200-b943-4638-ae19-bca3980d934b\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " Jun 08 18:14:31.051913 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.051771 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-service-ca\") pod \"4902e200-b943-4638-ae19-bca3980d934b\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " Jun 08 18:14:31.051913 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.051804 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-trusted-ca-bundle\") pod \"4902e200-b943-4638-ae19-bca3980d934b\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " Jun 08 18:14:31.051913 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.051850 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-serving-cert\") pod \"4902e200-b943-4638-ae19-bca3980d934b\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " Jun 08 18:14:31.051913 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.051881 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gw6r\" (UniqueName: \"kubernetes.io/projected/4902e200-b943-4638-ae19-bca3980d934b-kube-api-access-2gw6r\") pod \"4902e200-b943-4638-ae19-bca3980d934b\" (UID: \"4902e200-b943-4638-ae19-bca3980d934b\") " Jun 08 18:14:31.052178 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.052138 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-console-config" (OuterVolumeSpecName: "console-config") pod "4902e200-b943-4638-ae19-bca3980d934b" (UID: "4902e200-b943-4638-ae19-bca3980d934b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:31.052178 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.052164 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4902e200-b943-4638-ae19-bca3980d934b" (UID: "4902e200-b943-4638-ae19-bca3980d934b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:31.052328 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.052304 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4902e200-b943-4638-ae19-bca3980d934b" (UID: "4902e200-b943-4638-ae19-bca3980d934b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:31.052471 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.052448 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-service-ca" (OuterVolumeSpecName: "service-ca") pod "4902e200-b943-4638-ae19-bca3980d934b" (UID: "4902e200-b943-4638-ae19-bca3980d934b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:31.054070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.054048 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4902e200-b943-4638-ae19-bca3980d934b" (UID: "4902e200-b943-4638-ae19-bca3980d934b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:14:31.054152 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.054105 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4902e200-b943-4638-ae19-bca3980d934b-kube-api-access-2gw6r" (OuterVolumeSpecName: "kube-api-access-2gw6r") pod "4902e200-b943-4638-ae19-bca3980d934b" (UID: "4902e200-b943-4638-ae19-bca3980d934b"). InnerVolumeSpecName "kube-api-access-2gw6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:14:31.054152 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.054132 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4902e200-b943-4638-ae19-bca3980d934b" (UID: "4902e200-b943-4638-ae19-bca3980d934b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:14:31.152774 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.152736 2531 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-service-ca\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:31.152774 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.152770 2531 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-trusted-ca-bundle\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:31.152774 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.152780 2531 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-serving-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:31.152972 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.152789 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gw6r\" (UniqueName: \"kubernetes.io/projected/4902e200-b943-4638-ae19-bca3980d934b-kube-api-access-2gw6r\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:31.152972 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.152799 2531 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-console-config\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:31.152972 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.152807 2531 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4902e200-b943-4638-ae19-bca3980d934b-oauth-serving-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:31.152972 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.152815 2531 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4902e200-b943-4638-ae19-bca3980d934b-console-oauth-config\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:31.743119 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.743056 2531 generic.go:356] "Generic (PLEG): container finished" podID="4902e200-b943-4638-ae19-bca3980d934b" containerID="2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b" exitCode=0 Jun 08 18:14:31.743119 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.743113 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdc5b95c-w7bq9" event={"ID":"4902e200-b943-4638-ae19-bca3980d934b","Type":"ContainerDied","Data":"2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b"} Jun 08 18:14:31.743452 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.743166 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdc5b95c-w7bq9" event={"ID":"4902e200-b943-4638-ae19-bca3980d934b","Type":"ContainerDied","Data":"0854116ed7eaeb1c3f1726622b972d4bb72b60a1b75af0131a6607d6840791de"} Jun 08 18:14:31.743452 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.743113 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdc5b95c-w7bq9" Jun 08 18:14:31.743452 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.743185 2531 scope.go:117] "RemoveContainer" containerID="2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b" Jun 08 18:14:31.751419 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.751400 2531 scope.go:117] "RemoveContainer" containerID="2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b" Jun 08 18:14:31.751655 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:14:31.751634 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b\": container with ID starting with 2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b not found: ID does not exist" containerID="2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b" Jun 08 18:14:31.751718 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.751664 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b"} err="failed to get container status \"2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b\": rpc error: code = NotFound desc = could not find container \"2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b\": container with ID starting with 2193585ced2663a0b70c474b3cb102a65fc030a35464c36897f34ff86ff66c3b not found: ID does not exist" Jun 08 18:14:31.758827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.758804 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cdc5b95c-w7bq9"] Jun 08 18:14:31.765812 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:31.765792 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69cdc5b95c-w7bq9"] Jun 08 18:14:33.461117 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:33.461090 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4902e200-b943-4638-ae19-bca3980d934b" path="/var/lib/kubelet/pods/4902e200-b943-4638-ae19-bca3980d934b/volumes" Jun 08 18:14:41.764938 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:41.764854 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6846cc6868-9ll6m" podUID="325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" containerName="console" containerID="cri-o://e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa" gracePeriod=15 Jun 08 18:14:42.008073 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.008052 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:14:42.033379 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033329 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-oauth-config\") pod \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " Jun 08 18:14:42.033379 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033360 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-config\") pod \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " Jun 08 18:14:42.033379 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033379 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-service-ca\") pod \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " Jun 08 18:14:42.033592 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033416 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-oauth-serving-cert\") pod \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " Jun 08 18:14:42.033592 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033473 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-serving-cert\") pod \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " Jun 08 18:14:42.033592 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033509 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgwlk\" (UniqueName: \"kubernetes.io/projected/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-kube-api-access-dgwlk\") pod \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " Jun 08 18:14:42.033592 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033532 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-trusted-ca-bundle\") pod \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\" (UID: \"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d\") " Jun 08 18:14:42.033826 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033798 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-service-ca" (OuterVolumeSpecName: "service-ca") pod "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" (UID: "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:42.033826 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033810 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-config" (OuterVolumeSpecName: "console-config") pod "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" (UID: "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:42.033981 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.033819 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" (UID: "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:42.034090 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.034070 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" (UID: "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:14:42.035411 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.035385 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" (UID: "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:14:42.035518 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.035498 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" (UID: "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:14:42.035822 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.035804 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-kube-api-access-dgwlk" (OuterVolumeSpecName: "kube-api-access-dgwlk") pod "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" (UID: "325d2c4e-9180-4a4d-ba5d-5aad33f1c77d"). InnerVolumeSpecName "kube-api-access-dgwlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:14:42.134954 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.134924 2531 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-serving-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:42.134954 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.134953 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgwlk\" (UniqueName: \"kubernetes.io/projected/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-kube-api-access-dgwlk\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:42.134954 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.134962 2531 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-trusted-ca-bundle\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:42.135112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.134971 2531 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-oauth-config\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:42.135112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.134979 2531 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-console-config\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:42.135112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.134987 2531 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-service-ca\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:42.135112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.134994 2531 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d-oauth-serving-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:14:42.793318 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.793282 2531 generic.go:356] "Generic (PLEG): container finished" podID="325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" containerID="e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa" exitCode=0 Jun 08 18:14:42.793713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.793330 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6846cc6868-9ll6m" Jun 08 18:14:42.793713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.793348 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6846cc6868-9ll6m" event={"ID":"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d","Type":"ContainerDied","Data":"e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa"} Jun 08 18:14:42.793713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.793394 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6846cc6868-9ll6m" event={"ID":"325d2c4e-9180-4a4d-ba5d-5aad33f1c77d","Type":"ContainerDied","Data":"fb3d8c458a4f8db2609781591f6041eec630a4a381d5d4342c3e9ced8c37d0c3"} Jun 08 18:14:42.793713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.793422 2531 scope.go:117] "RemoveContainer" containerID="e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa" Jun 08 18:14:42.801993 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.801975 2531 scope.go:117] "RemoveContainer" containerID="e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa" Jun 08 18:14:42.802256 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:14:42.802238 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa\": container with ID starting with e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa not found: ID does not exist" containerID="e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa" Jun 08 18:14:42.802306 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.802263 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa"} err="failed to get container status \"e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa\": rpc error: code = NotFound desc = could not find container \"e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa\": container with ID starting with e1e856c5b0503388eba384a4bbcca86359fec9e287bfa5e2cc4bb44082e75faa not found: ID does not exist" Jun 08 18:14:42.812390 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.812370 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6846cc6868-9ll6m"] Jun 08 18:14:42.815673 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:42.815653 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6846cc6868-9ll6m"] Jun 08 18:14:43.462231 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:14:43.462199 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" path="/var/lib/kubelet/pods/325d2c4e-9180-4a4d-ba5d-5aad33f1c77d/volumes" Jun 08 18:18:56.566943 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.566908 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fbf6f8bf7-5sljn"] Jun 08 18:18:56.569238 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.567186 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" containerName="console" Jun 08 18:18:56.569238 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.567197 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" containerName="console" Jun 08 18:18:56.569238 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.567212 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4902e200-b943-4638-ae19-bca3980d934b" containerName="console" Jun 08 18:18:56.569238 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.567218 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="4902e200-b943-4638-ae19-bca3980d934b" containerName="console" Jun 08 18:18:56.569238 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.567272 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="325d2c4e-9180-4a4d-ba5d-5aad33f1c77d" containerName="console" Jun 08 18:18:56.569238 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.567280 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="4902e200-b943-4638-ae19-bca3980d934b" containerName="console" Jun 08 18:18:56.570083 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.570067 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.640658 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.640633 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fbf6f8bf7-5sljn"] Jun 08 18:18:56.675070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.675046 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj5nj\" (UniqueName: \"kubernetes.io/projected/0596b709-fab5-4018-8f3f-798767c5251b-kube-api-access-hj5nj\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.675168 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.675075 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-oauth-serving-cert\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.675168 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.675112 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0596b709-fab5-4018-8f3f-798767c5251b-console-serving-cert\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.675168 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.675127 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-console-config\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.675168 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.675155 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-service-ca\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.675303 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.675188 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0596b709-fab5-4018-8f3f-798767c5251b-console-oauth-config\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.675303 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.675205 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-trusted-ca-bundle\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.775464 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.775438 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0596b709-fab5-4018-8f3f-798767c5251b-console-serving-cert\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.775590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.775471 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-console-config\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.775590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.775488 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-service-ca\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.775590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.775535 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0596b709-fab5-4018-8f3f-798767c5251b-console-oauth-config\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.775590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.775559 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-trusted-ca-bundle\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.775868 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.775605 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj5nj\" (UniqueName: \"kubernetes.io/projected/0596b709-fab5-4018-8f3f-798767c5251b-kube-api-access-hj5nj\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.775868 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.775631 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-oauth-serving-cert\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.776272 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.776249 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-console-config\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.776357 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.776307 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-service-ca\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.776357 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.776332 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-oauth-serving-cert\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.776638 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.776617 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0596b709-fab5-4018-8f3f-798767c5251b-trusted-ca-bundle\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.777876 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.777852 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0596b709-fab5-4018-8f3f-798767c5251b-console-oauth-config\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.778096 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.778078 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0596b709-fab5-4018-8f3f-798767c5251b-console-serving-cert\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.787669 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.787651 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj5nj\" (UniqueName: \"kubernetes.io/projected/0596b709-fab5-4018-8f3f-798767c5251b-kube-api-access-hj5nj\") pod \"console-7fbf6f8bf7-5sljn\" (UID: \"0596b709-fab5-4018-8f3f-798767c5251b\") " pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:56.879516 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:56.879495 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:18:57.024340 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:57.024317 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fbf6f8bf7-5sljn"] Jun 08 18:18:57.026579 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:18:57.026542 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0596b709_fab5_4018_8f3f_798767c5251b.slice/crio-04a6153475a41aad5290b8732725c0293ba6fccaaa3d9f0c8fc61064cc2a896e WatchSource:0}: Error finding container 04a6153475a41aad5290b8732725c0293ba6fccaaa3d9f0c8fc61064cc2a896e: Status 404 returned error can't find the container with id 04a6153475a41aad5290b8732725c0293ba6fccaaa3d9f0c8fc61064cc2a896e Jun 08 18:18:57.782105 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:57.782064 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fbf6f8bf7-5sljn" event={"ID":"0596b709-fab5-4018-8f3f-798767c5251b","Type":"ContainerStarted","Data":"97bfdd46e90e64ceb88cdf3e82edab2475117b6ee93b39d6bfddd40780349f4f"} Jun 08 18:18:57.782528 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:57.782124 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fbf6f8bf7-5sljn" event={"ID":"0596b709-fab5-4018-8f3f-798767c5251b","Type":"ContainerStarted","Data":"04a6153475a41aad5290b8732725c0293ba6fccaaa3d9f0c8fc61064cc2a896e"} Jun 08 18:18:57.807063 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:18:57.807019 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fbf6f8bf7-5sljn" podStartSLOduration=1.807003947 podStartE2EDuration="1.807003947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:18:57.805830681 +0000 UTC m=+638.804633686" watchObservedRunningTime="2026-06-08 18:18:57.807003947 +0000 UTC m=+638.805806940" Jun 08 18:19:06.880572 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:06.880541 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:19:06.880969 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:06.880587 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:19:06.885188 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:06.885162 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:19:07.821616 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:07.821582 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fbf6f8bf7-5sljn" Jun 08 18:19:07.879376 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:07.879342 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f985b8db-mrxxj"] Jun 08 18:19:32.900546 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:32.900494 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56f985b8db-mrxxj" podUID="792bf476-8efe-4b02-848b-c1976ecaa7ea" containerName="console" containerID="cri-o://5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e" gracePeriod=15 Jun 08 18:19:33.139957 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.139935 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:19:33.235874 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.235812 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6gzq\" (UniqueName: \"kubernetes.io/projected/792bf476-8efe-4b02-848b-c1976ecaa7ea-kube-api-access-w6gzq\") pod \"792bf476-8efe-4b02-848b-c1976ecaa7ea\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " Jun 08 18:19:33.235874 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.235854 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-oauth-serving-cert\") pod \"792bf476-8efe-4b02-848b-c1976ecaa7ea\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " Jun 08 18:19:33.236027 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.235882 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-oauth-config\") pod \"792bf476-8efe-4b02-848b-c1976ecaa7ea\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " Jun 08 18:19:33.236073 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236053 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-service-ca\") pod \"792bf476-8efe-4b02-848b-c1976ecaa7ea\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " Jun 08 18:19:33.236112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236092 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-config\") pod \"792bf476-8efe-4b02-848b-c1976ecaa7ea\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " Jun 08 18:19:33.236145 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236132 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-trusted-ca-bundle\") pod \"792bf476-8efe-4b02-848b-c1976ecaa7ea\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " Jun 08 18:19:33.236180 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236162 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-serving-cert\") pod \"792bf476-8efe-4b02-848b-c1976ecaa7ea\" (UID: \"792bf476-8efe-4b02-848b-c1976ecaa7ea\") " Jun 08 18:19:33.236368 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236335 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "792bf476-8efe-4b02-848b-c1976ecaa7ea" (UID: "792bf476-8efe-4b02-848b-c1976ecaa7ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:19:33.236506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236432 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-config" (OuterVolumeSpecName: "console-config") pod "792bf476-8efe-4b02-848b-c1976ecaa7ea" (UID: "792bf476-8efe-4b02-848b-c1976ecaa7ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:19:33.236506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236446 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "792bf476-8efe-4b02-848b-c1976ecaa7ea" (UID: "792bf476-8efe-4b02-848b-c1976ecaa7ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:19:33.236506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236467 2531 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-oauth-serving-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:19:33.236636 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.236544 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "792bf476-8efe-4b02-848b-c1976ecaa7ea" (UID: "792bf476-8efe-4b02-848b-c1976ecaa7ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:19:33.237932 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.237910 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "792bf476-8efe-4b02-848b-c1976ecaa7ea" (UID: "792bf476-8efe-4b02-848b-c1976ecaa7ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:19:33.238090 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.238070 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/792bf476-8efe-4b02-848b-c1976ecaa7ea-kube-api-access-w6gzq" (OuterVolumeSpecName: "kube-api-access-w6gzq") pod "792bf476-8efe-4b02-848b-c1976ecaa7ea" (UID: "792bf476-8efe-4b02-848b-c1976ecaa7ea"). InnerVolumeSpecName "kube-api-access-w6gzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:19:33.238419 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.238394 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "792bf476-8efe-4b02-848b-c1976ecaa7ea" (UID: "792bf476-8efe-4b02-848b-c1976ecaa7ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:19:33.337165 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.337140 2531 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-serving-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:19:33.337165 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.337160 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6gzq\" (UniqueName: \"kubernetes.io/projected/792bf476-8efe-4b02-848b-c1976ecaa7ea-kube-api-access-w6gzq\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:19:33.337165 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.337169 2531 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-oauth-config\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:19:33.337325 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.337178 2531 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-service-ca\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:19:33.337325 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.337186 2531 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-console-config\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:19:33.337325 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.337194 2531 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/792bf476-8efe-4b02-848b-c1976ecaa7ea-trusted-ca-bundle\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:19:33.914739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.914707 2531 generic.go:356] "Generic (PLEG): container finished" podID="792bf476-8efe-4b02-848b-c1976ecaa7ea" containerID="5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e" exitCode=0 Jun 08 18:19:33.915072 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.914753 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f985b8db-mrxxj" Jun 08 18:19:33.915072 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.914772 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f985b8db-mrxxj" event={"ID":"792bf476-8efe-4b02-848b-c1976ecaa7ea","Type":"ContainerDied","Data":"5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e"} Jun 08 18:19:33.915072 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.914819 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f985b8db-mrxxj" event={"ID":"792bf476-8efe-4b02-848b-c1976ecaa7ea","Type":"ContainerDied","Data":"342156cfc6dbb06b29c0651d4e4d1e3d49a29360e0b276cc6662ecb49865afc4"} Jun 08 18:19:33.915072 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.914846 2531 scope.go:117] "RemoveContainer" containerID="5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e" Jun 08 18:19:33.922880 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.922863 2531 scope.go:117] "RemoveContainer" containerID="5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e" Jun 08 18:19:33.923144 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:19:33.923126 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e\": container with ID starting with 5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e not found: ID does not exist" containerID="5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e" Jun 08 18:19:33.923187 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.923151 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e"} err="failed to get container status \"5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e\": rpc error: code = NotFound desc = could not find container \"5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e\": container with ID starting with 5aeb1975c4441a1611e1478c617695c116ac3f083a13f39433951b2da3ed813e not found: ID does not exist" Jun 08 18:19:33.939448 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.939424 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f985b8db-mrxxj"] Jun 08 18:19:33.943215 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:33.943194 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56f985b8db-mrxxj"] Jun 08 18:19:35.460956 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:19:35.460917 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="792bf476-8efe-4b02-848b-c1976ecaa7ea" path="/var/lib/kubelet/pods/792bf476-8efe-4b02-848b-c1976ecaa7ea/volumes" Jun 08 18:21:56.063162 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.063124 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26"] Jun 08 18:21:56.063731 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.063447 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792bf476-8efe-4b02-848b-c1976ecaa7ea" containerName="console" Jun 08 18:21:56.063731 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.063459 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="792bf476-8efe-4b02-848b-c1976ecaa7ea" containerName="console" Jun 08 18:21:56.063731 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.063514 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="792bf476-8efe-4b02-848b-c1976ecaa7ea" containerName="console" Jun 08 18:21:56.066418 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.066392 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.069624 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.069597 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qsz87\"" Jun 08 18:21:56.070038 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.070021 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:21:56.070154 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.070134 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 18:21:56.084281 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.084258 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26"] Jun 08 18:21:56.105359 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.105334 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8de60d0-b6cd-4381-a9fe-377794f3e1cb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wd26\" (UID: \"e8de60d0-b6cd-4381-a9fe-377794f3e1cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.105471 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.105404 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjmk\" (UniqueName: \"kubernetes.io/projected/e8de60d0-b6cd-4381-a9fe-377794f3e1cb-kube-api-access-xjjmk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wd26\" (UID: \"e8de60d0-b6cd-4381-a9fe-377794f3e1cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.206446 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.206411 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjmk\" (UniqueName: \"kubernetes.io/projected/e8de60d0-b6cd-4381-a9fe-377794f3e1cb-kube-api-access-xjjmk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wd26\" (UID: \"e8de60d0-b6cd-4381-a9fe-377794f3e1cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.206547 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.206475 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8de60d0-b6cd-4381-a9fe-377794f3e1cb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wd26\" (UID: \"e8de60d0-b6cd-4381-a9fe-377794f3e1cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.206843 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.206825 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8de60d0-b6cd-4381-a9fe-377794f3e1cb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wd26\" (UID: \"e8de60d0-b6cd-4381-a9fe-377794f3e1cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.216390 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.216367 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjmk\" (UniqueName: \"kubernetes.io/projected/e8de60d0-b6cd-4381-a9fe-377794f3e1cb-kube-api-access-xjjmk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wd26\" (UID: \"e8de60d0-b6cd-4381-a9fe-377794f3e1cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.376827 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.376805 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" Jun 08 18:21:56.512144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.512116 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26"] Jun 08 18:21:56.515125 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:21:56.515104 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8de60d0_b6cd_4381_a9fe_377794f3e1cb.slice/crio-b9efd36e489613d33f906fe53021c263a86eea885d5bceafcd0fd7672fd2c29a WatchSource:0}: Error finding container b9efd36e489613d33f906fe53021c263a86eea885d5bceafcd0fd7672fd2c29a: Status 404 returned error can't find the container with id b9efd36e489613d33f906fe53021c263a86eea885d5bceafcd0fd7672fd2c29a Jun 08 18:21:56.517522 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:56.517507 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:21:57.480506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:57.480472 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" event={"ID":"e8de60d0-b6cd-4381-a9fe-377794f3e1cb","Type":"ContainerStarted","Data":"b9efd36e489613d33f906fe53021c263a86eea885d5bceafcd0fd7672fd2c29a"} Jun 08 18:21:59.490736 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:59.490670 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" event={"ID":"e8de60d0-b6cd-4381-a9fe-377794f3e1cb","Type":"ContainerStarted","Data":"43ec266f9b05e690f8df99f551bd218e8ec32d625b72f007047131f7d7857e25"} Jun 08 18:21:59.511803 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:21:59.511759 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wd26" podStartSLOduration=0.837324819 podStartE2EDuration="3.51174624s" totalImagesPullingTime="2.674421421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:21:59.511382789 +0000 UTC m=+820.510185785" watchObservedRunningTime="2026-06-08 18:21:59.51174624 +0000 UTC m=+820.510549232" Jun 08 18:22:01.452341 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.452306 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w"] Jun 08 18:22:01.455635 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.455617 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.458280 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.458257 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 18:22:01.458420 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.458260 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2xkcs\"" Jun 08 18:22:01.459388 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.459365 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 18:22:01.465257 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.465237 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w"] Jun 08 18:22:01.551318 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.551296 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lv4v\" (UniqueName: \"kubernetes.io/projected/5eaa57ae-6cbf-43f8-88c4-f9712d0b6454-kube-api-access-9lv4v\") pod \"cert-manager-webhook-7dc76cbb94-7sd8w\" (UID: \"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.551439 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.551410 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eaa57ae-6cbf-43f8-88c4-f9712d0b6454-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7sd8w\" (UID: \"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.651751 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.651726 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eaa57ae-6cbf-43f8-88c4-f9712d0b6454-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7sd8w\" (UID: \"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.651840 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.651763 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lv4v\" (UniqueName: \"kubernetes.io/projected/5eaa57ae-6cbf-43f8-88c4-f9712d0b6454-kube-api-access-9lv4v\") pod \"cert-manager-webhook-7dc76cbb94-7sd8w\" (UID: \"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.659552 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.659530 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eaa57ae-6cbf-43f8-88c4-f9712d0b6454-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7sd8w\" (UID: \"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.659639 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.659596 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lv4v\" (UniqueName: \"kubernetes.io/projected/5eaa57ae-6cbf-43f8-88c4-f9712d0b6454-kube-api-access-9lv4v\") pod \"cert-manager-webhook-7dc76cbb94-7sd8w\" (UID: \"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.775466 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.775411 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:01.899707 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:01.899616 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w"] Jun 08 18:22:01.901817 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:22:01.901792 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5eaa57ae_6cbf_43f8_88c4_f9712d0b6454.slice/crio-b074e4c228a1a14d24772b2e1e96f9282508f4c797724d37be8815c46522427b WatchSource:0}: Error finding container b074e4c228a1a14d24772b2e1e96f9282508f4c797724d37be8815c46522427b: Status 404 returned error can't find the container with id b074e4c228a1a14d24772b2e1e96f9282508f4c797724d37be8815c46522427b Jun 08 18:22:02.503053 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:02.503021 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" event={"ID":"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454","Type":"ContainerStarted","Data":"b074e4c228a1a14d24772b2e1e96f9282508f4c797724d37be8815c46522427b"} Jun 08 18:22:05.515900 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:05.515864 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" event={"ID":"5eaa57ae-6cbf-43f8-88c4-f9712d0b6454","Type":"ContainerStarted","Data":"74025bd29859407b563c659ab0bea076d6f9e297e0476981a8ca0b4afa83c3c6"} Jun 08 18:22:05.516253 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:05.515994 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:05.533770 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:05.533726 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" podStartSLOduration=1.820938909 podStartE2EDuration="4.533715203s" totalImagesPullingTime="2.712776294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:22:05.532323703 +0000 UTC m=+826.531126697" watchObservedRunningTime="2026-06-08 18:22:05.533715203 +0000 UTC m=+826.532518195" Jun 08 18:22:07.498116 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.498082 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-49m24"] Jun 08 18:22:07.501375 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.501356 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.505150 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.505132 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rb8xc\"" Jun 08 18:22:07.509732 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.509711 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-49m24"] Jun 08 18:22:07.597098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.597072 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv8jc\" (UniqueName: \"kubernetes.io/projected/f28d67f9-82ee-4df2-bf63-fd30d3715c7e-kube-api-access-sv8jc\") pod \"cert-manager-cainjector-5d99449ffd-49m24\" (UID: \"f28d67f9-82ee-4df2-bf63-fd30d3715c7e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.597202 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.597103 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28d67f9-82ee-4df2-bf63-fd30d3715c7e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-49m24\" (UID: \"f28d67f9-82ee-4df2-bf63-fd30d3715c7e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.698112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.698083 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv8jc\" (UniqueName: \"kubernetes.io/projected/f28d67f9-82ee-4df2-bf63-fd30d3715c7e-kube-api-access-sv8jc\") pod \"cert-manager-cainjector-5d99449ffd-49m24\" (UID: \"f28d67f9-82ee-4df2-bf63-fd30d3715c7e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.698112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.698116 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28d67f9-82ee-4df2-bf63-fd30d3715c7e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-49m24\" (UID: \"f28d67f9-82ee-4df2-bf63-fd30d3715c7e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.706021 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.706001 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f28d67f9-82ee-4df2-bf63-fd30d3715c7e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-49m24\" (UID: \"f28d67f9-82ee-4df2-bf63-fd30d3715c7e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.706021 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.706011 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv8jc\" (UniqueName: \"kubernetes.io/projected/f28d67f9-82ee-4df2-bf63-fd30d3715c7e-kube-api-access-sv8jc\") pod \"cert-manager-cainjector-5d99449ffd-49m24\" (UID: \"f28d67f9-82ee-4df2-bf63-fd30d3715c7e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.810205 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.810148 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" Jun 08 18:22:07.933654 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:07.933625 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-49m24"] Jun 08 18:22:07.936666 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:22:07.936633 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf28d67f9_82ee_4df2_bf63_fd30d3715c7e.slice/crio-bf561336345ae5b012e217fb8de4071b056851f225179623c23c30cbbc3e3527 WatchSource:0}: Error finding container bf561336345ae5b012e217fb8de4071b056851f225179623c23c30cbbc3e3527: Status 404 returned error can't find the container with id bf561336345ae5b012e217fb8de4071b056851f225179623c23c30cbbc3e3527 Jun 08 18:22:08.529738 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:08.529698 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" event={"ID":"f28d67f9-82ee-4df2-bf63-fd30d3715c7e","Type":"ContainerStarted","Data":"630f595e40962e707070b1e76c6f0a344b39bf893d6b3f8adfa8835f392423f5"} Jun 08 18:22:08.529738 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:08.529737 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" event={"ID":"f28d67f9-82ee-4df2-bf63-fd30d3715c7e","Type":"ContainerStarted","Data":"bf561336345ae5b012e217fb8de4071b056851f225179623c23c30cbbc3e3527"} Jun 08 18:22:08.548117 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:08.548072 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-49m24" podStartSLOduration=1.5480575779999999 podStartE2EDuration="1.548057578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:22:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:22:08.546836497 +0000 UTC m=+829.545639490" watchObservedRunningTime="2026-06-08 18:22:08.548057578 +0000 UTC m=+829.546860571" Jun 08 18:22:11.521522 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:11.521493 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7sd8w" Jun 08 18:22:27.939059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.939027 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh"] Jun 08 18:22:27.945114 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.945093 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:27.951509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.949195 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 18:22:27.951509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.949232 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:22:27.951509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.949301 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 18:22:27.951509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.949305 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bcfn8\"" Jun 08 18:22:27.951509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.949745 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 18:22:27.951509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.950266 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 18:22:27.954115 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:27.954092 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh"] Jun 08 18:22:28.039141 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.039111 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5t52\" (UniqueName: \"kubernetes.io/projected/30e4f912-6ad4-4b79-b44f-30b789d5d554-kube-api-access-w5t52\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.039251 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.039163 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30e4f912-6ad4-4b79-b44f-30b789d5d554-metrics-cert\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.039251 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.039210 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30e4f912-6ad4-4b79-b44f-30b789d5d554-manager-config\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.039329 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.039254 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30e4f912-6ad4-4b79-b44f-30b789d5d554-cert\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.139970 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.139946 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30e4f912-6ad4-4b79-b44f-30b789d5d554-cert\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.140081 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.139994 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5t52\" (UniqueName: \"kubernetes.io/projected/30e4f912-6ad4-4b79-b44f-30b789d5d554-kube-api-access-w5t52\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.140081 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.140033 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30e4f912-6ad4-4b79-b44f-30b789d5d554-metrics-cert\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.140081 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.140066 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30e4f912-6ad4-4b79-b44f-30b789d5d554-manager-config\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.140701 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.140677 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/30e4f912-6ad4-4b79-b44f-30b789d5d554-manager-config\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.142499 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.142478 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30e4f912-6ad4-4b79-b44f-30b789d5d554-cert\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.142601 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.142572 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/30e4f912-6ad4-4b79-b44f-30b789d5d554-metrics-cert\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.149519 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.149497 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5t52\" (UniqueName: \"kubernetes.io/projected/30e4f912-6ad4-4b79-b44f-30b789d5d554-kube-api-access-w5t52\") pod \"lws-controller-manager-6b7d5b599f-rxknh\" (UID: \"30e4f912-6ad4-4b79-b44f-30b789d5d554\") " pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.259546 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.259489 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:28.393463 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.393396 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh"] Jun 08 18:22:28.396058 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:22:28.396033 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e4f912_6ad4_4b79_b44f_30b789d5d554.slice/crio-fef3f9f464a620fdc6a44a919cc3400f7924febd69714bf26b0ebe7ca695eb80 WatchSource:0}: Error finding container fef3f9f464a620fdc6a44a919cc3400f7924febd69714bf26b0ebe7ca695eb80: Status 404 returned error can't find the container with id fef3f9f464a620fdc6a44a919cc3400f7924febd69714bf26b0ebe7ca695eb80 Jun 08 18:22:28.611690 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:28.611662 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" event={"ID":"30e4f912-6ad4-4b79-b44f-30b789d5d554","Type":"ContainerStarted","Data":"fef3f9f464a620fdc6a44a919cc3400f7924febd69714bf26b0ebe7ca695eb80"} Jun 08 18:22:31.626323 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:31.626292 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" event={"ID":"30e4f912-6ad4-4b79-b44f-30b789d5d554","Type":"ContainerStarted","Data":"a3a4973287ecb613f5b5dc8619e9598d641c80774ed62757e41173685a4ccb8d"} Jun 08 18:22:31.626689 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:31.626352 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:31.643853 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:31.643801 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" podStartSLOduration=2.254131975 podStartE2EDuration="4.643787627s" totalImagesPullingTime="2.389655652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:22:31.642144997 +0000 UTC m=+852.640947989" watchObservedRunningTime="2026-06-08 18:22:31.643787627 +0000 UTC m=+852.642590620" Jun 08 18:22:37.712183 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.712143 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg"] Jun 08 18:22:37.715750 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.715731 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.720567 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.720538 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 18:22:37.720850 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.720826 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 18:22:37.720971 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.720954 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zgpxl\"" Jun 08 18:22:37.721046 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.720970 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 18:22:37.721046 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.720972 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 18:22:37.734818 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.734798 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg"] Jun 08 18:22:37.811301 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.811276 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-webhook-cert\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.811397 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.811308 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6924b\" (UniqueName: \"kubernetes.io/projected/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-kube-api-access-6924b\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.811397 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.811336 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-tmp\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.811479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.811426 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-manifests\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.811479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.811449 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.912180 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.912160 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-manifests\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.912283 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.912188 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.912283 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.912208 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-webhook-cert\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.912283 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.912227 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6924b\" (UniqueName: \"kubernetes.io/projected/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-kube-api-access-6924b\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.912283 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.912255 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-tmp\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.912590 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.912570 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-manifests\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.914482 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.914461 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-tmp\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.914623 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.914606 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-webhook-cert\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.914744 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.914725 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:37.926956 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:37.926934 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6924b\" (UniqueName: \"kubernetes.io/projected/7f5b1db2-2ae0-4e32-be58-bd93fba25d1a-kube-api-access-6924b\") pod \"opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg\" (UID: \"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a\") " pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:38.026297 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:38.026241 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:38.174361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:38.174332 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg"] Jun 08 18:22:38.176969 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:22:38.176940 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5b1db2_2ae0_4e32_be58_bd93fba25d1a.slice/crio-9d196d716c263f6fb998fe5d32a44a20654fc2cd297626ca128f0876c7603658 WatchSource:0}: Error finding container 9d196d716c263f6fb998fe5d32a44a20654fc2cd297626ca128f0876c7603658: Status 404 returned error can't find the container with id 9d196d716c263f6fb998fe5d32a44a20654fc2cd297626ca128f0876c7603658 Jun 08 18:22:38.656507 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:38.656472 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" event={"ID":"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a","Type":"ContainerStarted","Data":"9d196d716c263f6fb998fe5d32a44a20654fc2cd297626ca128f0876c7603658"} Jun 08 18:22:41.671064 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:41.671026 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" event={"ID":"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a","Type":"ContainerStarted","Data":"7e03a3816dc656cd5c1fffbee96cbbee2a85d638a3f5e39a5533b9ea5efc35f7"} Jun 08 18:22:42.633287 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:42.633261 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b7d5b599f-rxknh" Jun 08 18:22:42.676356 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:42.676327 2531 generic.go:356] "Generic (PLEG): container finished" podID="7f5b1db2-2ae0-4e32-be58-bd93fba25d1a" containerID="7e03a3816dc656cd5c1fffbee96cbbee2a85d638a3f5e39a5533b9ea5efc35f7" exitCode=0 Jun 08 18:22:42.676704 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:42.676403 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" event={"ID":"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a","Type":"ContainerDied","Data":"7e03a3816dc656cd5c1fffbee96cbbee2a85d638a3f5e39a5533b9ea5efc35f7"} Jun 08 18:22:43.682728 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:43.682693 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" event={"ID":"7f5b1db2-2ae0-4e32-be58-bd93fba25d1a","Type":"ContainerStarted","Data":"3050a666a12917d486c9a90a5a4734798a5f23d1dc833d1c960f5cca90e9cd49"} Jun 08 18:22:43.683292 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:43.682808 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:22:43.716095 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:43.716050 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" podStartSLOduration=2.46348192 podStartE2EDuration="6.716038514s" totalImagesPullingTime="3.255303668s" totalInitContainerRuntime="997.252926ms" isStatefulPod=false podCreationTimestamp="2026-06-08 18:22:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:22:43.713779475 +0000 UTC m=+864.712582469" watchObservedRunningTime="2026-06-08 18:22:43.716038514 +0000 UTC m=+864.714841507" Jun 08 18:22:54.690572 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:22:54.690541 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg" Jun 08 18:23:33.197707 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.197677 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6ccfc5987b-2wj4b"] Jun 08 18:23:33.208384 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.208364 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.211607 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.211583 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 18:23:33.211738 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.211683 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-znp94\"" Jun 08 18:23:33.218860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.218836 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6ccfc5987b-2wj4b"] Jun 08 18:23:33.310542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.310510 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzvx\" (UniqueName: \"kubernetes.io/projected/fed5ad2a-36d6-4dba-ba4a-3a7ed469717f-kube-api-access-6nzvx\") pod \"dashboard-redirect-6ccfc5987b-2wj4b\" (UID: \"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f\") " pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.310680 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.310562 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fed5ad2a-36d6-4dba-ba4a-3a7ed469717f-redirect-config\") pod \"dashboard-redirect-6ccfc5987b-2wj4b\" (UID: \"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f\") " pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.411108 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.411083 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fed5ad2a-36d6-4dba-ba4a-3a7ed469717f-redirect-config\") pod \"dashboard-redirect-6ccfc5987b-2wj4b\" (UID: \"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f\") " pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.411230 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.411142 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzvx\" (UniqueName: \"kubernetes.io/projected/fed5ad2a-36d6-4dba-ba4a-3a7ed469717f-kube-api-access-6nzvx\") pod \"dashboard-redirect-6ccfc5987b-2wj4b\" (UID: \"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f\") " pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.411751 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.411731 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fed5ad2a-36d6-4dba-ba4a-3a7ed469717f-redirect-config\") pod \"dashboard-redirect-6ccfc5987b-2wj4b\" (UID: \"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f\") " pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.420517 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.420496 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzvx\" (UniqueName: \"kubernetes.io/projected/fed5ad2a-36d6-4dba-ba4a-3a7ed469717f-kube-api-access-6nzvx\") pod \"dashboard-redirect-6ccfc5987b-2wj4b\" (UID: \"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f\") " pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.518494 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.518395 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" Jun 08 18:23:33.653125 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.653050 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6ccfc5987b-2wj4b"] Jun 08 18:23:33.655937 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:23:33.655873 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed5ad2a_36d6_4dba_ba4a_3a7ed469717f.slice/crio-d4f1f36acc591744a6a796a991e798d94abf153c10159056d3430f2443492306 WatchSource:0}: Error finding container d4f1f36acc591744a6a796a991e798d94abf153c10159056d3430f2443492306: Status 404 returned error can't find the container with id d4f1f36acc591744a6a796a991e798d94abf153c10159056d3430f2443492306 Jun 08 18:23:33.892834 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:33.892807 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" event={"ID":"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f","Type":"ContainerStarted","Data":"d4f1f36acc591744a6a796a991e798d94abf153c10159056d3430f2443492306"} Jun 08 18:23:35.903075 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:35.903044 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" event={"ID":"fed5ad2a-36d6-4dba-ba4a-3a7ed469717f","Type":"ContainerStarted","Data":"51977c6a0d158735f0036660813b5d815ff56d5d9475d2e8d341d66b53d9462b"} Jun 08 18:23:35.922593 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:35.922551 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6ccfc5987b-2wj4b" podStartSLOduration=1.113449939 podStartE2EDuration="2.922536091s" totalImagesPullingTime="1.809086152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:23:35.920692897 +0000 UTC m=+916.919495890" watchObservedRunningTime="2026-06-08 18:23:35.922536091 +0000 UTC m=+916.921339084" Jun 08 18:23:49.672532 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.672502 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf"] Jun 08 18:23:49.675760 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.675744 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.679100 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.679067 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 18:23:49.679228 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.679148 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cmtqw\"" Jun 08 18:23:49.697740 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.697721 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf"] Jun 08 18:23:49.834532 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834500 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834655 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834539 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69fb08a9-524b-42d1-87c1-d1be36abe138-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834655 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834616 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cpjr\" (UniqueName: \"kubernetes.io/projected/69fb08a9-524b-42d1-87c1-d1be36abe138-kube-api-access-8cpjr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834655 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834649 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834803 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834683 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834803 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834719 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834803 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834775 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834809 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.834929 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.834828 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935736 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935678 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cpjr\" (UniqueName: \"kubernetes.io/projected/69fb08a9-524b-42d1-87c1-d1be36abe138-kube-api-access-8cpjr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935736 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935708 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935736 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935731 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935943 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935754 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935943 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935784 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935943 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935804 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935943 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935823 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935943 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935848 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.935943 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.935886 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69fb08a9-524b-42d1-87c1-d1be36abe138-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.936239 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.936220 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.936296 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.936271 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.936348 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.936324 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.936479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.936456 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.936666 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.936647 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69fb08a9-524b-42d1-87c1-d1be36abe138-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.938209 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.938187 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.938408 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.938395 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.950757 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.950734 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69fb08a9-524b-42d1-87c1-d1be36abe138-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.953777 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.953754 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cpjr\" (UniqueName: \"kubernetes.io/projected/69fb08a9-524b-42d1-87c1-d1be36abe138-kube-api-access-8cpjr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tj2wf\" (UID: \"69fb08a9-524b-42d1-87c1-d1be36abe138\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:49.985747 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:49.985724 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:50.127491 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:50.127445 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf"] Jun 08 18:23:50.129701 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:23:50.129673 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fb08a9_524b_42d1_87c1_d1be36abe138.slice/crio-ea7e5a1eedd40d3ba1458ce13f28f619939f87c4b6a753f1c4334144b8ee6f3c WatchSource:0}: Error finding container ea7e5a1eedd40d3ba1458ce13f28f619939f87c4b6a753f1c4334144b8ee6f3c: Status 404 returned error can't find the container with id ea7e5a1eedd40d3ba1458ce13f28f619939f87c4b6a753f1c4334144b8ee6f3c Jun 08 18:23:50.974172 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:50.974133 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" event={"ID":"69fb08a9-524b-42d1-87c1-d1be36abe138","Type":"ContainerStarted","Data":"ea7e5a1eedd40d3ba1458ce13f28f619939f87c4b6a753f1c4334144b8ee6f3c"} Jun 08 18:23:53.176291 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:53.176250 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:23:53.176574 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:53.176323 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:23:53.176574 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:53.176351 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:23:53.989659 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:53.989625 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" event={"ID":"69fb08a9-524b-42d1-87c1-d1be36abe138","Type":"ContainerStarted","Data":"9fe44b44711369c18fe3487d41ab67f45a970ddb374b9b9ad80fe05127d085da"} Jun 08 18:23:54.018213 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:54.018167 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" podStartSLOduration=1.973739369 podStartE2EDuration="5.01815221s" totalImagesPullingTime="3.044412841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:23:54.015476835 +0000 UTC m=+935.014279829" watchObservedRunningTime="2026-06-08 18:23:54.01815221 +0000 UTC m=+935.016955205" Jun 08 18:23:54.986038 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:54.986006 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:54.990617 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:54.990588 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:54.994697 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:54.994674 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:54.995424 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:54.995406 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tj2wf" Jun 08 18:23:58.500982 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.500951 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8z6s"] Jun 08 18:23:58.504095 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.504074 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" Jun 08 18:23:58.508571 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.508549 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-f7jgp\"" Jun 08 18:23:58.508761 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.508745 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 18:23:58.509627 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.509609 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 18:23:58.522035 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.522016 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8z6s"] Jun 08 18:23:58.603246 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.603216 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s5fv\" (UniqueName: \"kubernetes.io/projected/85c0d344-773f-4195-ba66-13b028b6074a-kube-api-access-9s5fv\") pod \"kuadrant-operator-catalog-w8z6s\" (UID: \"85c0d344-773f-4195-ba66-13b028b6074a\") " pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" Jun 08 18:23:58.704046 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.704020 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s5fv\" (UniqueName: \"kubernetes.io/projected/85c0d344-773f-4195-ba66-13b028b6074a-kube-api-access-9s5fv\") pod \"kuadrant-operator-catalog-w8z6s\" (UID: \"85c0d344-773f-4195-ba66-13b028b6074a\") " pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" Jun 08 18:23:58.713370 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.713345 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s5fv\" (UniqueName: \"kubernetes.io/projected/85c0d344-773f-4195-ba66-13b028b6074a-kube-api-access-9s5fv\") pod \"kuadrant-operator-catalog-w8z6s\" (UID: \"85c0d344-773f-4195-ba66-13b028b6074a\") " pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" Jun 08 18:23:58.814195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.814146 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" Jun 08 18:23:58.869310 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.869263 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8z6s"] Jun 08 18:23:58.946125 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:58.946101 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8z6s"] Jun 08 18:23:58.948223 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:23:58.948194 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c0d344_773f_4195_ba66_13b028b6074a.slice/crio-42505110476a9088aa37c7c8c6651dd508da61794b62b1afbdd9c7a334acadf3 WatchSource:0}: Error finding container 42505110476a9088aa37c7c8c6651dd508da61794b62b1afbdd9c7a334acadf3: Status 404 returned error can't find the container with id 42505110476a9088aa37c7c8c6651dd508da61794b62b1afbdd9c7a334acadf3 Jun 08 18:23:59.012400 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.012372 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" event={"ID":"85c0d344-773f-4195-ba66-13b028b6074a","Type":"ContainerStarted","Data":"42505110476a9088aa37c7c8c6651dd508da61794b62b1afbdd9c7a334acadf3"} Jun 08 18:23:59.066842 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.066788 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vmft"] Jun 08 18:23:59.071097 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.071083 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:23:59.078860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.078839 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vmft"] Jun 08 18:23:59.209418 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.209387 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dzv\" (UniqueName: \"kubernetes.io/projected/024f6b5e-0589-4282-8cc9-560edb23e145-kube-api-access-r7dzv\") pod \"kuadrant-operator-catalog-5vmft\" (UID: \"024f6b5e-0589-4282-8cc9-560edb23e145\") " pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:23:59.310440 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.310411 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dzv\" (UniqueName: \"kubernetes.io/projected/024f6b5e-0589-4282-8cc9-560edb23e145-kube-api-access-r7dzv\") pod \"kuadrant-operator-catalog-5vmft\" (UID: \"024f6b5e-0589-4282-8cc9-560edb23e145\") " pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:23:59.319747 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.319704 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dzv\" (UniqueName: \"kubernetes.io/projected/024f6b5e-0589-4282-8cc9-560edb23e145-kube-api-access-r7dzv\") pod \"kuadrant-operator-catalog-5vmft\" (UID: \"024f6b5e-0589-4282-8cc9-560edb23e145\") " pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:23:59.380739 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.380711 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:23:59.512199 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:23:59.512174 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vmft"] Jun 08 18:23:59.530500 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:23:59.530475 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024f6b5e_0589_4282_8cc9_560edb23e145.slice/crio-5f4e355ce1f7ff84cb3cf4829970a477967e26a44aaca0881740b64d29e17896 WatchSource:0}: Error finding container 5f4e355ce1f7ff84cb3cf4829970a477967e26a44aaca0881740b64d29e17896: Status 404 returned error can't find the container with id 5f4e355ce1f7ff84cb3cf4829970a477967e26a44aaca0881740b64d29e17896 Jun 08 18:24:00.020335 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:00.020296 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" event={"ID":"024f6b5e-0589-4282-8cc9-560edb23e145","Type":"ContainerStarted","Data":"5f4e355ce1f7ff84cb3cf4829970a477967e26a44aaca0881740b64d29e17896"} Jun 08 18:24:02.036965 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.036925 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" event={"ID":"85c0d344-773f-4195-ba66-13b028b6074a","Type":"ContainerStarted","Data":"dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e"} Jun 08 18:24:02.037398 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.037060 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" podUID="85c0d344-773f-4195-ba66-13b028b6074a" containerName="registry-server" containerID="cri-o://dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e" gracePeriod=2 Jun 08 18:24:02.038667 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.038635 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" event={"ID":"024f6b5e-0589-4282-8cc9-560edb23e145","Type":"ContainerStarted","Data":"7a0834f433de2bd7264c435eba94910c95c98a3c32cad56aebb5e11e695436b5"} Jun 08 18:24:02.055145 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.055106 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" podStartSLOduration=1.70249572 podStartE2EDuration="4.055092327s" totalImagesPullingTime="2.352596607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:24:02.053500043 +0000 UTC m=+943.052303037" watchObservedRunningTime="2026-06-08 18:24:02.055092327 +0000 UTC m=+943.053895320" Jun 08 18:24:02.070654 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.070616 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" podStartSLOduration=1.2973575130000001 podStartE2EDuration="3.070603949s" totalImagesPullingTime="1.773246436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:24:02.069791428 +0000 UTC m=+943.068594422" watchObservedRunningTime="2026-06-08 18:24:02.070603949 +0000 UTC m=+943.069406974" Jun 08 18:24:02.279570 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.279548 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" Jun 08 18:24:02.436884 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.436857 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s5fv\" (UniqueName: \"kubernetes.io/projected/85c0d344-773f-4195-ba66-13b028b6074a-kube-api-access-9s5fv\") pod \"85c0d344-773f-4195-ba66-13b028b6074a\" (UID: \"85c0d344-773f-4195-ba66-13b028b6074a\") " Jun 08 18:24:02.438918 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.438878 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85c0d344-773f-4195-ba66-13b028b6074a-kube-api-access-9s5fv" (OuterVolumeSpecName: "kube-api-access-9s5fv") pod "85c0d344-773f-4195-ba66-13b028b6074a" (UID: "85c0d344-773f-4195-ba66-13b028b6074a"). InnerVolumeSpecName "kube-api-access-9s5fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:24:02.537486 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:02.537461 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s5fv\" (UniqueName: \"kubernetes.io/projected/85c0d344-773f-4195-ba66-13b028b6074a-kube-api-access-9s5fv\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:24:03.044855 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.044827 2531 generic.go:356] "Generic (PLEG): container finished" podID="85c0d344-773f-4195-ba66-13b028b6074a" containerID="dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e" exitCode=0 Jun 08 18:24:03.045267 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.044875 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" Jun 08 18:24:03.045267 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.044920 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" event={"ID":"85c0d344-773f-4195-ba66-13b028b6074a","Type":"ContainerDied","Data":"dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e"} Jun 08 18:24:03.045267 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.044984 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w8z6s" event={"ID":"85c0d344-773f-4195-ba66-13b028b6074a","Type":"ContainerDied","Data":"42505110476a9088aa37c7c8c6651dd508da61794b62b1afbdd9c7a334acadf3"} Jun 08 18:24:03.045267 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.045020 2531 scope.go:117] "RemoveContainer" containerID="dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e" Jun 08 18:24:03.054281 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.054253 2531 scope.go:117] "RemoveContainer" containerID="dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e" Jun 08 18:24:03.054532 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:03.054515 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e\": container with ID starting with dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e not found: ID does not exist" containerID="dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e" Jun 08 18:24:03.054586 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.054542 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e"} err="failed to get container status \"dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e\": rpc error: code = NotFound desc = could not find container \"dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e\": container with ID starting with dfa4348febc04b02523e5d1a5aee6d0b83fa26ed739abdecaa3b3128a615e24e not found: ID does not exist" Jun 08 18:24:03.082903 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.082863 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8z6s"] Jun 08 18:24:03.091692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.091673 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w8z6s"] Jun 08 18:24:03.463198 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:03.463170 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85c0d344-773f-4195-ba66-13b028b6074a" path="/var/lib/kubelet/pods/85c0d344-773f-4195-ba66-13b028b6074a/volumes" Jun 08 18:24:09.381586 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:09.381556 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:24:09.381985 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:09.381600 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:24:09.403756 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:09.403732 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:24:10.097146 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:10.097119 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5vmft" Jun 08 18:24:26.418262 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.418227 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x"] Jun 08 18:24:26.418714 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.418554 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85c0d344-773f-4195-ba66-13b028b6074a" containerName="registry-server" Jun 08 18:24:26.418714 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.418565 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="85c0d344-773f-4195-ba66-13b028b6074a" containerName="registry-server" Jun 08 18:24:26.418714 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.418620 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="85c0d344-773f-4195-ba66-13b028b6074a" containerName="registry-server" Jun 08 18:24:26.425513 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.425494 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.452806 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.452785 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m5btw\"" Jun 08 18:24:26.512862 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.512836 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.512980 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.512883 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jfcs\" (UniqueName: \"kubernetes.io/projected/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-kube-api-access-4jfcs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.534788 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.534755 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x"] Jun 08 18:24:26.613944 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.613908 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.614036 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.613963 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jfcs\" (UniqueName: \"kubernetes.io/projected/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-kube-api-access-4jfcs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.614266 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.614248 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.641033 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.641011 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jfcs\" (UniqueName: \"kubernetes.io/projected/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-kube-api-access-4jfcs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.736003 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.735950 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:26.905933 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:26.905880 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x"] Jun 08 18:24:26.912254 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:24:26.912227 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3bf50c_5ada_4fa9_bbed_c60576b1702e.slice/crio-139dd76c616c83124c68449cc2457f2e1deb26ecac0155eec6a0e040964c5039 WatchSource:0}: Error finding container 139dd76c616c83124c68449cc2457f2e1deb26ecac0155eec6a0e040964c5039: Status 404 returned error can't find the container with id 139dd76c616c83124c68449cc2457f2e1deb26ecac0155eec6a0e040964c5039 Jun 08 18:24:27.152941 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:27.152915 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" event={"ID":"cb3bf50c-5ada-4fa9-bbed-c60576b1702e","Type":"ContainerStarted","Data":"139dd76c616c83124c68449cc2457f2e1deb26ecac0155eec6a0e040964c5039"} Jun 08 18:24:30.271344 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.271305 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jn98z"] Jun 08 18:24:30.273715 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.273685 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" Jun 08 18:24:30.280825 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.280800 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-72r4r\"" Jun 08 18:24:30.291571 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.291543 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jn98z"] Jun 08 18:24:30.345536 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.345511 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfc6f\" (UniqueName: \"kubernetes.io/projected/bc190850-2086-4d72-9cdb-50e3837beeab-kube-api-access-vfc6f\") pod \"authorino-operator-75cc8d5cb7-jn98z\" (UID: \"bc190850-2086-4d72-9cdb-50e3837beeab\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" Jun 08 18:24:30.446357 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.446318 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfc6f\" (UniqueName: \"kubernetes.io/projected/bc190850-2086-4d72-9cdb-50e3837beeab-kube-api-access-vfc6f\") pod \"authorino-operator-75cc8d5cb7-jn98z\" (UID: \"bc190850-2086-4d72-9cdb-50e3837beeab\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" Jun 08 18:24:30.458408 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.458381 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfc6f\" (UniqueName: \"kubernetes.io/projected/bc190850-2086-4d72-9cdb-50e3837beeab-kube-api-access-vfc6f\") pod \"authorino-operator-75cc8d5cb7-jn98z\" (UID: \"bc190850-2086-4d72-9cdb-50e3837beeab\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" Jun 08 18:24:30.586444 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.586390 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" Jun 08 18:24:30.717635 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:30.717511 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jn98z"] Jun 08 18:24:30.719930 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:24:30.719883 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc190850_2086_4d72_9cdb_50e3837beeab.slice/crio-5a0d46462975c2222e48042468efba716cd1099b96935ec968ae2d53ce491dd7 WatchSource:0}: Error finding container 5a0d46462975c2222e48042468efba716cd1099b96935ec968ae2d53ce491dd7: Status 404 returned error can't find the container with id 5a0d46462975c2222e48042468efba716cd1099b96935ec968ae2d53ce491dd7 Jun 08 18:24:31.171630 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:31.171598 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" event={"ID":"bc190850-2086-4d72-9cdb-50e3837beeab","Type":"ContainerStarted","Data":"5a0d46462975c2222e48042468efba716cd1099b96935ec968ae2d53ce491dd7"} Jun 08 18:24:34.189131 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:34.189085 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" event={"ID":"bc190850-2086-4d72-9cdb-50e3837beeab","Type":"ContainerStarted","Data":"0da10da69eff6470449c3daa781c480be3821b4e1e55b229d6d300bc95406264"} Jun 08 18:24:34.189583 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:34.189206 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" Jun 08 18:24:34.223297 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:34.223253 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" podStartSLOduration=1.630411728 podStartE2EDuration="4.223237918s" totalImagesPullingTime="2.59282619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:24:34.222617843 +0000 UTC m=+975.221420838" watchObservedRunningTime="2026-06-08 18:24:34.223237918 +0000 UTC m=+975.222040910" Jun 08 18:24:35.195522 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:35.195480 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" event={"ID":"cb3bf50c-5ada-4fa9-bbed-c60576b1702e","Type":"ContainerStarted","Data":"01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1"} Jun 08 18:24:35.195878 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:35.195649 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:35.223103 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:35.223015 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" podStartSLOduration=1.167507859 podStartE2EDuration="9.222997871s" totalImagesPullingTime="8.055490012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:24:35.221722796 +0000 UTC m=+976.220525788" watchObservedRunningTime="2026-06-08 18:24:35.222997871 +0000 UTC m=+976.221800940" Jun 08 18:24:37.853427 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.853398 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8"] Jun 08 18:24:37.856002 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.855974 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:37.858438 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.858417 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 18:24:37.858634 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.858620 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tfhgk\"" Jun 08 18:24:37.858737 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.858719 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 18:24:37.868959 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.868937 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8"] Jun 08 18:24:37.908479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.908450 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/af452f6b-cb0e-4a36-8432-d63de90241e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:37.908578 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.908507 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/af452f6b-cb0e-4a36-8432-d63de90241e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:37.908632 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:37.908589 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxksg\" (UniqueName: \"kubernetes.io/projected/af452f6b-cb0e-4a36-8432-d63de90241e5-kube-api-access-dxksg\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.009710 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.009677 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxksg\" (UniqueName: \"kubernetes.io/projected/af452f6b-cb0e-4a36-8432-d63de90241e5-kube-api-access-dxksg\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.009858 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.009744 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/af452f6b-cb0e-4a36-8432-d63de90241e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.009858 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.009786 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/af452f6b-cb0e-4a36-8432-d63de90241e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.010019 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:38.009916 2531 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 08 18:24:38.010019 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:38.009983 2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af452f6b-cb0e-4a36-8432-d63de90241e5-plugin-serving-cert podName:af452f6b-cb0e-4a36-8432-d63de90241e5 nodeName:}" failed. No retries permitted until 2026-06-08 18:24:38.509963997 +0000 UTC m=+979.508766981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/af452f6b-cb0e-4a36-8432-d63de90241e5-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-8drl8" (UID: "af452f6b-cb0e-4a36-8432-d63de90241e5") : secret "plugin-serving-cert" not found Jun 08 18:24:38.010528 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.010508 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/af452f6b-cb0e-4a36-8432-d63de90241e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.034202 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.034177 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxksg\" (UniqueName: \"kubernetes.io/projected/af452f6b-cb0e-4a36-8432-d63de90241e5-kube-api-access-dxksg\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.514026 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.513998 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/af452f6b-cb0e-4a36-8432-d63de90241e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.516805 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.516778 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/af452f6b-cb0e-4a36-8432-d63de90241e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8drl8\" (UID: \"af452f6b-cb0e-4a36-8432-d63de90241e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.765173 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.765103 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" Jun 08 18:24:38.896169 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:38.896145 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8"] Jun 08 18:24:38.897626 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:24:38.897602 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf452f6b_cb0e_4a36_8432_d63de90241e5.slice/crio-d7fc1e1608e4cd0074f9620543d5777f0dc7958fa7e8a2c5342a564006ddc440 WatchSource:0}: Error finding container d7fc1e1608e4cd0074f9620543d5777f0dc7958fa7e8a2c5342a564006ddc440: Status 404 returned error can't find the container with id d7fc1e1608e4cd0074f9620543d5777f0dc7958fa7e8a2c5342a564006ddc440 Jun 08 18:24:39.215139 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:39.215112 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" event={"ID":"af452f6b-cb0e-4a36-8432-d63de90241e5","Type":"ContainerStarted","Data":"d7fc1e1608e4cd0074f9620543d5777f0dc7958fa7e8a2c5342a564006ddc440"} Jun 08 18:24:45.198481 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:45.198433 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jn98z" Jun 08 18:24:46.202430 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:46.202395 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:48.556883 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.556850 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x"] Jun 08 18:24:48.557336 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.557037 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" containerName="manager" containerID="cri-o://01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1" gracePeriod=2 Jun 08 18:24:48.563634 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.563609 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x"] Jun 08 18:24:48.618103 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.617708 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc"] Jun 08 18:24:48.618273 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.618253 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" containerName="manager" Jun 08 18:24:48.618353 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.618276 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" containerName="manager" Jun 08 18:24:48.618413 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.618394 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" containerName="manager" Jun 08 18:24:48.621332 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.621309 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:48.660739 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:48.660708 2531 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" is forbidden: User \"system:node:ip-10-0-132-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-8.ec2.internal' and this object" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:48.700729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.700698 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc"] Jun 08 18:24:48.701958 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.701927 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjhd7\" (UniqueName: \"kubernetes.io/projected/58a61dd5-9674-44f2-9dbc-379665aa1e4b-kube-api-access-zjhd7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvqbc\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:48.702100 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.702004 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58a61dd5-9674-44f2-9dbc-379665aa1e4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvqbc\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:48.803333 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.803300 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjhd7\" (UniqueName: \"kubernetes.io/projected/58a61dd5-9674-44f2-9dbc-379665aa1e4b-kube-api-access-zjhd7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvqbc\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:48.803489 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.803369 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58a61dd5-9674-44f2-9dbc-379665aa1e4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvqbc\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:48.803749 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.803723 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58a61dd5-9674-44f2-9dbc-379665aa1e4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvqbc\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:48.823098 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.823041 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjhd7\" (UniqueName: \"kubernetes.io/projected/58a61dd5-9674-44f2-9dbc-379665aa1e4b-kube-api-access-zjhd7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvqbc\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:48.859861 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.859841 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:48.862381 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:48.862352 2531 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" is forbidden: User \"system:node:ip-10-0-132-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-8.ec2.internal' and this object" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:48.936978 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:48.936956 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:49.005488 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.005262 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jfcs\" (UniqueName: \"kubernetes.io/projected/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-kube-api-access-4jfcs\") pod \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " Jun 08 18:24:49.005488 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.005337 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-extensions-socket-volume\") pod \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\" (UID: \"cb3bf50c-5ada-4fa9-bbed-c60576b1702e\") " Jun 08 18:24:49.006079 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.006045 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb3bf50c-5ada-4fa9-bbed-c60576b1702e" (UID: "cb3bf50c-5ada-4fa9-bbed-c60576b1702e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:24:49.007191 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.007166 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-kube-api-access-4jfcs" (OuterVolumeSpecName: "kube-api-access-4jfcs") pod "cb3bf50c-5ada-4fa9-bbed-c60576b1702e" (UID: "cb3bf50c-5ada-4fa9-bbed-c60576b1702e"). InnerVolumeSpecName "kube-api-access-4jfcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:24:49.097983 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:24:49.097954 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a61dd5_9674_44f2_9dbc_379665aa1e4b.slice/crio-b6795948031be50bfeb22f16b1782869a967378b30938d9c75af8ca0c01610c2 WatchSource:0}: Error finding container b6795948031be50bfeb22f16b1782869a967378b30938d9c75af8ca0c01610c2: Status 404 returned error can't find the container with id b6795948031be50bfeb22f16b1782869a967378b30938d9c75af8ca0c01610c2 Jun 08 18:24:49.102015 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.101989 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc"] Jun 08 18:24:49.106758 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.106734 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jfcs\" (UniqueName: \"kubernetes.io/projected/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-kube-api-access-4jfcs\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:24:49.106849 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.106763 2531 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb3bf50c-5ada-4fa9-bbed-c60576b1702e-extensions-socket-volume\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:24:49.273024 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.272991 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" event={"ID":"58a61dd5-9674-44f2-9dbc-379665aa1e4b","Type":"ContainerStarted","Data":"ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3"} Jun 08 18:24:49.273176 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.273071 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" event={"ID":"58a61dd5-9674-44f2-9dbc-379665aa1e4b","Type":"ContainerStarted","Data":"b6795948031be50bfeb22f16b1782869a967378b30938d9c75af8ca0c01610c2"} Jun 08 18:24:49.273176 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.273101 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:24:49.274174 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.274151 2531 generic.go:356] "Generic (PLEG): container finished" podID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" containerID="01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1" exitCode=0 Jun 08 18:24:49.274280 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.274199 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:49.274280 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.274218 2531 scope.go:117] "RemoveContainer" containerID="01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1" Jun 08 18:24:49.276412 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:49.276379 2531 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" is forbidden: User \"system:node:ip-10-0-132-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-8.ec2.internal' and this object" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:49.282743 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.282724 2531 scope.go:117] "RemoveContainer" containerID="01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1" Jun 08 18:24:49.283013 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:49.282996 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1\": container with ID starting with 01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1 not found: ID does not exist" containerID="01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1" Jun 08 18:24:49.283082 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.283022 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1"} err="failed to get container status \"01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1\": rpc error: code = NotFound desc = could not find container \"01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1\": container with ID starting with 01341309e9bac95bc39778ae90c83340de3b039d5ddc8510d20bf9eb595c95a1 not found: ID does not exist" Jun 08 18:24:49.332817 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.332778 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" podStartSLOduration=1.332766168 podStartE2EDuration="1.332766168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:24:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:24:49.332015114 +0000 UTC m=+990.330818104" watchObservedRunningTime="2026-06-08 18:24:49.332766168 +0000 UTC m=+990.331569160" Jun 08 18:24:49.334743 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:49.334721 2531 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" is forbidden: User \"system:node:ip-10-0-132-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-8.ec2.internal' and this object" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:49.462358 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:24:49.462312 2531 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-27g2x\" is forbidden: User \"system:node:ip-10-0-132-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-8.ec2.internal' and this object" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-27g2x" Jun 08 18:24:49.464750 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:24:49.464721 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3bf50c-5ada-4fa9-bbed-c60576b1702e" path="/var/lib/kubelet/pods/cb3bf50c-5ada-4fa9-bbed-c60576b1702e/volumes" Jun 08 18:25:00.283527 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:00.283498 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:25:03.357475 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:03.357445 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" event={"ID":"af452f6b-cb0e-4a36-8432-d63de90241e5","Type":"ContainerStarted","Data":"a05f7becc2a93bec5b6c80e7d4b5985e9aded14d1096fc08df6b13a163eb0c95"} Jun 08 18:25:03.414986 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:03.414944 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8drl8" podStartSLOduration=2.135523375 podStartE2EDuration="26.414928959s" totalImagesPullingTime="24.279405584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:25:03.411628757 +0000 UTC m=+1004.410431747" watchObservedRunningTime="2026-06-08 18:25:03.414928959 +0000 UTC m=+1004.413731951" Jun 08 18:25:06.996069 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:06.996034 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc"] Jun 08 18:25:06.996466 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:06.996233 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" podUID="58a61dd5-9674-44f2-9dbc-379665aa1e4b" containerName="manager" containerID="cri-o://ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3" gracePeriod=10 Jun 08 18:25:07.246327 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.246277 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:25:07.262970 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.262953 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58a61dd5-9674-44f2-9dbc-379665aa1e4b-extensions-socket-volume\") pod \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " Jun 08 18:25:07.263032 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.262999 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjhd7\" (UniqueName: \"kubernetes.io/projected/58a61dd5-9674-44f2-9dbc-379665aa1e4b-kube-api-access-zjhd7\") pod \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\" (UID: \"58a61dd5-9674-44f2-9dbc-379665aa1e4b\") " Jun 08 18:25:07.263366 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.263341 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a61dd5-9674-44f2-9dbc-379665aa1e4b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "58a61dd5-9674-44f2-9dbc-379665aa1e4b" (UID: "58a61dd5-9674-44f2-9dbc-379665aa1e4b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:25:07.264883 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.264858 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a61dd5-9674-44f2-9dbc-379665aa1e4b-kube-api-access-zjhd7" (OuterVolumeSpecName: "kube-api-access-zjhd7") pod "58a61dd5-9674-44f2-9dbc-379665aa1e4b" (UID: "58a61dd5-9674-44f2-9dbc-379665aa1e4b"). InnerVolumeSpecName "kube-api-access-zjhd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:25:07.363842 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.363816 2531 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58a61dd5-9674-44f2-9dbc-379665aa1e4b-extensions-socket-volume\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:25:07.363842 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.363839 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjhd7\" (UniqueName: \"kubernetes.io/projected/58a61dd5-9674-44f2-9dbc-379665aa1e4b-kube-api-access-zjhd7\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:25:07.378006 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.377976 2531 generic.go:356] "Generic (PLEG): container finished" podID="58a61dd5-9674-44f2-9dbc-379665aa1e4b" containerID="ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3" exitCode=0 Jun 08 18:25:07.378111 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.378009 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" event={"ID":"58a61dd5-9674-44f2-9dbc-379665aa1e4b","Type":"ContainerDied","Data":"ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3"} Jun 08 18:25:07.378111 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.378061 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" event={"ID":"58a61dd5-9674-44f2-9dbc-379665aa1e4b","Type":"ContainerDied","Data":"b6795948031be50bfeb22f16b1782869a967378b30938d9c75af8ca0c01610c2"} Jun 08 18:25:07.378111 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.378086 2531 scope.go:117] "RemoveContainer" containerID="ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3" Jun 08 18:25:07.378111 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.378016 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc" Jun 08 18:25:07.388549 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.388532 2531 scope.go:117] "RemoveContainer" containerID="ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3" Jun 08 18:25:07.388813 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:25:07.388792 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3\": container with ID starting with ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3 not found: ID does not exist" containerID="ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3" Jun 08 18:25:07.388862 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.388820 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3"} err="failed to get container status \"ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3\": rpc error: code = NotFound desc = could not find container \"ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3\": container with ID starting with ad12b40e6805cb4de64959c028381ddaf2a6db462f4c8a92024c6bbbca3746d3 not found: ID does not exist" Jun 08 18:25:07.409810 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.409791 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc"] Jun 08 18:25:07.427824 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.427807 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvqbc"] Jun 08 18:25:07.461559 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:07.461538 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a61dd5-9674-44f2-9dbc-379665aa1e4b" path="/var/lib/kubelet/pods/58a61dd5-9674-44f2-9dbc-379665aa1e4b/volumes" Jun 08 18:25:23.618505 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.618462 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb"] Jun 08 18:25:23.619404 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.619085 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a61dd5-9674-44f2-9dbc-379665aa1e4b" containerName="manager" Jun 08 18:25:23.619404 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.619104 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a61dd5-9674-44f2-9dbc-379665aa1e4b" containerName="manager" Jun 08 18:25:23.619404 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.619183 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="58a61dd5-9674-44f2-9dbc-379665aa1e4b" containerName="manager" Jun 08 18:25:23.782812 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.782781 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb"] Jun 08 18:25:23.782970 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.782874 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.786326 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.786309 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2mp9f\"" Jun 08 18:25:23.884364 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884309 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884364 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884343 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884371 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884388 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884448 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884509 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884469 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884508 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqvp\" (UniqueName: \"kubernetes.io/projected/7ba911c2-309d-453a-b9bf-e9830d2a614d-kube-api-access-bnqvp\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884541 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.884700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.884604 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba911c2-309d-453a-b9bf-e9830d2a614d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985566 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985544 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985674 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985575 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985674 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985604 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985787 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985720 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985859 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985793 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985859 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985832 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985990 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985863 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqvp\" (UniqueName: \"kubernetes.io/projected/7ba911c2-309d-453a-b9bf-e9830d2a614d-kube-api-access-bnqvp\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985990 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985926 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985990 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985955 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.985990 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.985969 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba911c2-309d-453a-b9bf-e9830d2a614d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.986185 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.986038 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.986256 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.986211 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.986359 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.986337 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.986691 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.986673 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba911c2-309d-453a-b9bf-e9830d2a614d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.987939 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.987922 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.988157 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.988141 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.997874 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.997853 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba911c2-309d-453a-b9bf-e9830d2a614d-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:23.998405 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:23.998388 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqvp\" (UniqueName: \"kubernetes.io/projected/7ba911c2-309d-453a-b9bf-e9830d2a614d-kube-api-access-bnqvp\") pod \"maas-default-gateway-openshift-default-687ff6996-d7fwb\" (UID: \"7ba911c2-309d-453a-b9bf-e9830d2a614d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:24.092410 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.092384 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:24.245938 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.245908 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb"] Jun 08 18:25:24.247572 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:25:24.247546 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba911c2_309d_453a_b9bf_e9830d2a614d.slice/crio-4473897e529de6f9eab3998a29f02bee0b6e8ecb8615d8b10b8cdb6e15093620 WatchSource:0}: Error finding container 4473897e529de6f9eab3998a29f02bee0b6e8ecb8615d8b10b8cdb6e15093620: Status 404 returned error can't find the container with id 4473897e529de6f9eab3998a29f02bee0b6e8ecb8615d8b10b8cdb6e15093620 Jun 08 18:25:24.249676 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.249649 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:25:24.249743 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.249706 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:25:24.249743 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.249734 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:25:24.460325 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.460238 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" event={"ID":"7ba911c2-309d-453a-b9bf-e9830d2a614d","Type":"ContainerStarted","Data":"481e6a91e65c64fb34fbb8ce1a37431d6d4bd989b3da1888a4873d9ef8d17074"} Jun 08 18:25:24.460325 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.460310 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" event={"ID":"7ba911c2-309d-453a-b9bf-e9830d2a614d","Type":"ContainerStarted","Data":"4473897e529de6f9eab3998a29f02bee0b6e8ecb8615d8b10b8cdb6e15093620"} Jun 08 18:25:24.486354 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:24.486275 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" podStartSLOduration=1.486256638 podStartE2EDuration="1.486256638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:25:24.485723159 +0000 UTC m=+1025.484526166" watchObservedRunningTime="2026-06-08 18:25:24.486256638 +0000 UTC m=+1025.485059636" Jun 08 18:25:25.093506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:25.093474 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:25.097873 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:25.097852 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:25.464700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:25.464665 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:25.465531 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:25.465517 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:25:28.086266 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.086232 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l96n"] Jun 08 18:25:28.526144 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.526111 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l96n"] Jun 08 18:25:28.526320 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.526183 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l96n"] Jun 08 18:25:28.526320 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.526221 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.529661 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.529640 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 18:25:28.626126 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.626101 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gts64\" (UniqueName: \"kubernetes.io/projected/2b275903-9e3b-4390-9a1c-391450b9f31e-kube-api-access-gts64\") pod \"limitador-limitador-64c94fd64f-4l96n\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.626267 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.626245 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b275903-9e3b-4390-9a1c-391450b9f31e-config-file\") pod \"limitador-limitador-64c94fd64f-4l96n\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.726700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.726676 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gts64\" (UniqueName: \"kubernetes.io/projected/2b275903-9e3b-4390-9a1c-391450b9f31e-kube-api-access-gts64\") pod \"limitador-limitador-64c94fd64f-4l96n\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.726821 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.726717 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b275903-9e3b-4390-9a1c-391450b9f31e-config-file\") pod \"limitador-limitador-64c94fd64f-4l96n\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.727281 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.727264 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b275903-9e3b-4390-9a1c-391450b9f31e-config-file\") pod \"limitador-limitador-64c94fd64f-4l96n\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.735332 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.735307 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gts64\" (UniqueName: \"kubernetes.io/projected/2b275903-9e3b-4390-9a1c-391450b9f31e-kube-api-access-gts64\") pod \"limitador-limitador-64c94fd64f-4l96n\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.836563 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.836512 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:28.920727 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.920699 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7g87p"] Jun 08 18:25:28.926601 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.926584 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7g87p" Jun 08 18:25:28.930499 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.930316 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5jmpk\"" Jun 08 18:25:28.939216 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:28.939184 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7g87p"] Jun 08 18:25:29.025478 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:29.025457 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l96n"] Jun 08 18:25:29.028003 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:25:29.027969 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b275903_9e3b_4390_9a1c_391450b9f31e.slice/crio-2af20db136803e5ff187d35231e5e2840db144b8e726fb1ff10054dd0b66635d WatchSource:0}: Error finding container 2af20db136803e5ff187d35231e5e2840db144b8e726fb1ff10054dd0b66635d: Status 404 returned error can't find the container with id 2af20db136803e5ff187d35231e5e2840db144b8e726fb1ff10054dd0b66635d Jun 08 18:25:29.030089 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:29.030046 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f5hv\" (UniqueName: \"kubernetes.io/projected/e9d0604e-d8c3-470a-b0a2-11a5f22699c8-kube-api-access-9f5hv\") pod \"authorino-58cd955675-7g87p\" (UID: \"e9d0604e-d8c3-470a-b0a2-11a5f22699c8\") " pod="kuadrant-system/authorino-58cd955675-7g87p" Jun 08 18:25:29.131206 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:29.131176 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f5hv\" (UniqueName: \"kubernetes.io/projected/e9d0604e-d8c3-470a-b0a2-11a5f22699c8-kube-api-access-9f5hv\") pod \"authorino-58cd955675-7g87p\" (UID: \"e9d0604e-d8c3-470a-b0a2-11a5f22699c8\") " pod="kuadrant-system/authorino-58cd955675-7g87p" Jun 08 18:25:29.140410 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:29.140381 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f5hv\" (UniqueName: \"kubernetes.io/projected/e9d0604e-d8c3-470a-b0a2-11a5f22699c8-kube-api-access-9f5hv\") pod \"authorino-58cd955675-7g87p\" (UID: \"e9d0604e-d8c3-470a-b0a2-11a5f22699c8\") " pod="kuadrant-system/authorino-58cd955675-7g87p" Jun 08 18:25:29.242266 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:29.242242 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7g87p" Jun 08 18:25:29.487137 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:29.487103 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" event={"ID":"2b275903-9e3b-4390-9a1c-391450b9f31e","Type":"ContainerStarted","Data":"2af20db136803e5ff187d35231e5e2840db144b8e726fb1ff10054dd0b66635d"} Jun 08 18:25:29.558238 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:29.558216 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7g87p"] Jun 08 18:25:29.560075 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:25:29.560045 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9d0604e_d8c3_470a_b0a2_11a5f22699c8.slice/crio-b2112c2b9ec5eead1ac8f3a08b611a25d90e4a37ffadf6f70b1e959695e8ba9f WatchSource:0}: Error finding container b2112c2b9ec5eead1ac8f3a08b611a25d90e4a37ffadf6f70b1e959695e8ba9f: Status 404 returned error can't find the container with id b2112c2b9ec5eead1ac8f3a08b611a25d90e4a37ffadf6f70b1e959695e8ba9f Jun 08 18:25:30.496780 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:30.496742 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7g87p" event={"ID":"e9d0604e-d8c3-470a-b0a2-11a5f22699c8","Type":"ContainerStarted","Data":"b2112c2b9ec5eead1ac8f3a08b611a25d90e4a37ffadf6f70b1e959695e8ba9f"} Jun 08 18:25:34.147167 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.147141 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7g87p"] Jun 08 18:25:34.520562 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.520519 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" event={"ID":"2b275903-9e3b-4390-9a1c-391450b9f31e","Type":"ContainerStarted","Data":"a3430baff1f6c35e90588c824ed7b4f80ed4d3123a3aaed10d32c2b6d99f066d"} Jun 08 18:25:34.520752 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.520581 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:34.522000 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.521973 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7g87p" event={"ID":"e9d0604e-d8c3-470a-b0a2-11a5f22699c8","Type":"ContainerStarted","Data":"996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81"} Jun 08 18:25:34.522114 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.522020 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7g87p" podUID="e9d0604e-d8c3-470a-b0a2-11a5f22699c8" containerName="authorino" containerID="cri-o://996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81" gracePeriod=30 Jun 08 18:25:34.542960 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.542917 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" podStartSLOduration=1.47620916 podStartE2EDuration="6.542878445s" totalImagesPullingTime="5.066669285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:25:34.54220782 +0000 UTC m=+1035.541010813" watchObservedRunningTime="2026-06-08 18:25:34.542878445 +0000 UTC m=+1035.541681438" Jun 08 18:25:34.558101 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.558065 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7g87p" podStartSLOduration=2.020893286 podStartE2EDuration="6.558049631s" totalImagesPullingTime="4.537156345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:25:34.556156907 +0000 UTC m=+1035.554959901" watchObservedRunningTime="2026-06-08 18:25:34.558049631 +0000 UTC m=+1035.556852626" Jun 08 18:25:34.773585 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.773532 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7g87p" Jun 08 18:25:34.887115 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.887088 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f5hv\" (UniqueName: \"kubernetes.io/projected/e9d0604e-d8c3-470a-b0a2-11a5f22699c8-kube-api-access-9f5hv\") pod \"e9d0604e-d8c3-470a-b0a2-11a5f22699c8\" (UID: \"e9d0604e-d8c3-470a-b0a2-11a5f22699c8\") " Jun 08 18:25:34.889035 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.889011 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d0604e-d8c3-470a-b0a2-11a5f22699c8-kube-api-access-9f5hv" (OuterVolumeSpecName: "kube-api-access-9f5hv") pod "e9d0604e-d8c3-470a-b0a2-11a5f22699c8" (UID: "e9d0604e-d8c3-470a-b0a2-11a5f22699c8"). InnerVolumeSpecName "kube-api-access-9f5hv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:25:34.988113 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:34.988091 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f5hv\" (UniqueName: \"kubernetes.io/projected/e9d0604e-d8c3-470a-b0a2-11a5f22699c8-kube-api-access-9f5hv\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:25:35.527295 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.527265 2531 generic.go:356] "Generic (PLEG): container finished" podID="e9d0604e-d8c3-470a-b0a2-11a5f22699c8" containerID="996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81" exitCode=0 Jun 08 18:25:35.527687 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.527301 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7g87p" Jun 08 18:25:35.527687 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.527335 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7g87p" event={"ID":"e9d0604e-d8c3-470a-b0a2-11a5f22699c8","Type":"ContainerDied","Data":"996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81"} Jun 08 18:25:35.527687 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.527372 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7g87p" event={"ID":"e9d0604e-d8c3-470a-b0a2-11a5f22699c8","Type":"ContainerDied","Data":"b2112c2b9ec5eead1ac8f3a08b611a25d90e4a37ffadf6f70b1e959695e8ba9f"} Jun 08 18:25:35.527687 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.527397 2531 scope.go:117] "RemoveContainer" containerID="996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81" Jun 08 18:25:35.535620 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.535603 2531 scope.go:117] "RemoveContainer" containerID="996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81" Jun 08 18:25:35.535850 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:25:35.535833 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81\": container with ID starting with 996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81 not found: ID does not exist" containerID="996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81" Jun 08 18:25:35.535938 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.535863 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81"} err="failed to get container status \"996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81\": rpc error: code = NotFound desc = could not find container \"996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81\": container with ID starting with 996d860739b97424e3b22069737b9517e65d8d4c13ad4ecdd6a2f4275dbdee81 not found: ID does not exist" Jun 08 18:25:35.543868 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.543837 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7g87p"] Jun 08 18:25:35.548198 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:35.548179 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7g87p"] Jun 08 18:25:37.468044 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:37.468010 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d0604e-d8c3-470a-b0a2-11a5f22699c8" path="/var/lib/kubelet/pods/e9d0604e-d8c3-470a-b0a2-11a5f22699c8/volumes" Jun 08 18:25:45.164792 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.164751 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l96n"] Jun 08 18:25:45.165249 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.164997 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" podUID="2b275903-9e3b-4390-9a1c-391450b9f31e" containerName="limitador" containerID="cri-o://a3430baff1f6c35e90588c824ed7b4f80ed4d3123a3aaed10d32c2b6d99f066d" gracePeriod=30 Jun 08 18:25:45.166937 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.166907 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:45.577715 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.577683 2531 generic.go:356] "Generic (PLEG): container finished" podID="2b275903-9e3b-4390-9a1c-391450b9f31e" containerID="a3430baff1f6c35e90588c824ed7b4f80ed4d3123a3aaed10d32c2b6d99f066d" exitCode=0 Jun 08 18:25:45.577848 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.577745 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" event={"ID":"2b275903-9e3b-4390-9a1c-391450b9f31e","Type":"ContainerDied","Data":"a3430baff1f6c35e90588c824ed7b4f80ed4d3123a3aaed10d32c2b6d99f066d"} Jun 08 18:25:45.631742 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.631717 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:45.780451 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.780381 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b275903-9e3b-4390-9a1c-391450b9f31e-config-file\") pod \"2b275903-9e3b-4390-9a1c-391450b9f31e\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " Jun 08 18:25:45.780589 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.780499 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gts64\" (UniqueName: \"kubernetes.io/projected/2b275903-9e3b-4390-9a1c-391450b9f31e-kube-api-access-gts64\") pod \"2b275903-9e3b-4390-9a1c-391450b9f31e\" (UID: \"2b275903-9e3b-4390-9a1c-391450b9f31e\") " Jun 08 18:25:45.780730 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.780705 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b275903-9e3b-4390-9a1c-391450b9f31e-config-file" (OuterVolumeSpecName: "config-file") pod "2b275903-9e3b-4390-9a1c-391450b9f31e" (UID: "2b275903-9e3b-4390-9a1c-391450b9f31e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:25:45.782587 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.782566 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b275903-9e3b-4390-9a1c-391450b9f31e-kube-api-access-gts64" (OuterVolumeSpecName: "kube-api-access-gts64") pod "2b275903-9e3b-4390-9a1c-391450b9f31e" (UID: "2b275903-9e3b-4390-9a1c-391450b9f31e"). InnerVolumeSpecName "kube-api-access-gts64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:25:45.881557 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.881533 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gts64\" (UniqueName: \"kubernetes.io/projected/2b275903-9e3b-4390-9a1c-391450b9f31e-kube-api-access-gts64\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:25:45.881557 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:45.881554 2531 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b275903-9e3b-4390-9a1c-391450b9f31e-config-file\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:25:46.583536 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:46.583508 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" Jun 08 18:25:46.583982 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:46.583533 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l96n" event={"ID":"2b275903-9e3b-4390-9a1c-391450b9f31e","Type":"ContainerDied","Data":"2af20db136803e5ff187d35231e5e2840db144b8e726fb1ff10054dd0b66635d"} Jun 08 18:25:46.583982 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:46.583585 2531 scope.go:117] "RemoveContainer" containerID="a3430baff1f6c35e90588c824ed7b4f80ed4d3123a3aaed10d32c2b6d99f066d" Jun 08 18:25:46.607798 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:46.607773 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l96n"] Jun 08 18:25:46.609525 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:46.609506 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l96n"] Jun 08 18:25:47.464347 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:47.464318 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b275903-9e3b-4390-9a1c-391450b9f31e" path="/var/lib/kubelet/pods/2b275903-9e3b-4390-9a1c-391450b9f31e/volumes" Jun 08 18:25:49.340697 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.340667 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-xrxlp"] Jun 08 18:25:49.341129 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.341046 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d0604e-d8c3-470a-b0a2-11a5f22699c8" containerName="authorino" Jun 08 18:25:49.341129 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.341058 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d0604e-d8c3-470a-b0a2-11a5f22699c8" containerName="authorino" Jun 08 18:25:49.341129 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.341101 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b275903-9e3b-4390-9a1c-391450b9f31e" containerName="limitador" Jun 08 18:25:49.341129 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.341107 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b275903-9e3b-4390-9a1c-391450b9f31e" containerName="limitador" Jun 08 18:25:49.341259 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.341166 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b275903-9e3b-4390-9a1c-391450b9f31e" containerName="limitador" Jun 08 18:25:49.341259 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.341174 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d0604e-d8c3-470a-b0a2-11a5f22699c8" containerName="authorino" Jun 08 18:25:49.343806 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.343790 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.346577 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.346554 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 08 18:25:49.358390 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.358369 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-xrxlp"] Jun 08 18:25:49.411157 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.411135 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3a282e2a-6285-4402-9401-965ad79885ec-data\") pod \"postgres-69fb4594cf-xrxlp\" (UID: \"3a282e2a-6285-4402-9401-965ad79885ec\") " pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.411258 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.411173 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfqb4\" (UniqueName: \"kubernetes.io/projected/3a282e2a-6285-4402-9401-965ad79885ec-kube-api-access-bfqb4\") pod \"postgres-69fb4594cf-xrxlp\" (UID: \"3a282e2a-6285-4402-9401-965ad79885ec\") " pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.512219 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.512196 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3a282e2a-6285-4402-9401-965ad79885ec-data\") pod \"postgres-69fb4594cf-xrxlp\" (UID: \"3a282e2a-6285-4402-9401-965ad79885ec\") " pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.512368 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.512226 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfqb4\" (UniqueName: \"kubernetes.io/projected/3a282e2a-6285-4402-9401-965ad79885ec-kube-api-access-bfqb4\") pod \"postgres-69fb4594cf-xrxlp\" (UID: \"3a282e2a-6285-4402-9401-965ad79885ec\") " pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.512622 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.512601 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3a282e2a-6285-4402-9401-965ad79885ec-data\") pod \"postgres-69fb4594cf-xrxlp\" (UID: \"3a282e2a-6285-4402-9401-965ad79885ec\") " pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.520589 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.520576 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfqb4\" (UniqueName: \"kubernetes.io/projected/3a282e2a-6285-4402-9401-965ad79885ec-kube-api-access-bfqb4\") pod \"postgres-69fb4594cf-xrxlp\" (UID: \"3a282e2a-6285-4402-9401-965ad79885ec\") " pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.654651 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.654621 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:49.783521 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:49.783489 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-xrxlp"] Jun 08 18:25:49.784913 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:25:49.784865 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a282e2a_6285_4402_9401_965ad79885ec.slice/crio-0706caa7312604c813e1ef458cfc443f62723890f6cc7d96b84ec27cf129b9b9 WatchSource:0}: Error finding container 0706caa7312604c813e1ef458cfc443f62723890f6cc7d96b84ec27cf129b9b9: Status 404 returned error can't find the container with id 0706caa7312604c813e1ef458cfc443f62723890f6cc7d96b84ec27cf129b9b9 Jun 08 18:25:50.605311 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:50.605273 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-xrxlp" event={"ID":"3a282e2a-6285-4402-9401-965ad79885ec","Type":"ContainerStarted","Data":"0706caa7312604c813e1ef458cfc443f62723890f6cc7d96b84ec27cf129b9b9"} Jun 08 18:25:52.618283 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:52.618242 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-xrxlp" event={"ID":"3a282e2a-6285-4402-9401-965ad79885ec","Type":"ContainerStarted","Data":"aa407992a5f2b42c959a0c67c1e841e90f4be7ae82dc1fce2c9be31d25eab87f"} Jun 08 18:25:52.618758 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:52.618375 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:25:52.638678 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:52.638637 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-xrxlp" podStartSLOduration=1.444698921 podStartE2EDuration="3.638623755s" totalImagesPullingTime="2.193924834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:25:52.636743008 +0000 UTC m=+1053.635546003" watchObservedRunningTime="2026-06-08 18:25:52.638623755 +0000 UTC m=+1053.637426748" Jun 08 18:25:58.657523 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:25:58.657491 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-xrxlp" Jun 08 18:26:25.706730 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.706697 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:26:25.711456 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.711439 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:25.714149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.714125 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 18:26:25.714256 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.714191 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-97892\"" Jun 08 18:26:25.714418 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.714399 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 18:26:25.714692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.714677 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 18:26:25.720713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.720692 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:26:25.783806 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.783783 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfhhj\" (UniqueName: \"kubernetes.io/projected/fe953b79-5b27-4641-93e9-c1857de9677a-kube-api-access-jfhhj\") pod \"maas-keycloak-0\" (UID: \"fe953b79-5b27-4641-93e9-c1857de9677a\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:25.884317 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.884291 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfhhj\" (UniqueName: \"kubernetes.io/projected/fe953b79-5b27-4641-93e9-c1857de9677a-kube-api-access-jfhhj\") pod \"maas-keycloak-0\" (UID: \"fe953b79-5b27-4641-93e9-c1857de9677a\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:25.893314 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:25.893292 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfhhj\" (UniqueName: \"kubernetes.io/projected/fe953b79-5b27-4641-93e9-c1857de9677a-kube-api-access-jfhhj\") pod \"maas-keycloak-0\" (UID: \"fe953b79-5b27-4641-93e9-c1857de9677a\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:26.022524 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:26.022436 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:26.155866 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:26.155826 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:26:26.157428 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:26:26.157401 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe953b79_5b27_4641_93e9_c1857de9677a.slice/crio-32a41d28fb4c83c9d23ab8b3430f11695d7921ed4d6b6b603d11b895ea95b441 WatchSource:0}: Error finding container 32a41d28fb4c83c9d23ab8b3430f11695d7921ed4d6b6b603d11b895ea95b441: Status 404 returned error can't find the container with id 32a41d28fb4c83c9d23ab8b3430f11695d7921ed4d6b6b603d11b895ea95b441 Jun 08 18:26:26.782309 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:26.782269 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fe953b79-5b27-4641-93e9-c1857de9677a","Type":"ContainerStarted","Data":"32a41d28fb4c83c9d23ab8b3430f11695d7921ed4d6b6b603d11b895ea95b441"} Jun 08 18:26:31.810073 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:31.810029 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fe953b79-5b27-4641-93e9-c1857de9677a","Type":"ContainerStarted","Data":"1cc67a771c6ad11833a514a8eacadc5d808f8aa6cb50ca0d391962d545df5aaa"} Jun 08 18:26:31.838803 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:31.838745 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.680210585 podStartE2EDuration="6.838725114s" totalImagesPullingTime="5.158514529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:26:31.837702149 +0000 UTC m=+1092.836505143" watchObservedRunningTime="2026-06-08 18:26:31.838725114 +0000 UTC m=+1092.837528108" Jun 08 18:26:32.023234 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:32.023185 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:32.024975 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:32.024930 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:33.022994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:33.022942 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:34.023919 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:34.023843 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:35.023832 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:35.023772 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:36.023210 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:36.023171 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:36.024289 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:36.023816 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:37.023703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:37.023649 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:38.023242 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:38.023185 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:39.022910 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:39.022855 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:40.023395 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:40.023350 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:41.023552 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:41.023505 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:42.023153 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:42.023087 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:43.022822 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:43.022778 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:26:44.106286 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:44.106236 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:44.119648 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:44.119602 2531 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:26:54.113822 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:54.113788 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:26:55.105840 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.105807 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vngwl"] Jun 08 18:26:55.112475 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.112458 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vngwl" Jun 08 18:26:55.114995 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.114978 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5jmpk\"" Jun 08 18:26:55.118925 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.118902 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vngwl"] Jun 08 18:26:55.271457 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.271430 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmd4r\" (UniqueName: \"kubernetes.io/projected/7a58dd5b-211d-4890-9f5f-ab313f3e79c6-kube-api-access-jmd4r\") pod \"authorino-5d4b67c446-vngwl\" (UID: \"7a58dd5b-211d-4890-9f5f-ab313f3e79c6\") " pod="kuadrant-system/authorino-5d4b67c446-vngwl" Jun 08 18:26:55.372746 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.372689 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmd4r\" (UniqueName: \"kubernetes.io/projected/7a58dd5b-211d-4890-9f5f-ab313f3e79c6-kube-api-access-jmd4r\") pod \"authorino-5d4b67c446-vngwl\" (UID: \"7a58dd5b-211d-4890-9f5f-ab313f3e79c6\") " pod="kuadrant-system/authorino-5d4b67c446-vngwl" Jun 08 18:26:55.382195 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.382164 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vngwl"] Jun 08 18:26:55.382373 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:26:55.382353 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jmd4r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-vngwl" podUID="7a58dd5b-211d-4890-9f5f-ab313f3e79c6" Jun 08 18:26:55.383977 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.383954 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmd4r\" (UniqueName: \"kubernetes.io/projected/7a58dd5b-211d-4890-9f5f-ab313f3e79c6-kube-api-access-jmd4r\") pod \"authorino-5d4b67c446-vngwl\" (UID: \"7a58dd5b-211d-4890-9f5f-ab313f3e79c6\") " pod="kuadrant-system/authorino-5d4b67c446-vngwl" Jun 08 18:26:55.412543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.412521 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b8656589b-d4wmc"] Jun 08 18:26:55.414679 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.414664 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8656589b-d4wmc" Jun 08 18:26:55.423598 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.423577 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b8656589b-d4wmc"] Jun 08 18:26:55.573535 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.573512 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p26w\" (UniqueName: \"kubernetes.io/projected/2031c3cf-19f5-4164-8d8e-d4986962e0b8-kube-api-access-7p26w\") pod \"authorino-b8656589b-d4wmc\" (UID: \"2031c3cf-19f5-4164-8d8e-d4986962e0b8\") " pod="kuadrant-system/authorino-b8656589b-d4wmc" Jun 08 18:26:55.633961 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.633905 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8656589b-d4wmc"] Jun 08 18:26:55.634096 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:26:55.634079 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7p26w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b8656589b-d4wmc" podUID="2031c3cf-19f5-4164-8d8e-d4986962e0b8" Jun 08 18:26:55.665155 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.665131 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fdfd4b57b-ksnww"] Jun 08 18:26:55.667204 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.667190 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:55.669858 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.669843 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 18:26:55.673988 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.673967 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p26w\" (UniqueName: \"kubernetes.io/projected/2031c3cf-19f5-4164-8d8e-d4986962e0b8-kube-api-access-7p26w\") pod \"authorino-b8656589b-d4wmc\" (UID: \"2031c3cf-19f5-4164-8d8e-d4986962e0b8\") " pod="kuadrant-system/authorino-b8656589b-d4wmc" Jun 08 18:26:55.678510 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.678489 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fdfd4b57b-ksnww"] Jun 08 18:26:55.687680 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.687654 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p26w\" (UniqueName: \"kubernetes.io/projected/2031c3cf-19f5-4164-8d8e-d4986962e0b8-kube-api-access-7p26w\") pod \"authorino-b8656589b-d4wmc\" (UID: \"2031c3cf-19f5-4164-8d8e-d4986962e0b8\") " pod="kuadrant-system/authorino-b8656589b-d4wmc" Jun 08 18:26:55.774775 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.774753 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khspl\" (UniqueName: \"kubernetes.io/projected/327768ab-0de2-43d4-b947-a53bb24a2a0e-kube-api-access-khspl\") pod \"authorino-6fdfd4b57b-ksnww\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:55.774885 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.774816 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/327768ab-0de2-43d4-b947-a53bb24a2a0e-tls-cert\") pod \"authorino-6fdfd4b57b-ksnww\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:55.875562 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.875540 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khspl\" (UniqueName: \"kubernetes.io/projected/327768ab-0de2-43d4-b947-a53bb24a2a0e-kube-api-access-khspl\") pod \"authorino-6fdfd4b57b-ksnww\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:55.875655 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.875603 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/327768ab-0de2-43d4-b947-a53bb24a2a0e-tls-cert\") pod \"authorino-6fdfd4b57b-ksnww\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:55.877792 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.877776 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/327768ab-0de2-43d4-b947-a53bb24a2a0e-tls-cert\") pod \"authorino-6fdfd4b57b-ksnww\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:55.883794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.883770 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khspl\" (UniqueName: \"kubernetes.io/projected/327768ab-0de2-43d4-b947-a53bb24a2a0e-kube-api-access-khspl\") pod \"authorino-6fdfd4b57b-ksnww\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:55.952653 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.952604 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8656589b-d4wmc" Jun 08 18:26:55.952729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.952608 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vngwl" Jun 08 18:26:55.958447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.958430 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8656589b-d4wmc" Jun 08 18:26:55.961476 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.961460 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vngwl" Jun 08 18:26:55.975418 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:55.975401 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:26:56.077360 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.077335 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmd4r\" (UniqueName: \"kubernetes.io/projected/7a58dd5b-211d-4890-9f5f-ab313f3e79c6-kube-api-access-jmd4r\") pod \"7a58dd5b-211d-4890-9f5f-ab313f3e79c6\" (UID: \"7a58dd5b-211d-4890-9f5f-ab313f3e79c6\") " Jun 08 18:26:56.077500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.077400 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p26w\" (UniqueName: \"kubernetes.io/projected/2031c3cf-19f5-4164-8d8e-d4986962e0b8-kube-api-access-7p26w\") pod \"2031c3cf-19f5-4164-8d8e-d4986962e0b8\" (UID: \"2031c3cf-19f5-4164-8d8e-d4986962e0b8\") " Jun 08 18:26:56.079794 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.079763 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a58dd5b-211d-4890-9f5f-ab313f3e79c6-kube-api-access-jmd4r" (OuterVolumeSpecName: "kube-api-access-jmd4r") pod "7a58dd5b-211d-4890-9f5f-ab313f3e79c6" (UID: "7a58dd5b-211d-4890-9f5f-ab313f3e79c6"). InnerVolumeSpecName "kube-api-access-jmd4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:26:56.079952 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.079768 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2031c3cf-19f5-4164-8d8e-d4986962e0b8-kube-api-access-7p26w" (OuterVolumeSpecName: "kube-api-access-7p26w") pod "2031c3cf-19f5-4164-8d8e-d4986962e0b8" (UID: "2031c3cf-19f5-4164-8d8e-d4986962e0b8"). InnerVolumeSpecName "kube-api-access-7p26w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:26:56.102824 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.102803 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fdfd4b57b-ksnww"] Jun 08 18:26:56.104871 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:26:56.104847 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod327768ab_0de2_43d4_b947_a53bb24a2a0e.slice/crio-9e0a213b2dfc72f38020659071650463e48ab03ac39ca70ee98bbe858e8d0cd1 WatchSource:0}: Error finding container 9e0a213b2dfc72f38020659071650463e48ab03ac39ca70ee98bbe858e8d0cd1: Status 404 returned error can't find the container with id 9e0a213b2dfc72f38020659071650463e48ab03ac39ca70ee98bbe858e8d0cd1 Jun 08 18:26:56.178253 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.178231 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p26w\" (UniqueName: \"kubernetes.io/projected/2031c3cf-19f5-4164-8d8e-d4986962e0b8-kube-api-access-7p26w\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:26:56.178253 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.178252 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmd4r\" (UniqueName: \"kubernetes.io/projected/7a58dd5b-211d-4890-9f5f-ab313f3e79c6-kube-api-access-jmd4r\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:26:56.958866 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.958787 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vngwl" Jun 08 18:26:56.958866 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.958821 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" event={"ID":"327768ab-0de2-43d4-b947-a53bb24a2a0e","Type":"ContainerStarted","Data":"3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472"} Jun 08 18:26:56.959139 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.958866 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" event={"ID":"327768ab-0de2-43d4-b947-a53bb24a2a0e","Type":"ContainerStarted","Data":"9e0a213b2dfc72f38020659071650463e48ab03ac39ca70ee98bbe858e8d0cd1"} Jun 08 18:26:56.959139 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.958963 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8656589b-d4wmc" Jun 08 18:26:56.985603 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:56.985561 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" podStartSLOduration=1.5034771139999998 podStartE2EDuration="1.985549314s" totalImagesPullingTime="482.0722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:26:56.983762582 +0000 UTC m=+1117.982565574" watchObservedRunningTime="2026-06-08 18:26:56.985549314 +0000 UTC m=+1117.984352340" Jun 08 18:26:57.008190 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:57.008162 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vngwl"] Jun 08 18:26:57.010964 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:57.010940 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vngwl"] Jun 08 18:26:57.039930 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:57.039900 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8656589b-d4wmc"] Jun 08 18:26:57.041777 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:57.041755 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b8656589b-d4wmc"] Jun 08 18:26:57.462902 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:57.462865 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2031c3cf-19f5-4164-8d8e-d4986962e0b8" path="/var/lib/kubelet/pods/2031c3cf-19f5-4164-8d8e-d4986962e0b8/volumes" Jun 08 18:26:57.463367 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:26:57.463203 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a58dd5b-211d-4890-9f5f-ab313f3e79c6" path="/var/lib/kubelet/pods/7a58dd5b-211d-4890-9f5f-ab313f3e79c6/volumes" Jun 08 18:27:00.918032 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:00.918000 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d795bffcd-s4ffq"] Jun 08 18:27:00.920627 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:00.920605 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:00.923965 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:00.923944 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 18:27:00.924067 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:00.923969 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ckgbs\"" Jun 08 18:27:00.924067 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:00.924024 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 18:27:00.931701 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:00.931681 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d795bffcd-s4ffq"] Jun 08 18:27:01.014442 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.014415 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a785bfb-bbb1-4618-8da0-47826caca8d7-webhook-cert\") pod \"maas-controller-6d795bffcd-s4ffq\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:01.014597 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.014501 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4fgt\" (UniqueName: \"kubernetes.io/projected/8a785bfb-bbb1-4618-8da0-47826caca8d7-kube-api-access-c4fgt\") pod \"maas-controller-6d795bffcd-s4ffq\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:01.115220 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.115190 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4fgt\" (UniqueName: \"kubernetes.io/projected/8a785bfb-bbb1-4618-8da0-47826caca8d7-kube-api-access-c4fgt\") pod \"maas-controller-6d795bffcd-s4ffq\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:01.115346 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.115280 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a785bfb-bbb1-4618-8da0-47826caca8d7-webhook-cert\") pod \"maas-controller-6d795bffcd-s4ffq\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:01.117634 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.117613 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a785bfb-bbb1-4618-8da0-47826caca8d7-webhook-cert\") pod \"maas-controller-6d795bffcd-s4ffq\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:01.128149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.128125 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4fgt\" (UniqueName: \"kubernetes.io/projected/8a785bfb-bbb1-4618-8da0-47826caca8d7-kube-api-access-c4fgt\") pod \"maas-controller-6d795bffcd-s4ffq\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:01.142233 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.142209 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-755bdf5b84-hxvn5"] Jun 08 18:27:01.144861 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.144847 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.164246 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.164225 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bdf5b84-hxvn5"] Jun 08 18:27:01.231146 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.231092 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:01.317450 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.317416 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf75a165-c054-4287-931d-919d979998a0-webhook-cert\") pod \"maas-controller-755bdf5b84-hxvn5\" (UID: \"bf75a165-c054-4287-931d-919d979998a0\") " pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.317626 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.317586 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjnvf\" (UniqueName: \"kubernetes.io/projected/bf75a165-c054-4287-931d-919d979998a0-kube-api-access-sjnvf\") pod \"maas-controller-755bdf5b84-hxvn5\" (UID: \"bf75a165-c054-4287-931d-919d979998a0\") " pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.369560 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.369538 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d795bffcd-s4ffq"] Jun 08 18:27:01.371785 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:27:01.371756 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a785bfb_bbb1_4618_8da0_47826caca8d7.slice/crio-0a916327246f60b54ed992ed2a367d52cc8cb2a63ec9a3fdc653942908e259e0 WatchSource:0}: Error finding container 0a916327246f60b54ed992ed2a367d52cc8cb2a63ec9a3fdc653942908e259e0: Status 404 returned error can't find the container with id 0a916327246f60b54ed992ed2a367d52cc8cb2a63ec9a3fdc653942908e259e0 Jun 08 18:27:01.373227 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.373208 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:27:01.418440 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.418417 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjnvf\" (UniqueName: \"kubernetes.io/projected/bf75a165-c054-4287-931d-919d979998a0-kube-api-access-sjnvf\") pod \"maas-controller-755bdf5b84-hxvn5\" (UID: \"bf75a165-c054-4287-931d-919d979998a0\") " pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.418555 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.418459 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf75a165-c054-4287-931d-919d979998a0-webhook-cert\") pod \"maas-controller-755bdf5b84-hxvn5\" (UID: \"bf75a165-c054-4287-931d-919d979998a0\") " pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.420804 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.420786 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf75a165-c054-4287-931d-919d979998a0-webhook-cert\") pod \"maas-controller-755bdf5b84-hxvn5\" (UID: \"bf75a165-c054-4287-931d-919d979998a0\") " pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.427599 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.427576 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjnvf\" (UniqueName: \"kubernetes.io/projected/bf75a165-c054-4287-931d-919d979998a0-kube-api-access-sjnvf\") pod \"maas-controller-755bdf5b84-hxvn5\" (UID: \"bf75a165-c054-4287-931d-919d979998a0\") " pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.455063 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.455034 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:01.591017 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.590994 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bdf5b84-hxvn5"] Jun 08 18:27:01.592771 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:27:01.592744 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf75a165_c054_4287_931d_919d979998a0.slice/crio-2ba13d7d29d1d62774d3f3194ac19a556b49df88f01e6c39b8b9bf3932511bbf WatchSource:0}: Error finding container 2ba13d7d29d1d62774d3f3194ac19a556b49df88f01e6c39b8b9bf3932511bbf: Status 404 returned error can't find the container with id 2ba13d7d29d1d62774d3f3194ac19a556b49df88f01e6c39b8b9bf3932511bbf Jun 08 18:27:01.987612 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.987568 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bdf5b84-hxvn5" event={"ID":"bf75a165-c054-4287-931d-919d979998a0","Type":"ContainerStarted","Data":"2ba13d7d29d1d62774d3f3194ac19a556b49df88f01e6c39b8b9bf3932511bbf"} Jun 08 18:27:01.989169 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:01.989132 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" event={"ID":"8a785bfb-bbb1-4618-8da0-47826caca8d7","Type":"ContainerStarted","Data":"0a916327246f60b54ed992ed2a367d52cc8cb2a63ec9a3fdc653942908e259e0"} Jun 08 18:27:05.005941 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:05.005883 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bdf5b84-hxvn5" event={"ID":"bf75a165-c054-4287-931d-919d979998a0","Type":"ContainerStarted","Data":"d043ae13b3e090783edf1d080067e75ad4a7b9c395fe0c5444391baf4314da00"} Jun 08 18:27:05.006444 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:05.005996 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:05.007445 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:05.007421 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" event={"ID":"8a785bfb-bbb1-4618-8da0-47826caca8d7","Type":"ContainerStarted","Data":"c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25"} Jun 08 18:27:05.007574 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:05.007559 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:05.039544 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:05.039500 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-755bdf5b84-hxvn5" podStartSLOduration=1.577522526 podStartE2EDuration="4.039485718s" totalImagesPullingTime="2.461963192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:27:05.038984389 +0000 UTC m=+1126.037787378" watchObservedRunningTime="2026-06-08 18:27:05.039485718 +0000 UTC m=+1126.038288711" Jun 08 18:27:05.079163 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:05.079125 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" podStartSLOduration=2.403197012 podStartE2EDuration="5.079112108s" totalImagesPullingTime="2.675915096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:27:05.07800159 +0000 UTC m=+1126.076804583" watchObservedRunningTime="2026-06-08 18:27:05.079112108 +0000 UTC m=+1126.077915101" Jun 08 18:27:16.018384 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.018350 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-755bdf5b84-hxvn5" Jun 08 18:27:16.018745 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.018427 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:16.092282 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.092245 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d795bffcd-s4ffq"] Jun 08 18:27:16.092500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.092477 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" podUID="8a785bfb-bbb1-4618-8da0-47826caca8d7" containerName="manager" containerID="cri-o://c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25" gracePeriod=30 Jun 08 18:27:16.339687 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.339662 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:16.439755 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.439714 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a785bfb-bbb1-4618-8da0-47826caca8d7-webhook-cert\") pod \"8a785bfb-bbb1-4618-8da0-47826caca8d7\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " Jun 08 18:27:16.439935 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.439809 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4fgt\" (UniqueName: \"kubernetes.io/projected/8a785bfb-bbb1-4618-8da0-47826caca8d7-kube-api-access-c4fgt\") pod \"8a785bfb-bbb1-4618-8da0-47826caca8d7\" (UID: \"8a785bfb-bbb1-4618-8da0-47826caca8d7\") " Jun 08 18:27:16.441817 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.441794 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a785bfb-bbb1-4618-8da0-47826caca8d7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8a785bfb-bbb1-4618-8da0-47826caca8d7" (UID: "8a785bfb-bbb1-4618-8da0-47826caca8d7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:27:16.441936 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.441854 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a785bfb-bbb1-4618-8da0-47826caca8d7-kube-api-access-c4fgt" (OuterVolumeSpecName: "kube-api-access-c4fgt") pod "8a785bfb-bbb1-4618-8da0-47826caca8d7" (UID: "8a785bfb-bbb1-4618-8da0-47826caca8d7"). InnerVolumeSpecName "kube-api-access-c4fgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:27:16.541440 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.541398 2531 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a785bfb-bbb1-4618-8da0-47826caca8d7-webhook-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:27:16.541440 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:16.541436 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4fgt\" (UniqueName: \"kubernetes.io/projected/8a785bfb-bbb1-4618-8da0-47826caca8d7-kube-api-access-c4fgt\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:27:17.068062 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.068031 2531 generic.go:356] "Generic (PLEG): container finished" podID="8a785bfb-bbb1-4618-8da0-47826caca8d7" containerID="c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25" exitCode=0 Jun 08 18:27:17.068447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.068073 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" Jun 08 18:27:17.068447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.068111 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" event={"ID":"8a785bfb-bbb1-4618-8da0-47826caca8d7","Type":"ContainerDied","Data":"c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25"} Jun 08 18:27:17.068447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.068166 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d795bffcd-s4ffq" event={"ID":"8a785bfb-bbb1-4618-8da0-47826caca8d7","Type":"ContainerDied","Data":"0a916327246f60b54ed992ed2a367d52cc8cb2a63ec9a3fdc653942908e259e0"} Jun 08 18:27:17.068447 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.068198 2531 scope.go:117] "RemoveContainer" containerID="c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25" Jun 08 18:27:17.077660 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.077642 2531 scope.go:117] "RemoveContainer" containerID="c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25" Jun 08 18:27:17.077899 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:27:17.077873 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25\": container with ID starting with c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25 not found: ID does not exist" containerID="c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25" Jun 08 18:27:17.077944 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.077916 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25"} err="failed to get container status \"c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25\": rpc error: code = NotFound desc = could not find container \"c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25\": container with ID starting with c12e0afd704075300dd7c1a3e30eef4e3cbe7574c7573c276841197cfc02fe25 not found: ID does not exist" Jun 08 18:27:17.109045 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.109020 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d795bffcd-s4ffq"] Jun 08 18:27:17.122718 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.122698 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d795bffcd-s4ffq"] Jun 08 18:27:17.468400 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:17.468368 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a785bfb-bbb1-4618-8da0-47826caca8d7" path="/var/lib/kubelet/pods/8a785bfb-bbb1-4618-8da0-47826caca8d7/volumes" Jun 08 18:27:35.178837 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.178807 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7d7b5975d4-sfhwn"] Jun 08 18:27:35.179298 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.179195 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a785bfb-bbb1-4618-8da0-47826caca8d7" containerName="manager" Jun 08 18:27:35.179298 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.179209 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a785bfb-bbb1-4618-8da0-47826caca8d7" containerName="manager" Jun 08 18:27:35.179298 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.179284 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a785bfb-bbb1-4618-8da0-47826caca8d7" containerName="manager" Jun 08 18:27:35.184366 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.184345 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.187670 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.187652 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 18:27:35.197200 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.197178 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7d7b5975d4-sfhwn"] Jun 08 18:27:35.290908 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.290855 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc46532-7e1c-4b08-af34-626d0c3fa026-maas-api-tls\") pod \"maas-api-7d7b5975d4-sfhwn\" (UID: \"cdc46532-7e1c-4b08-af34-626d0c3fa026\") " pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.291019 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.290916 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8ffb\" (UniqueName: \"kubernetes.io/projected/cdc46532-7e1c-4b08-af34-626d0c3fa026-kube-api-access-h8ffb\") pod \"maas-api-7d7b5975d4-sfhwn\" (UID: \"cdc46532-7e1c-4b08-af34-626d0c3fa026\") " pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.392237 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.392205 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc46532-7e1c-4b08-af34-626d0c3fa026-maas-api-tls\") pod \"maas-api-7d7b5975d4-sfhwn\" (UID: \"cdc46532-7e1c-4b08-af34-626d0c3fa026\") " pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.392367 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.392241 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8ffb\" (UniqueName: \"kubernetes.io/projected/cdc46532-7e1c-4b08-af34-626d0c3fa026-kube-api-access-h8ffb\") pod \"maas-api-7d7b5975d4-sfhwn\" (UID: \"cdc46532-7e1c-4b08-af34-626d0c3fa026\") " pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.394586 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.394564 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdc46532-7e1c-4b08-af34-626d0c3fa026-maas-api-tls\") pod \"maas-api-7d7b5975d4-sfhwn\" (UID: \"cdc46532-7e1c-4b08-af34-626d0c3fa026\") " pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.401604 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.401582 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8ffb\" (UniqueName: \"kubernetes.io/projected/cdc46532-7e1c-4b08-af34-626d0c3fa026-kube-api-access-h8ffb\") pod \"maas-api-7d7b5975d4-sfhwn\" (UID: \"cdc46532-7e1c-4b08-af34-626d0c3fa026\") " pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.494094 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.494035 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:35.648286 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.647217 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7d7b5975d4-sfhwn"] Jun 08 18:27:35.651015 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:27:35.650980 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc46532_7e1c_4b08_af34_626d0c3fa026.slice/crio-11ca827e5cdf61b9f238909ea627ca3efab7c1efe84b18ce0977acc638dc5fcc WatchSource:0}: Error finding container 11ca827e5cdf61b9f238909ea627ca3efab7c1efe84b18ce0977acc638dc5fcc: Status 404 returned error can't find the container with id 11ca827e5cdf61b9f238909ea627ca3efab7c1efe84b18ce0977acc638dc5fcc Jun 08 18:27:35.888599 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.888572 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vrhtm"] Jun 08 18:27:35.895577 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.895552 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" Jun 08 18:27:35.901612 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.901587 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 18:27:35.920654 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.920634 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vrhtm"] Jun 08 18:27:35.996858 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:35.996827 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nw7p\" (UniqueName: \"kubernetes.io/projected/c90c7a14-f112-4a22-a123-794843a21936-kube-api-access-4nw7p\") pod \"payload-pre-processing-67d7689b65-vrhtm\" (UID: \"c90c7a14-f112-4a22-a123-794843a21936\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" Jun 08 18:27:36.097309 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:36.097274 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nw7p\" (UniqueName: \"kubernetes.io/projected/c90c7a14-f112-4a22-a123-794843a21936-kube-api-access-4nw7p\") pod \"payload-pre-processing-67d7689b65-vrhtm\" (UID: \"c90c7a14-f112-4a22-a123-794843a21936\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" Jun 08 18:27:36.107075 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:36.107054 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nw7p\" (UniqueName: \"kubernetes.io/projected/c90c7a14-f112-4a22-a123-794843a21936-kube-api-access-4nw7p\") pod \"payload-pre-processing-67d7689b65-vrhtm\" (UID: \"c90c7a14-f112-4a22-a123-794843a21936\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" Jun 08 18:27:36.162293 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:36.162219 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerStarted","Data":"11ca827e5cdf61b9f238909ea627ca3efab7c1efe84b18ce0977acc638dc5fcc"} Jun 08 18:27:36.206490 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:36.206462 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" Jun 08 18:27:36.339451 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:36.339418 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vrhtm"] Jun 08 18:27:36.342837 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:27:36.342808 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90c7a14_f112_4a22_a123_794843a21936.slice/crio-0f486dd3b7ffe48314945dfc471ea47986a6649826217b956723f8437101dd25 WatchSource:0}: Error finding container 0f486dd3b7ffe48314945dfc471ea47986a6649826217b956723f8437101dd25: Status 404 returned error can't find the container with id 0f486dd3b7ffe48314945dfc471ea47986a6649826217b956723f8437101dd25 Jun 08 18:27:37.169021 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:37.168982 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" event={"ID":"c90c7a14-f112-4a22-a123-794843a21936","Type":"ContainerStarted","Data":"0f486dd3b7ffe48314945dfc471ea47986a6649826217b956723f8437101dd25"} Jun 08 18:27:38.175963 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:38.175846 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" event={"ID":"c90c7a14-f112-4a22-a123-794843a21936","Type":"ContainerStarted","Data":"080e322c6d125573cda7aeab877204468c25585ff9598c3e8bf444326a2338d3"} Jun 08 18:27:38.176361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:38.176062 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" Jun 08 18:27:38.177356 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:38.177328 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerStarted","Data":"65d124778f2889633d7b15fcfb67e43f6ecbf9032e69c12293d38a6a66c6b745"} Jun 08 18:27:38.177489 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:38.177380 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:38.208608 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:38.208569 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" podStartSLOduration=1.639673406 podStartE2EDuration="3.208555409s" totalImagesPullingTime="1.568882003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:27:38.206356138 +0000 UTC m=+1159.205159142" watchObservedRunningTime="2026-06-08 18:27:38.208555409 +0000 UTC m=+1159.207358380" Jun 08 18:27:38.228227 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:38.228191 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podStartSLOduration=0.968690975 podStartE2EDuration="3.22817715s" totalImagesPullingTime="2.259486175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:27:38.227750765 +0000 UTC m=+1159.226553760" watchObservedRunningTime="2026-06-08 18:27:38.22817715 +0000 UTC m=+1159.226980142" Jun 08 18:27:39.184036 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:39.184002 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="65d124778f2889633d7b15fcfb67e43f6ecbf9032e69c12293d38a6a66c6b745" exitCode=1 Jun 08 18:27:39.184420 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:39.184089 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"65d124778f2889633d7b15fcfb67e43f6ecbf9032e69c12293d38a6a66c6b745"} Jun 08 18:27:39.184420 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:39.184283 2531 scope.go:117] "RemoveContainer" containerID="65d124778f2889633d7b15fcfb67e43f6ecbf9032e69c12293d38a6a66c6b745" Jun 08 18:27:40.190661 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:40.190630 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23" exitCode=1 Jun 08 18:27:40.190661 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:40.190666 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23"} Jun 08 18:27:40.191151 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:40.190710 2531 scope.go:117] "RemoveContainer" containerID="65d124778f2889633d7b15fcfb67e43f6ecbf9032e69c12293d38a6a66c6b745" Jun 08 18:27:40.191151 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:40.190912 2531 scope.go:117] "RemoveContainer" containerID="850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23" Jun 08 18:27:40.191151 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:27:40.191134 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:27:41.201492 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:41.201467 2531 scope.go:117] "RemoveContainer" containerID="850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23" Jun 08 18:27:41.201851 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:27:41.201635 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:27:43.177563 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:43.177532 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:43.177955 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:43.177847 2531 scope.go:117] "RemoveContainer" containerID="850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23" Jun 08 18:27:43.178055 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:27:43.178034 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:27:44.226592 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:44.226559 2531 generic.go:356] "Generic (PLEG): container finished" podID="7ba911c2-309d-453a-b9bf-e9830d2a614d" containerID="481e6a91e65c64fb34fbb8ce1a37431d6d4bd989b3da1888a4873d9ef8d17074" exitCode=0 Jun 08 18:27:44.227024 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:44.226632 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" event={"ID":"7ba911c2-309d-453a-b9bf-e9830d2a614d","Type":"ContainerDied","Data":"481e6a91e65c64fb34fbb8ce1a37431d6d4bd989b3da1888a4873d9ef8d17074"} Jun 08 18:27:44.227070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:44.227034 2531 scope.go:117] "RemoveContainer" containerID="481e6a91e65c64fb34fbb8ce1a37431d6d4bd989b3da1888a4873d9ef8d17074" Jun 08 18:27:44.227985 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:44.227953 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:27:44.228091 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:44.228040 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:27:44.228132 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:44.228105 2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 18:27:45.234609 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:45.234572 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" event={"ID":"7ba911c2-309d-453a-b9bf-e9830d2a614d","Type":"ContainerStarted","Data":"2c7f909f694f3c778fd92f772b3f1984735af09aa3fc4ca9415ea8667922f491"} Jun 08 18:27:45.494221 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:45.494127 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:45.494513 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:45.494496 2531 scope.go:117] "RemoveContainer" containerID="850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23" Jun 08 18:27:45.494689 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:27:45.494670 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:27:46.092604 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:46.092556 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:27:46.092796 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:46.092782 2531 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-d7fwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jun 08 18:27:46.092846 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:46.092823 2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" podUID="7ba911c2-309d-453a-b9bf-e9830d2a614d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jun 08 18:27:47.093213 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:47.093180 2531 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-d7fwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jun 08 18:27:47.093579 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:47.093276 2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" podUID="7ba911c2-309d-453a-b9bf-e9830d2a614d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jun 08 18:27:48.093583 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:48.093545 2531 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-d7fwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jun 08 18:27:48.094003 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:48.093629 2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" podUID="7ba911c2-309d-453a-b9bf-e9830d2a614d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jun 08 18:27:49.092688 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:49.092654 2531 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-d7fwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jun 08 18:27:49.092955 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:49.092708 2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" podUID="7ba911c2-309d-453a-b9bf-e9830d2a614d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jun 08 18:27:49.186433 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:49.186407 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-vrhtm" Jun 08 18:27:50.096790 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:50.096761 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:27:50.097203 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:50.097176 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:27:50.098007 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:50.097985 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-d7fwb" Jun 08 18:27:56.456953 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:56.456925 2531 scope.go:117] "RemoveContainer" containerID="850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23" Jun 08 18:27:57.309577 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:57.309513 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1" exitCode=1 Jun 08 18:27:57.309703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:57.309589 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1"} Jun 08 18:27:57.309703 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:57.309653 2531 scope.go:117] "RemoveContainer" containerID="850f1e8e9e7251d9c8c151203262a8613a26c1e480345d24bb6705959029bc23" Jun 08 18:27:57.309948 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:57.309925 2531 scope.go:117] "RemoveContainer" containerID="42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1" Jun 08 18:27:57.310125 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:27:57.310103 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:27:58.177677 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:58.177643 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:27:58.316315 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:27:58.316295 2531 scope.go:117] "RemoveContainer" containerID="42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1" Jun 08 18:27:58.316458 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:27:58.316441 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:28:05.494469 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:05.494437 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:28:05.495010 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:05.494818 2531 scope.go:117] "RemoveContainer" containerID="42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1" Jun 08 18:28:05.495136 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:28:05.495032 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:28:16.456617 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:16.456589 2531 scope.go:117] "RemoveContainer" containerID="42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1" Jun 08 18:28:16.457099 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:28:16.456753 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:28:27.457256 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:27.457220 2531 scope.go:117] "RemoveContainer" containerID="42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1" Jun 08 18:28:28.472177 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:28.472144 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" exitCode=1 Jun 08 18:28:28.472523 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:28.472219 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c"} Jun 08 18:28:28.472523 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:28.472301 2531 scope.go:117] "RemoveContainer" containerID="42023027328b9c5e5a9ddc331e9d9a1176d630e6393af87e1b48092e7822bab1" Jun 08 18:28:28.472635 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:28.472615 2531 scope.go:117] "RemoveContainer" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" Jun 08 18:28:28.472827 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:28:28.472804 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:28:33.177604 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:33.177571 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:28:33.178004 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:33.177939 2531 scope.go:117] "RemoveContainer" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" Jun 08 18:28:33.178142 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:28:33.178121 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:28:35.495105 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:35.495067 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:28:35.495515 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:35.495326 2531 scope.go:117] "RemoveContainer" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" Jun 08 18:28:35.495515 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:28:35.495476 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:28:46.456421 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:28:46.456388 2531 scope.go:117] "RemoveContainer" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" Jun 08 18:28:46.456868 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:28:46.456617 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:29:01.456253 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:01.456220 2531 scope.go:117] "RemoveContainer" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" Jun 08 18:29:01.456746 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:29:01.456396 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:29:16.457684 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:16.457581 2531 scope.go:117] "RemoveContainer" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" Jun 08 18:29:17.712231 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:17.712196 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" exitCode=1 Jun 08 18:29:17.712691 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:17.712268 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53"} Jun 08 18:29:17.712691 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:17.712347 2531 scope.go:117] "RemoveContainer" containerID="f955d0ca7361582f761757d4aa6353326663a200f607845b1ea9c3ca96e02b2c" Jun 08 18:29:17.712691 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:17.712657 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:29:17.712868 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:29:17.712846 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:29:18.178235 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:18.178203 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:29:18.718783 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:18.718760 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:29:18.719159 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:29:18.718924 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:29:25.495172 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:25.495132 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:29:25.495562 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:25.495475 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:29:25.495665 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:29:25.495646 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:29:36.457054 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:36.457016 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:29:36.457679 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:29:36.457256 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:29:48.456402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:48.456377 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:29:48.456805 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:29:48.456578 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:29:59.462071 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:29:59.462042 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:29:59.462871 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:29:59.462837 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:30:11.457103 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:11.457063 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:30:11.457672 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:30:11.457283 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:30:22.457112 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:22.457085 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:30:22.457529 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:30:22.457261 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:30:35.463397 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:35.463361 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:30:35.463935 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:30:35.463617 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:30:46.456247 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:46.456214 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:30:47.164020 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:47.163995 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" exitCode=1 Jun 08 18:30:47.164118 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:47.164029 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54"} Jun 08 18:30:47.164118 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:47.164077 2531 scope.go:117] "RemoveContainer" containerID="a86396d8e9dcc7b9a2ea708dc67b8c1c9e86aa85c40b139fe0bbb78289e5fb53" Jun 08 18:30:47.164371 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:47.164334 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:30:47.164569 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:30:47.164549 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:30:48.177860 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:48.177825 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:30:48.178354 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:48.178209 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:30:48.178448 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:30:48.178420 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:30:55.494397 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:55.494363 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:30:55.494815 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:30:55.494706 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:30:55.494877 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:30:55.494857 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:31:06.456386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:31:06.456353 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:31:06.456825 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:31:06.456598 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:31:17.456559 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:31:17.456526 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:31:17.457076 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:31:17.456728 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:31:31.457013 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:31:31.456979 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:31:31.457441 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:31:31.457167 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:31:42.456822 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:31:42.456789 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:31:42.457273 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:31:42.457013 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:31:57.456756 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:31:57.456729 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:31:57.457225 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:31:57.456880 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:32:12.457130 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:32:12.457053 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:32:12.457485 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:32:12.457208 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:32:27.456292 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:32:27.456255 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:32:27.456824 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:32:27.456434 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:32:38.456652 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:32:38.456613 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:32:38.457277 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:32:38.456849 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:32:51.456396 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:32:51.456364 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:32:51.458833 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:32:51.456585 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:33:04.456506 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:04.456477 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:33:04.456880 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:33:04.456651 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:33:16.456831 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:16.456799 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:33:16.457349 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:33:16.457001 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:33:29.459000 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:29.458973 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:33:29.459379 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:29.459152 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:33:29.964371 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:29.964344 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerStarted","Data":"65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be"} Jun 08 18:33:29.964560 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:29.964543 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:33:30.971243 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:30.971202 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" exitCode=1 Jun 08 18:33:30.971639 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:30.971290 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be"} Jun 08 18:33:30.971639 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:30.971359 2531 scope.go:117] "RemoveContainer" containerID="bfd419fdc1863831bb34a070ef408d7dc25c370f50153fd7d557e2f0ff7f1e54" Jun 08 18:33:30.971639 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:30.971543 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:33:30.971781 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:33:30.971755 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:33:31.977671 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:31.977640 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:33:31.978094 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:33:31.977790 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:33:35.494709 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:35.494654 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:33:35.495157 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:35.495067 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:33:35.495300 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:33:35.495275 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:33:46.456529 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:33:46.456496 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:33:46.456928 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:33:46.456717 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:34:01.463416 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:34:01.463384 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:34:01.463964 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:34:01.463594 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:34:15.456530 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:34:15.456496 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:34:15.456991 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:34:15.456670 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:34:28.456219 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:34:28.456187 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:34:28.456667 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:34:28.456362 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:34:40.456868 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:34:40.456834 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:34:40.457399 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:34:40.457039 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:34:53.456638 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:34:53.456606 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:34:53.457126 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:34:53.456764 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:35:08.456782 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:35:08.456695 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:35:08.457270 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:35:08.456850 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:35:19.460642 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:35:19.460613 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:35:19.461044 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:35:19.460774 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:35:33.457221 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:35:33.457188 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:35:33.457610 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:35:33.457353 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:35:47.457022 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:35:47.456981 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:35:47.457590 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:35:47.457262 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:35:59.458729 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:35:59.458690 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:35:59.459298 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:35:59.458921 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:36:13.456793 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:36:13.456764 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:36:13.457188 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:36:13.456992 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:36:27.457140 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:36:27.457101 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:36:27.457572 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:36:27.457347 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:36:39.458980 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:36:39.458955 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:36:39.459453 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:36:39.459109 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:36:50.456876 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:36:50.456840 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:36:50.457304 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:36:50.457079 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:37:05.456441 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:37:05.456412 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:37:05.456869 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:37:05.456634 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:37:17.457121 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:37:17.457087 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:37:17.457625 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:37:17.457303 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:37:30.456635 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:37:30.456605 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:37:30.457100 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:37:30.456753 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:37:42.457250 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:37:42.457215 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:37:42.457772 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:37:42.457436 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:37:56.456731 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:37:56.456700 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:37:56.459043 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:37:56.456867 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:38:08.457476 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:08.457382 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:38:08.457870 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:38:08.457583 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:38:22.456857 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:22.456823 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:38:22.457370 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:38:22.457086 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:38:35.457315 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:35.457287 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:38:35.457730 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:35.457454 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:38:36.497790 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:36.497761 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" exitCode=1 Jun 08 18:38:36.498149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:36.497819 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6"} Jun 08 18:38:36.498149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:36.497859 2531 scope.go:117] "RemoveContainer" containerID="65f124de18504d626dbed9438c1cd1b9b3afbcef63ddd24981ab39b50ff945be" Jun 08 18:38:36.498149 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:36.498125 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:38:36.498325 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:38:36.498303 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:38:39.965187 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:39.965160 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:38:39.965556 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:39.965458 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:38:39.965652 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:38:39.965632 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:38:45.494176 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:45.494145 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:38:45.494648 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:38:45.494456 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:38:45.494648 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:38:45.494595 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:39:00.456303 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:39:00.456275 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:39:00.456748 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:39:00.456430 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:39:14.456612 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:39:14.456581 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:39:14.457126 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:39:14.456745 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:39:29.458966 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:39:29.458939 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:39:29.459348 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:39:29.459113 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:39:44.457024 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:39:44.456982 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:39:44.457513 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:39:44.457203 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:39:59.459194 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:39:59.459167 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:39:59.459621 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:39:59.459328 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:40:12.456539 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:40:12.456507 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:40:12.457054 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:40:12.456688 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:40:27.456910 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:40:27.456865 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:40:27.457318 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:40:27.457060 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:40:42.456712 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:40:42.456681 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:40:42.457154 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:40:42.456861 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:40:56.456668 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:40:56.456626 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:40:56.457239 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:40:56.456817 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:41:08.456357 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:41:08.456267 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:41:08.456817 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:41:08.456493 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:41:20.457214 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:41:20.457188 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:41:20.457652 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:41:20.457402 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:41:34.457135 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:41:34.457105 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:41:34.457590 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:41:34.457277 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:41:49.458655 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:41:49.458624 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:41:49.459089 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:41:49.458817 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:42:03.457080 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:42:03.457049 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:42:03.457496 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:42:03.457293 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:42:16.456388 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:42:16.456358 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:42:16.456830 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:42:16.456532 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:42:29.458762 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:42:29.458733 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:42:29.459399 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:42:29.458910 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:42:40.457050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:42:40.457018 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:42:40.457605 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:42:40.457240 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:42:54.456700 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:42:54.456667 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:42:54.457207 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:42:54.456837 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:43:06.456914 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:06.456855 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:43:06.459407 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:43:06.457108 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:43:18.456508 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:18.456474 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:43:18.456958 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:43:18.456672 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:43:29.460213 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:29.460188 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:43:29.460726 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:43:29.460403 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:43:42.457058 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:42.457027 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:43:42.457461 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:42.457213 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:43:44.016744 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:44.016710 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" exitCode=1 Jun 08 18:43:44.017184 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:44.016784 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501"} Jun 08 18:43:44.017184 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:44.016840 2531 scope.go:117] "RemoveContainer" containerID="6c9f50ec49f01609f3db073d08984a9c85d874404dca29a2f11316c9b75e8ac6" Jun 08 18:43:44.017184 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:44.017119 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:43:44.017350 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:43:44.017315 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:43:44.965073 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:44.965048 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:43:45.023555 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:45.023533 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:43:45.023915 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:43:45.023693 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:43:45.494139 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:45.494108 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:43:46.028640 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:46.028613 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:43:46.029041 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:43:46.028782 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:43:58.456614 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:43:58.456580 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:43:58.457036 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:43:58.456760 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:44:10.457010 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:44:10.456973 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:44:10.457510 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:44:10.457205 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:44:21.456543 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:44:21.456507 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:44:21.457117 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:44:21.456765 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:44:35.457005 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:44:35.456967 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:44:35.457515 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:44:35.457139 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:44:49.459187 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:44:49.459161 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:44:49.459644 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:44:49.459339 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:45:03.456861 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:45:03.456819 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:45:03.457410 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:45:03.457110 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:45:14.457165 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:45:14.457131 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:45:14.457593 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:45:14.457361 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:45:27.456692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:45:27.456665 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:45:27.457086 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:45:27.456836 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:45:39.460462 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:45:39.460434 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:45:39.460840 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:45:39.460597 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:45:53.456250 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:45:53.456219 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:45:53.456876 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:45:53.456376 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:46:06.456376 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:46:06.456348 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:46:06.456825 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:46:06.456563 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:46:18.457018 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:46:18.456985 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:46:18.457415 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:46:18.457156 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:46:29.462365 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:46:29.462339 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:46:29.462818 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:46:29.462512 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:46:43.457304 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:46:43.457273 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:46:43.457788 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:46:43.457517 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:46:56.456581 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:46:56.456544 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:46:56.466234 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:46:56.466188 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:47:10.457010 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:10.456930 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:47:10.457363 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:47:10.457107 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:47:22.593019 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:22.592985 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:47:22.593472 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:22.593143 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" containerID="cri-o://1cc67a771c6ad11833a514a8eacadc5d808f8aa6cb50ca0d391962d545df5aaa" gracePeriod=30 Jun 08 18:47:23.456487 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:23.456456 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:47:23.456704 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:47:23.456678 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:47:24.106906 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:24.106854 2531 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/ready\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 08 18:47:24.129268 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:24.129235 2531 generic.go:356] "Generic (PLEG): container finished" podID="fe953b79-5b27-4641-93e9-c1857de9677a" containerID="1cc67a771c6ad11833a514a8eacadc5d808f8aa6cb50ca0d391962d545df5aaa" exitCode=143 Jun 08 18:47:24.129408 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:24.129306 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fe953b79-5b27-4641-93e9-c1857de9677a","Type":"ContainerDied","Data":"1cc67a771c6ad11833a514a8eacadc5d808f8aa6cb50ca0d391962d545df5aaa"} Jun 08 18:47:24.642843 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:24.642816 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:24.697322 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:24.697289 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfhhj\" (UniqueName: \"kubernetes.io/projected/fe953b79-5b27-4641-93e9-c1857de9677a-kube-api-access-jfhhj\") pod \"fe953b79-5b27-4641-93e9-c1857de9677a\" (UID: \"fe953b79-5b27-4641-93e9-c1857de9677a\") " Jun 08 18:47:24.699388 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:24.699366 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe953b79-5b27-4641-93e9-c1857de9677a-kube-api-access-jfhhj" (OuterVolumeSpecName: "kube-api-access-jfhhj") pod "fe953b79-5b27-4641-93e9-c1857de9677a" (UID: "fe953b79-5b27-4641-93e9-c1857de9677a"). InnerVolumeSpecName "kube-api-access-jfhhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:47:24.798880 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:24.798816 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfhhj\" (UniqueName: \"kubernetes.io/projected/fe953b79-5b27-4641-93e9-c1857de9677a-kube-api-access-jfhhj\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:47:25.135526 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.135501 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.135526 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.135515 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fe953b79-5b27-4641-93e9-c1857de9677a","Type":"ContainerDied","Data":"32a41d28fb4c83c9d23ab8b3430f11695d7921ed4d6b6b603d11b895ea95b441"} Jun 08 18:47:25.135979 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.135573 2531 scope.go:117] "RemoveContainer" containerID="1cc67a771c6ad11833a514a8eacadc5d808f8aa6cb50ca0d391962d545df5aaa" Jun 08 18:47:25.156542 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.156518 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:47:25.161335 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.161313 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:47:25.186806 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.186783 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:47:25.187180 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.187168 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" Jun 08 18:47:25.187228 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.187183 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" Jun 08 18:47:25.187264 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.187255 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" containerName="keycloak" Jun 08 18:47:25.191613 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.191597 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.194118 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.194090 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-97892\"" Jun 08 18:47:25.194233 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.194093 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 18:47:25.194233 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.194168 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 18:47:25.194233 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.194175 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 18:47:25.194233 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.194173 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 18:47:25.199651 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.199632 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:47:25.304020 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.303997 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/56db6c7c-3d2d-4d58-8a60-2f987b00e5d3-test-realms\") pod \"maas-keycloak-0\" (UID: \"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.304130 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.304040 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9wk\" (UniqueName: \"kubernetes.io/projected/56db6c7c-3d2d-4d58-8a60-2f987b00e5d3-kube-api-access-gh9wk\") pod \"maas-keycloak-0\" (UID: \"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.404416 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.404351 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/56db6c7c-3d2d-4d58-8a60-2f987b00e5d3-test-realms\") pod \"maas-keycloak-0\" (UID: \"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.404416 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.404392 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9wk\" (UniqueName: \"kubernetes.io/projected/56db6c7c-3d2d-4d58-8a60-2f987b00e5d3-kube-api-access-gh9wk\") pod \"maas-keycloak-0\" (UID: \"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.405083 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.405064 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/56db6c7c-3d2d-4d58-8a60-2f987b00e5d3-test-realms\") pod \"maas-keycloak-0\" (UID: \"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.414482 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.414462 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9wk\" (UniqueName: \"kubernetes.io/projected/56db6c7c-3d2d-4d58-8a60-2f987b00e5d3-kube-api-access-gh9wk\") pod \"maas-keycloak-0\" (UID: \"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.462402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.462378 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe953b79-5b27-4641-93e9-c1857de9677a" path="/var/lib/kubelet/pods/fe953b79-5b27-4641-93e9-c1857de9677a/volumes" Jun 08 18:47:25.502300 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.502278 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:25.631123 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:25.630922 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:47:26.144193 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:26.144152 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3","Type":"ContainerStarted","Data":"3f22e4c7c6bb033c45295c41deaab86f180beef481bfe2f549ba874fad2ddb1e"} Jun 08 18:47:26.144644 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:26.144458 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"56db6c7c-3d2d-4d58-8a60-2f987b00e5d3","Type":"ContainerStarted","Data":"b14142b7571c8113945c2c62c23235a0d4f680f02026cff87828020297ade5e6"} Jun 08 18:47:26.162352 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:26.162307 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.855782443 podStartE2EDuration="1.162292647s" totalImagesPullingTime="306.510204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:47:26.16098846 +0000 UTC m=+2347.159791455" watchObservedRunningTime="2026-06-08 18:47:26.162292647 +0000 UTC m=+2347.161095651" Jun 08 18:47:26.503367 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:26.503325 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:26.505257 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:26.505216 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:27.502820 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:27.502772 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:28.502569 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:28.502529 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:29.503073 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:29.503026 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:30.503177 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:30.503127 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:31.502800 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:31.502754 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:32.503669 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:32.503617 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:33.502874 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:33.502828 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:34.457430 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:34.457393 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:47:34.457812 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:47:34.457617 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:47:34.502622 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:34.502582 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:35.503287 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:35.503247 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:35.503776 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:35.503507 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:36.502706 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:36.502657 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:37.503351 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:37.503311 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:38.503692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:38.503647 2531 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 08 18:47:39.623023 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:39.622983 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 18:47:39.640652 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:39.640617 2531 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="56db6c7c-3d2d-4d58-8a60-2f987b00e5d3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:47:48.456582 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:48.456550 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:47:48.457042 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:47:48.456767 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:47:49.629500 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:47:49.629468 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:48:00.457046 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:00.457016 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:48:00.457505 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:00.457181 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:48:01.476804 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.476684 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fdfd4b57b-ksnww"] Jun 08 18:48:01.477250 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.476859 2531 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" podUID="327768ab-0de2-43d4-b947-a53bb24a2a0e" containerName="authorino" containerID="cri-o://3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472" gracePeriod=30 Jun 08 18:48:01.754514 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.754477 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:48:01.859069 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.859036 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khspl\" (UniqueName: \"kubernetes.io/projected/327768ab-0de2-43d4-b947-a53bb24a2a0e-kube-api-access-khspl\") pod \"327768ab-0de2-43d4-b947-a53bb24a2a0e\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " Jun 08 18:48:01.859234 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.859100 2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/327768ab-0de2-43d4-b947-a53bb24a2a0e-tls-cert\") pod \"327768ab-0de2-43d4-b947-a53bb24a2a0e\" (UID: \"327768ab-0de2-43d4-b947-a53bb24a2a0e\") " Jun 08 18:48:01.861442 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.861411 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327768ab-0de2-43d4-b947-a53bb24a2a0e-kube-api-access-khspl" (OuterVolumeSpecName: "kube-api-access-khspl") pod "327768ab-0de2-43d4-b947-a53bb24a2a0e" (UID: "327768ab-0de2-43d4-b947-a53bb24a2a0e"). InnerVolumeSpecName "kube-api-access-khspl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:48:01.871036 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.871005 2531 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/327768ab-0de2-43d4-b947-a53bb24a2a0e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "327768ab-0de2-43d4-b947-a53bb24a2a0e" (UID: "327768ab-0de2-43d4-b947-a53bb24a2a0e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:48:01.960646 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.960618 2531 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/327768ab-0de2-43d4-b947-a53bb24a2a0e-tls-cert\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:48:01.960646 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:01.960644 2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khspl\" (UniqueName: \"kubernetes.io/projected/327768ab-0de2-43d4-b947-a53bb24a2a0e-kube-api-access-khspl\") on node \"ip-10-0-132-8.ec2.internal\" DevicePath \"\"" Jun 08 18:48:02.363901 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.363858 2531 generic.go:356] "Generic (PLEG): container finished" podID="327768ab-0de2-43d4-b947-a53bb24a2a0e" containerID="3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472" exitCode=0 Jun 08 18:48:02.364050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.363925 2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" Jun 08 18:48:02.364050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.363944 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" event={"ID":"327768ab-0de2-43d4-b947-a53bb24a2a0e","Type":"ContainerDied","Data":"3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472"} Jun 08 18:48:02.364050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.363998 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fdfd4b57b-ksnww" event={"ID":"327768ab-0de2-43d4-b947-a53bb24a2a0e","Type":"ContainerDied","Data":"9e0a213b2dfc72f38020659071650463e48ab03ac39ca70ee98bbe858e8d0cd1"} Jun 08 18:48:02.364050 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.364020 2531 scope.go:117] "RemoveContainer" containerID="3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472" Jun 08 18:48:02.373234 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.373213 2531 scope.go:117] "RemoveContainer" containerID="3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472" Jun 08 18:48:02.373487 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:02.373466 2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472\": container with ID starting with 3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472 not found: ID does not exist" containerID="3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472" Jun 08 18:48:02.373539 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.373495 2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472"} err="failed to get container status \"3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472\": rpc error: code = NotFound desc = could not find container \"3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472\": container with ID starting with 3c2af42cd6b0707ee4f50368db8c3e123aedfa475718a70ec5403616a1c60472 not found: ID does not exist" Jun 08 18:48:02.401905 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.401868 2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fdfd4b57b-ksnww"] Jun 08 18:48:02.407158 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:02.407131 2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6fdfd4b57b-ksnww"] Jun 08 18:48:03.462003 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:03.461973 2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="327768ab-0de2-43d4-b947-a53bb24a2a0e" path="/var/lib/kubelet/pods/327768ab-0de2-43d4-b947-a53bb24a2a0e/volumes" Jun 08 18:48:11.456979 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:11.456947 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:48:11.459402 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:11.457133 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:48:12.827940 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.827906 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v"] Jun 08 18:48:12.828418 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.828356 2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327768ab-0de2-43d4-b947-a53bb24a2a0e" containerName="authorino" Jun 08 18:48:12.828418 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.828372 2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="327768ab-0de2-43d4-b947-a53bb24a2a0e" containerName="authorino" Jun 08 18:48:12.828535 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.828464 2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="327768ab-0de2-43d4-b947-a53bb24a2a0e" containerName="authorino" Jun 08 18:48:12.831336 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.831313 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:12.833800 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.833781 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 18:48:12.833937 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.833826 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 18:48:12.834911 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.834868 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 18:48:12.835003 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.834926 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7wkr\"" Jun 08 18:48:12.841014 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.840992 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v"] Jun 08 18:48:12.954228 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.954193 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:12.954387 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.954264 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:12.954387 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.954315 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:12.954387 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.954342 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:12.954494 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.954394 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:12.954494 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:12.954428 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w22lc\" (UniqueName: \"kubernetes.io/projected/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-kube-api-access-w22lc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055429 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055396 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055584 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055437 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055584 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055464 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055584 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055496 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w22lc\" (UniqueName: \"kubernetes.io/projected/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-kube-api-access-w22lc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055584 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055522 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055808 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055620 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055874 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055831 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055965 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055878 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.055965 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.055939 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.057880 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.057855 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.058049 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.058030 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.063636 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.063618 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w22lc\" (UniqueName: \"kubernetes.io/projected/99b361e5-c934-4a84-bfae-83a7fbf0d1ba-kube-api-access-w22lc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v\" (UID: \"99b361e5-c934-4a84-bfae-83a7fbf0d1ba\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.142769 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.142743 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:13.481662 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:13.481633 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v"] Jun 08 18:48:13.483154 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:48:13.483126 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b361e5_c934_4a84_bfae_83a7fbf0d1ba.slice/crio-088679a8915215d13a1c5189e41963bd35a0ede0b010fd5e9011d65cff468593 WatchSource:0}: Error finding container 088679a8915215d13a1c5189e41963bd35a0ede0b010fd5e9011d65cff468593: Status 404 returned error can't find the container with id 088679a8915215d13a1c5189e41963bd35a0ede0b010fd5e9011d65cff468593 Jun 08 18:48:14.429620 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:14.429585 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" event={"ID":"99b361e5-c934-4a84-bfae-83a7fbf0d1ba","Type":"ContainerStarted","Data":"088679a8915215d13a1c5189e41963bd35a0ede0b010fd5e9011d65cff468593"} Jun 08 18:48:16.505754 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.505716 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498"] Jun 08 18:48:16.522085 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.522056 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498"] Jun 08 18:48:16.522250 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.522135 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.524740 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.524715 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 18:48:16.690814 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.690779 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.691020 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.690834 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.691020 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.690920 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbbx\" (UniqueName: \"kubernetes.io/projected/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-kube-api-access-fjbbx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.691155 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.691024 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.691155 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.691076 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.691155 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.691133 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792099 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792019 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792099 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792067 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792099 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792097 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbbx\" (UniqueName: \"kubernetes.io/projected/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-kube-api-access-fjbbx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792382 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792130 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792382 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792164 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792382 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792209 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792582 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792536 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792654 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792579 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.792654 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.792592 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.794587 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.794566 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.794922 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.794905 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.800077 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.800052 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbbx\" (UniqueName: \"kubernetes.io/projected/0fefa630-33a0-4f9c-80e6-f798d20f5fe2-kube-api-access-fjbbx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-pf498\" (UID: \"0fefa630-33a0-4f9c-80e6-f798d20f5fe2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:16.836315 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:16.836252 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:17.464911 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:17.464871 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498"] Jun 08 18:48:17.467370 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:48:17.467338 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fefa630_33a0_4f9c_80e6_f798d20f5fe2.slice/crio-1e6270671f7c6c23ba93a4b43899d6a6adc6e2bf264d4e29d5dff54f7ddfb3ac WatchSource:0}: Error finding container 1e6270671f7c6c23ba93a4b43899d6a6adc6e2bf264d4e29d5dff54f7ddfb3ac: Status 404 returned error can't find the container with id 1e6270671f7c6c23ba93a4b43899d6a6adc6e2bf264d4e29d5dff54f7ddfb3ac Jun 08 18:48:18.457931 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:18.457881 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" event={"ID":"99b361e5-c934-4a84-bfae-83a7fbf0d1ba","Type":"ContainerStarted","Data":"fc1cea6a998d9db7ed2af3364c73a53b2d2d4fd4e91d0135122ff87ddf508f63"} Jun 08 18:48:18.459478 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:18.459450 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" event={"ID":"0fefa630-33a0-4f9c-80e6-f798d20f5fe2","Type":"ContainerStarted","Data":"801d405056191d3deb4f6c99ce3692b1171581de19efac76691415a9de0ce77c"} Jun 08 18:48:18.459609 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:18.459525 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" event={"ID":"0fefa630-33a0-4f9c-80e6-f798d20f5fe2","Type":"ContainerStarted","Data":"1e6270671f7c6c23ba93a4b43899d6a6adc6e2bf264d4e29d5dff54f7ddfb3ac"} Jun 08 18:48:19.464834 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:19.464802 2531 generic.go:356] "Generic (PLEG): container finished" podID="99b361e5-c934-4a84-bfae-83a7fbf0d1ba" containerID="fc1cea6a998d9db7ed2af3364c73a53b2d2d4fd4e91d0135122ff87ddf508f63" exitCode=0 Jun 08 18:48:19.465277 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:19.464882 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" event={"ID":"99b361e5-c934-4a84-bfae-83a7fbf0d1ba","Type":"ContainerDied","Data":"fc1cea6a998d9db7ed2af3364c73a53b2d2d4fd4e91d0135122ff87ddf508f63"} Jun 08 18:48:19.466417 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:19.466382 2531 generic.go:356] "Generic (PLEG): container finished" podID="0fefa630-33a0-4f9c-80e6-f798d20f5fe2" containerID="801d405056191d3deb4f6c99ce3692b1171581de19efac76691415a9de0ce77c" exitCode=0 Jun 08 18:48:19.466516 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:19.466427 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" event={"ID":"0fefa630-33a0-4f9c-80e6-f798d20f5fe2","Type":"ContainerDied","Data":"801d405056191d3deb4f6c99ce3692b1171581de19efac76691415a9de0ce77c"} Jun 08 18:48:21.478360 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:21.478318 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" event={"ID":"0fefa630-33a0-4f9c-80e6-f798d20f5fe2","Type":"ContainerStarted","Data":"46d7ad54bf8ef8b4d5af15a3ecb6b5e96fdc38aa70448638c6f3ae4a2b998589"} Jun 08 18:48:21.480026 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:21.480002 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" event={"ID":"99b361e5-c934-4a84-bfae-83a7fbf0d1ba","Type":"ContainerStarted","Data":"fc36d1b2397c5ef2c8ecef4076bd15fa4778e068869765e43abbe26932c9840b"} Jun 08 18:48:21.497168 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:21.497124 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" podStartSLOduration=2.949525817 podStartE2EDuration="5.4971107s" totalImagesPullingTime="1.260961952s" totalInitContainerRuntime="1.286622931s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:48:21.496326282 +0000 UTC m=+2402.495129274" watchObservedRunningTime="2026-06-08 18:48:21.4971107 +0000 UTC m=+2402.495913693" Jun 08 18:48:21.515188 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:21.515148 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" podStartSLOduration=3.100499548 podStartE2EDuration="9.515134966s" totalImagesPullingTime="5.165762474s" totalInitContainerRuntime="1.248872944s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:48:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:48:21.513110938 +0000 UTC m=+2402.511913932" watchObservedRunningTime="2026-06-08 18:48:21.515134966 +0000 UTC m=+2402.513937959" Jun 08 18:48:22.706899 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.706865 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4"] Jun 08 18:48:22.710971 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.710948 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.713549 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.713529 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 18:48:22.723818 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.723793 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4"] Jun 08 18:48:22.749075 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.749048 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.749184 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.749117 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.749184 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.749168 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.749303 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.749205 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d59c9a9-811d-41c9-8575-c28718086a9b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.749303 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.749269 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.749303 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.749293 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6hbm\" (UniqueName: \"kubernetes.io/projected/8d59c9a9-811d-41c9-8575-c28718086a9b-kube-api-access-b6hbm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850186 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850154 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850186 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850188 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6hbm\" (UniqueName: \"kubernetes.io/projected/8d59c9a9-811d-41c9-8575-c28718086a9b-kube-api-access-b6hbm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850339 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850212 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850339 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850250 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850339 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850280 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850491 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850401 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d59c9a9-811d-41c9-8575-c28718086a9b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850653 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850629 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850646 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.850751 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.850738 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.852672 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.852645 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d59c9a9-811d-41c9-8575-c28718086a9b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.852856 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.852838 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d59c9a9-811d-41c9-8575-c28718086a9b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:22.858444 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:22.858423 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6hbm\" (UniqueName: \"kubernetes.io/projected/8d59c9a9-811d-41c9-8575-c28718086a9b-kube-api-access-b6hbm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4\" (UID: \"8d59c9a9-811d-41c9-8575-c28718086a9b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:23.021628 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.021567 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:48:23.143853 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.143826 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:23.144031 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.143927 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:23.156852 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.156830 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:23.157356 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.157336 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4"] Jun 08 18:48:23.158654 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:48:23.158626 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d59c9a9_811d_41c9_8575_c28718086a9b.slice/crio-71c1bb7c0600da7814fee427c42c062e56f678adf8411c002f99a0a3ef236e2d WatchSource:0}: Error finding container 71c1bb7c0600da7814fee427c42c062e56f678adf8411c002f99a0a3ef236e2d: Status 404 returned error can't find the container with id 71c1bb7c0600da7814fee427c42c062e56f678adf8411c002f99a0a3ef236e2d Jun 08 18:48:23.493482 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.493444 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" event={"ID":"8d59c9a9-811d-41c9-8575-c28718086a9b","Type":"ContainerStarted","Data":"3494300f832ab56f4c502b52d6996f9bc3ff62bec718aa207d4f72690c738b3d"} Jun 08 18:48:23.493652 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.493509 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" event={"ID":"8d59c9a9-811d-41c9-8575-c28718086a9b","Type":"ContainerStarted","Data":"71c1bb7c0600da7814fee427c42c062e56f678adf8411c002f99a0a3ef236e2d"} Jun 08 18:48:23.504858 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:23.504829 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v" Jun 08 18:48:24.456998 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:24.456967 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:48:24.457379 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:24.457161 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:48:26.836967 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:26.836930 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:26.837365 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:26.836988 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:26.850285 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:26.850260 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:27.523304 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:27.523271 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-pf498" Jun 08 18:48:38.457108 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:38.457077 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:48:38.457545 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:38.457257 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:48:46.753798 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.753765 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght"] Jun 08 18:48:46.768131 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.768106 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.768283 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.768164 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght"] Jun 08 18:48:46.770650 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.770626 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 18:48:46.830103 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.830073 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.830227 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.830116 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.830227 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.830218 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.830347 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.830262 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.830347 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.830335 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.830435 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.830396 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggt74\" (UniqueName: \"kubernetes.io/projected/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-kube-api-access-ggt74\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.931425 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931398 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.931554 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931439 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.931554 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931484 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.931554 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931503 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggt74\" (UniqueName: \"kubernetes.io/projected/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-kube-api-access-ggt74\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.931554 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931538 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.931775 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931567 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.931863 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931831 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.932029 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.931944 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.932029 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.932002 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.933823 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.933803 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.933974 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.933955 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:46.939804 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:46.939782 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggt74\" (UniqueName: \"kubernetes.io/projected/dd1d2167-dc4e-44cb-a72a-952ea9d9e754-kube-api-access-ggt74\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-f2ght\" (UID: \"dd1d2167-dc4e-44cb-a72a-952ea9d9e754\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:47.080045 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:47.079990 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:48:47.212247 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:47.212223 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght"] Jun 08 18:48:47.214067 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:48:47.214040 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1d2167_dc4e_44cb_a72a_952ea9d9e754.slice/crio-c488805dc9a0c3e96d7032ee92521adb61803a1dffffe37de371ab598a89bffa WatchSource:0}: Error finding container c488805dc9a0c3e96d7032ee92521adb61803a1dffffe37de371ab598a89bffa: Status 404 returned error can't find the container with id c488805dc9a0c3e96d7032ee92521adb61803a1dffffe37de371ab598a89bffa Jun 08 18:48:47.612460 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:47.612426 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" event={"ID":"dd1d2167-dc4e-44cb-a72a-952ea9d9e754","Type":"ContainerStarted","Data":"ab58fdeb0ffc8fb152d62185654cfa21582525e85a9fbaeb568ea3ba6b77bc25"} Jun 08 18:48:47.612611 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:47.612483 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" event={"ID":"dd1d2167-dc4e-44cb-a72a-952ea9d9e754","Type":"ContainerStarted","Data":"c488805dc9a0c3e96d7032ee92521adb61803a1dffffe37de371ab598a89bffa"} Jun 08 18:48:50.456880 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:50.456846 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:48:50.457265 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:50.457058 2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:48:51.637371 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:51.637340 2531 generic.go:356] "Generic (PLEG): container finished" podID="cdc46532-7e1c-4b08-af34-626d0c3fa026" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" exitCode=1 Jun 08 18:48:51.637766 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:51.637409 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" event={"ID":"cdc46532-7e1c-4b08-af34-626d0c3fa026","Type":"ContainerDied","Data":"4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d"} Jun 08 18:48:51.637766 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:51.637466 2531 scope.go:117] "RemoveContainer" containerID="4a22221284145901dcfede932c34f0a255e5065f264f31e8eb515864db355501" Jun 08 18:48:51.637766 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:51.637737 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:48:51.637952 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:51.637935 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:48:54.965130 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:54.965096 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:48:54.965512 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:54.965391 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:48:54.965559 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:54.965541 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:48:55.495158 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:55.495130 2531 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" Jun 08 18:48:55.661047 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:48:55.661027 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:48:55.661196 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:48:55.661179 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:49:08.456811 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:08.456779 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:49:08.457331 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:49:08.457007 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:49:16.766806 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:16.766770 2531 generic.go:356] "Generic (PLEG): container finished" podID="8d59c9a9-811d-41c9-8575-c28718086a9b" containerID="3494300f832ab56f4c502b52d6996f9bc3ff62bec718aa207d4f72690c738b3d" exitCode=0 Jun 08 18:49:16.767220 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:16.766831 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" event={"ID":"8d59c9a9-811d-41c9-8575-c28718086a9b","Type":"ContainerDied","Data":"3494300f832ab56f4c502b52d6996f9bc3ff62bec718aa207d4f72690c738b3d"} Jun 08 18:49:17.773809 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:17.773776 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" event={"ID":"8d59c9a9-811d-41c9-8575-c28718086a9b","Type":"ContainerStarted","Data":"3c7baa89a23fc73c1e2b6c3f98f4164a616fdb7f1d5913d6ea04b20e15c4d292"} Jun 08 18:49:17.793768 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:17.793723 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" podStartSLOduration=2.442168562 podStartE2EDuration="55.793709233s" totalImagesPullingTime="218.247777ms" totalInitContainerRuntime="53.133292894s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:49:17.792311358 +0000 UTC m=+2458.791114354" watchObservedRunningTime="2026-06-08 18:49:17.793709233 +0000 UTC m=+2458.792512272" Jun 08 18:49:22.456412 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:22.456382 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:49:22.456797 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:49:22.456541 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:49:23.022118 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:23.022085 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:49:23.022284 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:23.022155 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:49:23.034423 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:23.034403 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:49:23.813577 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:23.813555 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4" Jun 08 18:49:35.456846 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:35.456804 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:49:35.457295 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:49:35.457060 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:49:36.868983 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:36.868949 2531 generic.go:356] "Generic (PLEG): container finished" podID="dd1d2167-dc4e-44cb-a72a-952ea9d9e754" containerID="ab58fdeb0ffc8fb152d62185654cfa21582525e85a9fbaeb568ea3ba6b77bc25" exitCode=0 Jun 08 18:49:36.869352 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:36.869022 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" event={"ID":"dd1d2167-dc4e-44cb-a72a-952ea9d9e754","Type":"ContainerDied","Data":"ab58fdeb0ffc8fb152d62185654cfa21582525e85a9fbaeb568ea3ba6b77bc25"} Jun 08 18:49:37.875796 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:37.875758 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" event={"ID":"dd1d2167-dc4e-44cb-a72a-952ea9d9e754","Type":"ContainerStarted","Data":"3afb4455da9ee4a026cd5efba01393146e9a2253de4c1b1529f75b4400f1fdcc"} Jun 08 18:49:37.897104 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:37.897061 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" podStartSLOduration=3.09070059 podStartE2EDuration="51.89704798s" totalImagesPullingTime="182.893534ms" totalInitContainerRuntime="48.623453856s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:49:37.894972307 +0000 UTC m=+2478.893775301" watchObservedRunningTime="2026-06-08 18:49:37.89704798 +0000 UTC m=+2478.895850972" Jun 08 18:49:46.457173 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:46.457141 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:49:46.457681 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:49:46.457342 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:49:47.080502 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:47.080470 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:49:47.080692 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:47.080533 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:49:47.093064 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:47.093037 2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:49:47.937773 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:47.937740 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-f2ght" Jun 08 18:49:58.456725 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:49:58.456691 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:49:58.457148 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:49:58.456873 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:50:11.456462 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:11.456388 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:50:11.456808 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:50:11.456547 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:50:25.456485 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:25.456449 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:50:25.457003 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:50:25.456687 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:50:38.456950 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:38.456921 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:50:38.457327 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:50:38.457092 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:50:45.627452 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:45.627398 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6ccfc5987b-2wj4b_fed5ad2a-36d6-4dba-ba4a-3a7ed469717f/nginx/0.log" Jun 08 18:50:46.106015 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:46.105989 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7d7b5975d4-sfhwn_cdc46532-7e1c-4b08-af34-626d0c3fa026/maas-api/9.log" Jun 08 18:50:46.225312 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:46.225282 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-755bdf5b84-hxvn5_bf75a165-c054-4287-931d-919d979998a0/manager/0.log" Jun 08 18:50:46.577294 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:46.577216 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg_7f5b1db2-2ae0-4e32-be58-bd93fba25d1a/copy-manifests/0.log" Jun 08 18:50:46.584669 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:46.584644 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg_7f5b1db2-2ae0-4e32-be58-bd93fba25d1a/manager/0.log" Jun 08 18:50:46.957815 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:46.957790 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-xrxlp_3a282e2a-6285-4402-9401-965ad79885ec/postgres/0.log" Jun 08 18:50:48.414213 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:48.414186 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jn98z_bc190850-2086-4d72-9cdb-50e3837beeab/manager/0.log" Jun 08 18:50:48.627788 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:48.627766 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8drl8_af452f6b-cb0e-4a36-8432-d63de90241e5/kuadrant-console-plugin/0.log" Jun 08 18:50:48.740400 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:48.740331 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vmft_024f6b5e-0589-4282-8cc9-560edb23e145/registry-server/0.log" Jun 08 18:50:49.466059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:49.466034 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tj2wf_69fb08a9-524b-42d1-87c1-d1be36abe138/istio-proxy/0.log" Jun 08 18:50:49.948300 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:49.948276 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/1.log" Jun 08 18:50:50.054467 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.054447 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vrhtm_c90c7a14-f112-4a22-a123-794843a21936/payload-pre-processing/0.log" Jun 08 18:50:50.279629 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.279558 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dc4f597c9-ndwsz_111698bf-c87a-4ba7-b95e-8cd003d5b568/router/0.log" Jun 08 18:50:50.612654 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.612632 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v_99b361e5-c934-4a84-bfae-83a7fbf0d1ba/storage-initializer/0.log" Jun 08 18:50:50.619701 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.619682 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-znz2v_99b361e5-c934-4a84-bfae-83a7fbf0d1ba/main/0.log" Jun 08 18:50:50.752516 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.752499 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-pf498_0fefa630-33a0-4f9c-80e6-f798d20f5fe2/storage-initializer/0.log" Jun 08 18:50:50.759994 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.759978 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-pf498_0fefa630-33a0-4f9c-80e6-f798d20f5fe2/main/0.log" Jun 08 18:50:50.887367 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.887314 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4_8d59c9a9-811d-41c9-8575-c28718086a9b/storage-initializer/0.log" Jun 08 18:50:50.899175 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:50.899152 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-svff4_8d59c9a9-811d-41c9-8575-c28718086a9b/main/0.log" Jun 08 18:50:51.126097 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:51.126075 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-f2ght_dd1d2167-dc4e-44cb-a72a-952ea9d9e754/storage-initializer/0.log" Jun 08 18:50:51.132941 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:51.132915 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-f2ght_dd1d2167-dc4e-44cb-a72a-952ea9d9e754/main/0.log" Jun 08 18:50:51.456713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:51.456693 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:50:51.456918 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:50:51.456877 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:50:58.269349 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:58.269311 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k8q9j_7f922831-b683-4553-becb-f80585a93c86/global-pull-secret-syncer/0.log" Jun 08 18:50:58.386792 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:58.386761 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m2zxd_4a37c70e-2811-469f-94d5-5ce997c8885e/konnectivity-agent/0.log" Jun 08 18:50:58.456176 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:50:58.456154 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-8.ec2.internal_33ba0c26a87d56d7a7838510bc50fe62/haproxy/0.log" Jun 08 18:51:02.457054 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:02.457017 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:51:02.457526 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:51:02.457267 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:51:02.868209 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:02.868180 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jn98z_bc190850-2086-4d72-9cdb-50e3837beeab/manager/0.log" Jun 08 18:51:02.936213 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:02.936193 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8drl8_af452f6b-cb0e-4a36-8432-d63de90241e5/kuadrant-console-plugin/0.log" Jun 08 18:51:02.978392 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:02.978367 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vmft_024f6b5e-0589-4282-8cc9-560edb23e145/registry-server/0.log" Jun 08 18:51:05.092533 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.092501 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cd795b4d-q2t8z_dc8967cf-4811-4ad1-88aa-ea2cbb529f45/metrics-server/0.log" Jun 08 18:51:05.127356 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.127332 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-qrmfq_48fd8a57-cbdb-4b6e-9962-cbe9f567de3c/monitoring-plugin/0.log" Jun 08 18:51:05.269484 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.269454 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6jtt4_44b141da-2219-415e-aa79-ca02bac365ae/node-exporter/0.log" Jun 08 18:51:05.294927 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.294909 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6jtt4_44b141da-2219-415e-aa79-ca02bac365ae/kube-rbac-proxy/0.log" Jun 08 18:51:05.315767 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.315752 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6jtt4_44b141da-2219-415e-aa79-ca02bac365ae/init-textfile/0.log" Jun 08 18:51:05.432051 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.432029 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zvqvq_7a874e7e-6bad-4cea-8249-ba9af63129cc/kube-rbac-proxy-main/0.log" Jun 08 18:51:05.453823 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.453804 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zvqvq_7a874e7e-6bad-4cea-8249-ba9af63129cc/kube-rbac-proxy-self/0.log" Jun 08 18:51:05.485295 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.485276 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zvqvq_7a874e7e-6bad-4cea-8249-ba9af63129cc/openshift-state-metrics/0.log" Jun 08 18:51:05.737817 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.737729 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mp2zg_23a59b1d-6236-424e-b1b3-76fa75ebb3c5/prometheus-operator/0.log" Jun 08 18:51:05.756919 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.756876 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mp2zg_23a59b1d-6236-424e-b1b3-76fa75ebb3c5/kube-rbac-proxy/0.log" Jun 08 18:51:05.829723 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.829703 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c86fb59-twnf9_7aea3699-3b83-4629-a9ae-9e19d78206dc/telemeter-client/0.log" Jun 08 18:51:05.865940 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.865922 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c86fb59-twnf9_7aea3699-3b83-4629-a9ae-9e19d78206dc/reload/0.log" Jun 08 18:51:05.890051 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:05.890032 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585c86fb59-twnf9_7aea3699-3b83-4629-a9ae-9e19d78206dc/kube-rbac-proxy/0.log" Jun 08 18:51:07.741324 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:07.741290 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-46fg9_5e020b91-3e70-420f-a376-93eeb0a6c2a3/networking-console-plugin/0.log" Jun 08 18:51:08.952452 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:08.952423 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fbf6f8bf7-5sljn_0596b709-fab5-4018-8f3f-798767c5251b/console/0.log" Jun 08 18:51:08.985641 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:08.985612 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-l86gj_32b04dfa-12c3-4e69-880c-c91eafa6031e/download-server/0.log" Jun 08 18:51:09.359684 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.359656 2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x"] Jun 08 18:51:09.363344 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.363327 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.366960 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.366932 2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rd9c8\"/\"default-dockercfg-z4v4b\"" Jun 08 18:51:09.367563 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.367536 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rd9c8\"/\"kube-root-ca.crt\"" Jun 08 18:51:09.367883 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.367854 2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rd9c8\"/\"openshift-service-ca.crt\"" Jun 08 18:51:09.379426 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.379407 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x"] Jun 08 18:51:09.423791 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.423769 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-proc\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.423928 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.423807 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-lib-modules\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.423928 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.423915 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4m9\" (UniqueName: \"kubernetes.io/projected/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-kube-api-access-hf4m9\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.424020 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.423948 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-sys\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.424020 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.423969 2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-podres\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524421 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524401 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4m9\" (UniqueName: \"kubernetes.io/projected/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-kube-api-access-hf4m9\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524528 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524428 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-sys\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524528 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524447 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-podres\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524528 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524473 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-proc\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524528 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524512 2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-lib-modules\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524682 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524524 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-sys\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524682 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524595 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-podres\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524682 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524607 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-proc\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.524682 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.524673 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-lib-modules\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.534045 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.534027 2531 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4m9\" (UniqueName: \"kubernetes.io/projected/3c1e909f-f1eb-4a6b-9343-08a76439b3fc-kube-api-access-hf4m9\") pod \"perf-node-gather-daemonset-m6m7x\" (UID: \"3c1e909f-f1eb-4a6b-9343-08a76439b3fc\") " pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.678713 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.678634 2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:09.791734 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:09.791708 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-sjkn9_756049c9-e141-4ef0-8d55-da30efe78648/volume-data-source-validator/0.log" Jun 08 18:51:10.023310 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:10.023283 2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x"] Jun 08 18:51:10.025167 ip-10-0-132-8 kubenswrapper[2531]: W0608 18:51:10.025140 2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3c1e909f_f1eb_4a6b_9343_08a76439b3fc.slice/crio-0f6ea7958d8b114a63bbea79d73fa53ea80c0253668b0b257c151170dc29f331 WatchSource:0}: Error finding container 0f6ea7958d8b114a63bbea79d73fa53ea80c0253668b0b257c151170dc29f331: Status 404 returned error can't find the container with id 0f6ea7958d8b114a63bbea79d73fa53ea80c0253668b0b257c151170dc29f331 Jun 08 18:51:10.347264 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:10.347239 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" event={"ID":"3c1e909f-f1eb-4a6b-9343-08a76439b3fc","Type":"ContainerStarted","Data":"9de896e9b82e96c5eaaa612ea9dcf0fa70245a8e6406a60c4f72e5f7ca3be620"} Jun 08 18:51:10.347425 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:10.347288 2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" event={"ID":"3c1e909f-f1eb-4a6b-9343-08a76439b3fc","Type":"ContainerStarted","Data":"0f6ea7958d8b114a63bbea79d73fa53ea80c0253668b0b257c151170dc29f331"} Jun 08 18:51:10.347425 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:10.347362 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:10.365386 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:10.365343 2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" podStartSLOduration=1.365330396 podStartE2EDuration="1.365330396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:51:10.364597644 +0000 UTC m=+2571.363400638" watchObservedRunningTime="2026-06-08 18:51:10.365330396 +0000 UTC m=+2571.364133389" Jun 08 18:51:11.065533 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:11.065507 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6972p_1aef15f4-46bd-4fc0-b279-91d04b397685/dns/0.log" Jun 08 18:51:11.086694 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:11.086667 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6972p_1aef15f4-46bd-4fc0-b279-91d04b397685/kube-rbac-proxy/0.log" Jun 08 18:51:11.274830 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:11.274804 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc8vp_c9a78d84-1392-4435-8891-c0cf1da0bcbc/dns-node-resolver/0.log" Jun 08 18:51:11.912648 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:11.912615 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fw95n_918fabd2-131a-4c30-a0be-23ed41a28250/node-ca/0.log" Jun 08 18:51:12.885380 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:12.885353 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tj2wf_69fb08a9-524b-42d1-87c1-d1be36abe138/istio-proxy/0.log" Jun 08 18:51:13.009681 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:13.009650 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/1.log" Jun 08 18:51:13.009828 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:13.009720 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/0.log" Jun 08 18:51:13.030579 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:13.030560 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vrhtm_c90c7a14-f112-4a22-a123-794843a21936/payload-pre-processing/0.log" Jun 08 18:51:13.084634 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:13.084615 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dc4f597c9-ndwsz_111698bf-c87a-4ba7-b95e-8cd003d5b568/router/0.log" Jun 08 18:51:13.456479 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:13.456455 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:51:13.456649 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:51:13.456622 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:51:13.705402 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:13.705377 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghqwp_d659592b-318f-4546-b13b-34d9ae0e99f6/serve-healthcheck-canary/0.log" Jun 08 18:51:14.283355 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:14.283329 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lltvp_bdd45eda-ac8b-41e5-a0cb-133fae85b0c0/kube-rbac-proxy/0.log" Jun 08 18:51:14.303070 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:14.303045 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lltvp_bdd45eda-ac8b-41e5-a0cb-133fae85b0c0/exporter/0.log" Jun 08 18:51:14.325482 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:14.325462 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lltvp_bdd45eda-ac8b-41e5-a0cb-133fae85b0c0/extractor/0.log" Jun 08 18:51:16.362361 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:16.362336 2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rd9c8/perf-node-gather-daemonset-m6m7x" Jun 08 18:51:16.771085 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:16.770986 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6ccfc5987b-2wj4b_fed5ad2a-36d6-4dba-ba4a-3a7ed469717f/nginx/0.log" Jun 08 18:51:16.871511 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:16.871485 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7d7b5975d4-sfhwn_cdc46532-7e1c-4b08-af34-626d0c3fa026/maas-api/9.log" Jun 08 18:51:16.871686 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:16.871671 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7d7b5975d4-sfhwn_cdc46532-7e1c-4b08-af34-626d0c3fa026/maas-api/9.log" Jun 08 18:51:16.895323 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:16.895295 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-755bdf5b84-hxvn5_bf75a165-c054-4287-931d-919d979998a0/manager/0.log" Jun 08 18:51:16.988741 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:16.988718 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg_7f5b1db2-2ae0-4e32-be58-bd93fba25d1a/manager/0.log" Jun 08 18:51:17.008202 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:17.008184 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cdbb9f7bb-hlcsg_7f5b1db2-2ae0-4e32-be58-bd93fba25d1a/copy-manifests/0.log" Jun 08 18:51:17.166265 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:17.166241 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-xrxlp_3a282e2a-6285-4402-9401-965ad79885ec/postgres/0.log" Jun 08 18:51:18.964005 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:18.963973 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b7d5b599f-rxknh_30e4f912-6ad4-4b79-b44f-30b789d5d554/manager/0.log" Jun 08 18:51:23.633746 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:23.633716 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tj2wf_69fb08a9-524b-42d1-87c1-d1be36abe138/istio-proxy/0.log" Jun 08 18:51:23.707351 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:23.707330 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/1.log" Jun 08 18:51:23.707560 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:23.707541 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/0.log" Jun 08 18:51:23.716343 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:23.716322 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vrhtm_c90c7a14-f112-4a22-a123-794843a21936/payload-pre-processing/0.log" Jun 08 18:51:23.751471 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:23.751448 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dc4f597c9-ndwsz_111698bf-c87a-4ba7-b95e-8cd003d5b568/router/0.log" Jun 08 18:51:24.888625 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:24.888593 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tj2wf_69fb08a9-524b-42d1-87c1-d1be36abe138/istio-proxy/0.log" Jun 08 18:51:24.971791 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:24.971752 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/1.log" Jun 08 18:51:24.972035 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:24.972015 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/0.log" Jun 08 18:51:24.983024 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:24.983004 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vrhtm_c90c7a14-f112-4a22-a123-794843a21936/payload-pre-processing/0.log" Jun 08 18:51:25.015869 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:25.015849 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dc4f597c9-ndwsz_111698bf-c87a-4ba7-b95e-8cd003d5b568/router/0.log" Jun 08 18:51:25.457135 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:25.457106 2531 scope.go:117] "RemoveContainer" containerID="4ce319a41cf203c80fcabcc399b4d6f6c40f5214781f4aea2ffcbbf31cc6b71d" Jun 08 18:51:25.457310 ip-10-0-132-8 kubenswrapper[2531]: E0608 18:51:25.457268 2531 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7d7b5975d4-sfhwn_opendatahub(cdc46532-7e1c-4b08-af34-626d0c3fa026)\"" pod="opendatahub/maas-api-7d7b5975d4-sfhwn" podUID="cdc46532-7e1c-4b08-af34-626d0c3fa026" Jun 08 18:51:26.440241 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.440214 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvhtc_0f2532f5-e06b-4a0b-84d8-ac54315c3a1b/kube-multus-additional-cni-plugins/0.log" Jun 08 18:51:26.460041 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.460020 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvhtc_0f2532f5-e06b-4a0b-84d8-ac54315c3a1b/egress-router-binary-copy/0.log" Jun 08 18:51:26.484651 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.484632 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvhtc_0f2532f5-e06b-4a0b-84d8-ac54315c3a1b/cni-plugins/0.log" Jun 08 18:51:26.505119 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.505101 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvhtc_0f2532f5-e06b-4a0b-84d8-ac54315c3a1b/bond-cni-plugin/0.log" Jun 08 18:51:26.524538 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.524519 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvhtc_0f2532f5-e06b-4a0b-84d8-ac54315c3a1b/routeoverride-cni/0.log" Jun 08 18:51:26.544352 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.544332 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvhtc_0f2532f5-e06b-4a0b-84d8-ac54315c3a1b/whereabouts-cni-bincopy/0.log" Jun 08 18:51:26.562790 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.562770 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvhtc_0f2532f5-e06b-4a0b-84d8-ac54315c3a1b/whereabouts-cni/0.log" Jun 08 18:51:26.573430 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.573413 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tj2wf_69fb08a9-524b-42d1-87c1-d1be36abe138/istio-proxy/0.log" Jun 08 18:51:26.600059 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.600033 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dk4x4_f4305c9c-ac5e-4c4a-b86e-b0af5e5d884f/kube-multus/0.log" Jun 08 18:51:26.648708 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.648685 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ctgvc_b19a021f-4a9c-4916-89c4-de834fc39272/network-metrics-daemon/0.log" Jun 08 18:51:26.655829 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.655811 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/1.log" Jun 08 18:51:26.656155 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.656129 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-d7fwb_7ba911c2-309d-453a-b9bf-e9830d2a614d/istio-proxy/0.log" Jun 08 18:51:26.666084 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.666067 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vrhtm_c90c7a14-f112-4a22-a123-794843a21936/payload-pre-processing/0.log" Jun 08 18:51:26.666674 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.666660 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ctgvc_b19a021f-4a9c-4916-89c4-de834fc39272/kube-rbac-proxy/0.log" Jun 08 18:51:26.703374 ip-10-0-132-8 kubenswrapper[2531]: I0608 18:51:26.703301 2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dc4f597c9-ndwsz_111698bf-c87a-4ba7-b95e-8cd003d5b568/router/0.log"