Jul 02 22:59:46.763136 ip-10-0-142-239 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 22:59:46.763148 ip-10-0-142-239 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 22:59:46.763157 ip-10-0-142-239 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 22:59:46.763450 ip-10-0-142-239 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 22:59:56.873584 ip-10-0-142-239 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 22:59:56.873605 ip-10-0-142-239 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e3943681ceef4ac095052e9cf823e393 --
Jul 02 23:01:32.911328 ip-10-0-142-239 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.386277    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389956    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389967    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389971    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389974    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389980    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389984    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:01:33.447896 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389986    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389991    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389995    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.389998    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390001    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390004    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390007    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390009    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390012    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390015    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390018    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390020    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390023    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390027    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390029    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390032    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390035    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390037    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390040    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:01:33.449875 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390043    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390046    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390063    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390066    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390068    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390071    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390074    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390077    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390079    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390082    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390084    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390088    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390090    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390093    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390095    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390098    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390101    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390104    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390107    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390110    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:01:33.452292 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390112    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390115    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390117    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390120    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390123    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390125    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390128    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390130    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390133    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390135    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390138    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390140    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390143    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390145    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390148    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390150    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390152    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390156    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390158    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390161    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:01:33.454184 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390163    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390166    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390168    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390171    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390174    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390176    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390179    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390182    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390184    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390187    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390189    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390192    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390195    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390199    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390202    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390205    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390208    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390211    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390214    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:01:33.463809 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390217    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:01:33.456489 ip-10-0-142-239 systemd[1]: Started Kubernetes Kubelet.
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390220    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390224    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390227    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390229    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390232    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390235    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390237    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390240    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390242    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390245    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390248    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390251    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390253    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390256    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390920    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390926    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390929    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390932    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390934    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:01:33.465939 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390937    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390940    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390943    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390945    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390948    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390950    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390953    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390956    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390959    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390962    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390964    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390967    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390970    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390972    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390975    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390978    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390981    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390984    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390987    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390990    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:01:33.479705 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390992    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390995    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.390998    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391000    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391003    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391005    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391008    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391010    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391013    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391018    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391022    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391025    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391028    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391031    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391034    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391037    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391039    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391042    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391045    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:01:33.495473 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391065    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391068    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391071    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391073    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391076    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391078    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391083    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391085    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391088    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391090    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391093    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391096    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391100    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391104    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391106    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391109    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391112    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391114    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391117    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:01:33.497680 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391119    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391122    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391125    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391127    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391130    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391132    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391135    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391137    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391140    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391143    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391145    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391148    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391150    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391152    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391155    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391158    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391160    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391163    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391166    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391169    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:01:33.499459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391172    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391175    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391177    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391180    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391184    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391187    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391190    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391192    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391196    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391200    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391202    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391205    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391208    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391211    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391214    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391216    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391559    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391564    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391569    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:01:33.501851 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391573    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391576    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391579    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391582    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391585    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391587    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391590    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391592    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391595    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391598    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391600    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391604    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391609    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391624    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391627    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391630    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391633    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391637    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391640    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391642    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:01:33.516432 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391646    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391648    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391650    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391653    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391655    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391658    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391660    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391663    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391666    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391669    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391671    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391673    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391676    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391678    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391681    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391683    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391686    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391688    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391691    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391693    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:01:33.522288 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391696    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391698    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391700    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391703    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391707    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391709    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391712    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391714    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391716    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391720    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391722    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391725    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391727    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391730    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391732    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391734    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391737    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391739    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391742    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391744    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:01:33.538649 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391747    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391749    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391752    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391754    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391757    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391759    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391762    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391764    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391767    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391769    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391772    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391774    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391776    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391779    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391781    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391784    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391787    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391790    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391793    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:01:33.540574 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391795    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391797    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391801    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391804    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391806    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391808    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391811    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391813    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391816    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391818    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391821    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391823    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391826    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391828    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391830    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391833    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.391835    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391910    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391918    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391926    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391932    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 23:01:33.541210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391940    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391944    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391948    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391952    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391955    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391958    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391961    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391964    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391969    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391971    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391974    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391977    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391979    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391983    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391988    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391991    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391994    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.391996    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392000    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392003    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392006    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392008    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392011    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392014    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 23:01:33.693071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392017    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392020    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392023    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392026    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392030    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392033    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392036    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392038    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392041    2575 flags.go:64] FLAG: --enable-server="true"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392045    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392060    2575 flags.go:64] FLAG: --event-burst="100"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392063    2575 flags.go:64] FLAG: --event-qps="50"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392065    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392068    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392071    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392074    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392079    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392081    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392084    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392087    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392089    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392094    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392096    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392099    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392102    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 23:01:33.693895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392104    2575 flags.go:64] FLAG: --feature-gates=""
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392108    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392111    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392114    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392116    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392119    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392122    2575 flags.go:64] FLAG: --help="false"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392125    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392128    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392130    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392133    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392136    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392139    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392142    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392145    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392147    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392150    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392153    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392156    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392158    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392161    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392164    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392167    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392171    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 23:01:33.694738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392173    2575 flags.go:64] FLAG: --lock-file=""
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392176    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392179    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392181    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392187    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392190    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392193    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392196    2575 flags.go:64] FLAG: --logging-format="text"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392198    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392201    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392204    2575 flags.go:64] FLAG: --manifest-url=""
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392207    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392211    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392213    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392217    2575 flags.go:64] FLAG: --max-pods="110"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392220    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392223    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392225    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392228    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392231    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392233    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392236    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392243    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392246    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392249    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 23:01:33.697820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392252    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392255    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392260    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392262    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392265    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392268    2575 flags.go:64] FLAG: --port="10250"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392271    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392274    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b28297098ae7adf"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392278    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392281    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392283    2575 flags.go:64] FLAG: --register-node="true"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392288    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392291    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392294    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392296    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392299    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392303    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392305    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392308    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392311    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392313    2575 flags.go:64] FLAG: --runonce="false"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392316    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392319    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392322    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392324    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 23:01:33.698656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392327    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392330    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392333    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392335    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392338    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392341    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392343    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392346    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392349    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392355    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392358    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392363    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392366    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392368    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392373    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392376    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392379    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392382    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392386    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392388    2575 flags.go:64] FLAG: --v="2"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392392    2575 flags.go:64] FLAG: --version="false"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392396    2575 flags.go:64] FLAG: --vmodule=""
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392399    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392402    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392510    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:01:33.700132 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392513    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392516    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392520    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392523    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392526    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392530    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392533    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392535    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392538    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392540    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392543    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392546    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392548    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392551    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392554    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392556    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392558    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392561    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392564    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392566    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:01:33.700843 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392569    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392572    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392575    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392577    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392580    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392583    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392586    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392588    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392591    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392593    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392595    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392598    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392600    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392603    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392605    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392608    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392611    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392613    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392616    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392618    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:01:33.701393 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392620    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392623    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392625    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392627    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392630    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392632    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392634    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392638    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392641    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392644    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392647    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392650    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392652    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392657    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392661    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392664    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392668    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392673    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392676    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:01:33.701969 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392679    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392682    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392685    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392687    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392690    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392692    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392695    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392697    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392700    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392702    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392705    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392707    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392710    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392712    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392715    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392717    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392719    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392722    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392724    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:01:33.801874 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392726    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392729    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392731    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392734    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392736    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392739    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392742    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392745    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392748    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392751    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392753    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392757    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392760    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392762    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392765    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392767    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392770    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392772    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392775    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:01:33.802630 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.392777    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.392782    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.400977    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.400997    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.401011    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.401017    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401081    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401088    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401092    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401095    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401098    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401100    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401103    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401105    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:01:33.803242 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401108    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401111    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401113    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401116    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401118    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401121    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401124    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401127    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401129    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401132    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401134    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401137    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401139    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401142    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401144    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401147    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401150    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401152    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401154    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401157    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:01:33.803869 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401159    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401163    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401165    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401168    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401170    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401176    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401179    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401182    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401184    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401187    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401189    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401192    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401194    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401197    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401199    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401204    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401206    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401209    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401212    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401214    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:01:33.804427 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401217    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401219    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401222    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401224    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401227    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401230    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401232    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401235    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401238    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401240    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401243    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401245    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401248    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401250    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401253    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401255    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401258    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401262    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401264    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401267    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:01:33.804991 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401269    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401272    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401274    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401277    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401281    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401284    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401287    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401292    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401296    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401298    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401301    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401304    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401307    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401310    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401312    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401314    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401317    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401319    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401322    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:01:33.805591 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401324    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401327    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401329    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401332    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401334    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401337    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401339    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401341    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401344    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401347    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401350    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401353    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.401358    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.401588    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402580    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:01:33.806157 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402586    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402593    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402596    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402602    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402695    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402699    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402702    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402705    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402708    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402710    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402713    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402716    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402719    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402725    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402730    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402733    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402736    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402739    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402742    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402745    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:01:33.806587 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402747    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402750    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402753    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402755    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402758    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402761    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402764    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402766    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402769    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402772    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402775    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402777    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402780    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402782    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402785    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402788    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402795    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402798    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402801    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402803    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:01:33.807178 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402806    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402809    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402811    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402814    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402817    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402819    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402822    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402825    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402827    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402830    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402832    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402835    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402837    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402840    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402843    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402845    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402847    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402850    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402855    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402857    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:01:33.807722 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402860    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402863    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402865    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402867    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402870    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402873    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402876    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402879    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402882    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402884    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402888    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402892    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402895    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402898    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402901    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402904    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402907    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402909    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402912    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402915    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:01:33.808307 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402918    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402920    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402923    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402926    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402931    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402933    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402936    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402939    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402941    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402944    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402946    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402949    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402953    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402957    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402959    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402962    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:01:33.808830 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:33.402965    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.402970    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.403093    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.405072    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.406593    2575 server.go:1019] "Starting client certificate rotation"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.406694    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.406723    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.409199    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.412257    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.420728    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.422903    2575 log.go:25] "Validated CRI v1 image API"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.424623    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 23:01:33.809308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.427734    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8fa034bd-782f-4e0c-b75f-cdebb9c57bb0:/dev/nvme0n1p4 d459a08a-4b8a-4677-a13f-10021ca205ef:/dev/nvme0n1p3]
Jul 02 23:01:33.809649 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.427747    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 23:01:33.809747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.435897    2575 manager.go:216] Machine: {Timestamp:2026-07-02 23:01:33.43461246 +0000 UTC m=+0.371661759 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103335 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f2c39539416805695139da8253a3 SystemUUID:ec25f2c3-9539-4168-0569-5139da8253a3 BootID:e3943681-ceef-4ac0-9505-2e9cf823e393 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:7a:2b:a3:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:7a:2b:a3:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:a3:c1:05:1a:a7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 23:01:33.809747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.435984    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 23:01:33.809747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.436045    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 23:01:33.809747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.437195    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 23:01:33.809747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.437273    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:01:33.809747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.437222    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 23:01:33.809747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.437920    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.437930    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.437937    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.438466    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.439763    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443132    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443237    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443262    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443271    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443283    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443290    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443299    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443577    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.443594    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.447162    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.449167    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.449209    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.450940    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.450957    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.450966    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.450974    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.450986    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.450994    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451006    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451014    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451025    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451032    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451044    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451065    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451717    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.451725    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.453034    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.452925    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.455644    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tj2mf"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.455834    2575 server.go:1268] "Started kubelet"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.455893    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.455973    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.455912    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.456868    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.457604    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 23:01:33.810288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.458645    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.461341    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.464773    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.464793    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.464929    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.465408    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.465426    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.463761    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-239.ec2.internal.18be9b555f20e012  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-239.ec2.internal,UID:ip-10-0-142-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-239.ec2.internal,},FirstTimestamp:2026-07-02 23:01:33.455810578 +0000 UTC m=+0.392859876,LastTimestamp:2026-07-02 23:01:33.455810578 +0000 UTC m=+0.392859876,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-239.ec2.internal,}"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.465564    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.465618    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.465624    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.465983    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tj2mf"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466070    2575 factory.go:55] Registering systemd factory
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466085    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466273    2575 factory.go:153] Registering CRI-O factory
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466282    2575 factory.go:223] Registration of the crio container factory successfully
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466323    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466346    2575 factory.go:103] Registering Raw factory
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466363    2575 manager.go:1196] Started watching for new ooms in manager
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.466784    2575 manager.go:349] Starting recovery of all containers
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.467998    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.468102    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.477198    2575 manager.go:354] Recovery completed
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.485461    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.487203    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.487227    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.487236    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.487703    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.487714    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.487721    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.487749    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.488392    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:01:33.811368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.488420    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.488433    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.488882    2575 policy_none.go:49] "None policy: Start"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.488899    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.488909    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.489901    2575 policy_none.go:47] "Start"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.565600    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.565693    2575 manager.go:337] "Starting Device Plugin manager"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.565758    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.565771    2575 server.go:87] "Starting device plugin registration server"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.565998    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.566011    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.566089    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.566163    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.566172    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.566639    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.566703    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.613479    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.614565    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.614599    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.614619    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.614646    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.617253    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.666329    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.667080    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.667105    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.667118    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.667137    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.674296    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-239.ec2.internal\" not found" node="ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.675529    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.675554    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-239.ec2.internal\": node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.688739    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.715326    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"]
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.715385    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.727297    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.727321    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.727334    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.728585    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:01:33.940329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.728697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.728722    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.729255    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.729255    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.729279    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.729290    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.729303    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.729319    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.730483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.730509    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.731085    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.731111    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.731125    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.766418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.766439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.766473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4171bb48f6e62864b15f6dcc9fa0fe2a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-239.ec2.internal\" (UID: \"4171bb48f6e62864b15f6dcc9fa0fe2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.772578    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-239.ec2.internal\" not found" node="ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.777228    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-239.ec2.internal\" not found" node="ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.789754    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.866952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.866972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.866987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4171bb48f6e62864b15f6dcc9fa0fe2a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-239.ec2.internal\" (UID: \"4171bb48f6e62864b15f6dcc9fa0fe2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941913 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.867010    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4171bb48f6e62864b15f6dcc9fa0fe2a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-239.ec2.internal\" (UID: \"4171bb48f6e62864b15f6dcc9fa0fe2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941913 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.867063    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941913 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:33.867063    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5b613f510a320d3ccc3ec79b1f26f861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal\" (UID: \"5b613f510a320d3ccc3ec79b1f26f861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:33.941913 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.890078    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:34.055936 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:33.990663    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:34.178674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.075092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:34.178674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.080340    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:34.178674 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.091571    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:34.295256 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.192064    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:34.295256 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.292487    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:34.416947 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.392912    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-239.ec2.internal\" not found"
Jul 02 23:01:34.416947 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.406072    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 23:01:34.416947 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.406194    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.419001    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.443788    2575 apiserver.go:52] "Watching apiserver"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.452965    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.455432    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-vx6gc","kube-system/konnectivity-agent-sz7lt","openshift-cluster-node-tuning-operator/tuned-b94x2","openshift-image-registry/node-ca-vxmqs","openshift-multus/multus-additional-cni-plugins-m4hjr","openshift-network-diagnostics/network-check-target-vvqzr","openshift-network-operator/iptables-alerter-97v55","openshift-ovn-kubernetes/ovnkube-node-4bx2l","kube-system/global-pull-secret-syncer-79qqj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r","openshift-dns/node-resolver-2xwww","openshift-multus/multus-j6mrv"]
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.456769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.456827    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.457858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.460845    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.460957    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vnjrj\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.460850    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.461164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.462292    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.463173    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pvwxj\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.463251    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.463505    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.463833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.464359    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.464442    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.464525    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nwnf2\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.464587    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.464847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.464906    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.464992    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.465412    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.466078    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.466146    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 23:01:34.519691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.466677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.466692    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.466751    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.466939    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9qjm6\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.468118    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.468681    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469086    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469261    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469347    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469438    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c26sq\""
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.469775    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd28ad52-cc89-42b1-9d5f-211dc3061bd1-konnectivity-ca\") pod \"konnectivity-agent-sz7lt\" (UID: \"fd28ad52-cc89-42b1-9d5f-211dc3061bd1\") " pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-modprobe-d\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-os-release\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq2h4\" (UniqueName: \"kubernetes.io/projected/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-kube-api-access-sq2h4\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-lib-modules\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-cnibin\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.520999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd28ad52-cc89-42b1-9d5f-211dc3061bd1-agent-certs\") pod \"konnectivity-agent-sz7lt\" (UID: \"fd28ad52-cc89-42b1-9d5f-211dc3061bd1\") " pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysctl-conf\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.469988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-run\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-var-lib-kubelet\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-host\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7af76860-5555-496b-b14d-8c2e9882acfd-tmp\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwvxx\" (UniqueName: \"kubernetes.io/projected/7af76860-5555-496b-b14d-8c2e9882acfd-kube-api-access-fwvxx\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-system-cni-dir\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-cni-binary-copy\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8b8\" (UniqueName: \"kubernetes.io/projected/e3609761-4f85-439e-8e39-7dc1faf96080-kube-api-access-ts8b8\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-serviceca\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470183    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 23:01:34.523805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31ff9cf6-df23-4a47-9244-cbd109c8dccc-iptables-alerter-script\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysconfig\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ff9cf6-df23-4a47-9244-cbd109c8dccc-host-slash\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysctl-d\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-systemd\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-kubernetes\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-sys\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-host\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bdnq\" (UniqueName: \"kubernetes.io/projected/31ff9cf6-df23-4a47-9244-cbd109c8dccc-kube-api-access-2bdnq\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxhcp\" (UniqueName: \"kubernetes.io/projected/2fe605be-a403-46ec-8e29-89278da41672-kube-api-access-rxhcp\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7af76860-5555-496b-b14d-8c2e9882acfd-etc-tuned\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470649    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 22:56:34 +0000 UTC" deadline="2028-04-03 02:52:02.64288136 +0000 UTC"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.470677    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15363h50m28.172206296s"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.471388    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.524713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.471947    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.472162    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.472414    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xbbbq\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.472548    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.472676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.472792    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.472903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.473313    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.473453    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.473669    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kn928\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.473929    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.476078    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.476191    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.476704    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8htz\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.476716    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g6rzb\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.477125    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.477251    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.477521    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.477630    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.477676    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal"]
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.479551    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.485878    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal"]
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.488336    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:01:34.525829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.507805    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fv865"
Jul 02 23:01:34.530509 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.527496    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fv865"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.566655    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.570886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovnkube-config\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.570910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32405914-3a78-48e6-bbcc-04c37c5afecd-hosts-file\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.570931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-kubernetes\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.570947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-sys\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.570962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bdnq\" (UniqueName: \"kubernetes.io/projected/31ff9cf6-df23-4a47-9244-cbd109c8dccc-kube-api-access-2bdnq\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571019    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-sys\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-systemd\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-ovn\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b0d4b43-4df7-41f4-87aa-706c96829d6b-cni-binary-copy\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-k8s-cni-cncf-io\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7af76860-5555-496b-b14d-8c2e9882acfd-etc-tuned\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-cni-bin\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.624891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571248    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-kubernetes\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94d267d5-49fe-42da-a581-f2e74ea9c18b-kubelet-config\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-kubelet\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-conf-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-sys-fs\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-modprobe-d\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-etc-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-device-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-cnibin\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-os-release\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-socket-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx46r\" (UniqueName: \"kubernetes.io/projected/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-kube-api-access-zx46r\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovn-node-metrics-cert\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.625515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd28ad52-cc89-42b1-9d5f-211dc3061bd1-agent-certs\") pod \"konnectivity-agent-sz7lt\" (UID: \"fd28ad52-cc89-42b1-9d5f-211dc3061bd1\") " pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-var-lib-kubelet\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-host\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7af76860-5555-496b-b14d-8c2e9882acfd-tmp\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvxx\" (UniqueName: \"kubernetes.io/projected/7af76860-5555-496b-b14d-8c2e9882acfd-kube-api-access-fwvxx\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-system-cni-dir\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8b8\" (UniqueName: \"kubernetes.io/projected/e3609761-4f85-439e-8e39-7dc1faf96080-kube-api-access-ts8b8\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-systemd-units\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-hostroot\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-daemon-config\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbb5t\" (UniqueName: \"kubernetes.io/projected/4b0d4b43-4df7-41f4-87aa-706c96829d6b-kube-api-access-qbb5t\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.571981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-registration-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ff9cf6-df23-4a47-9244-cbd109c8dccc-host-slash\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.626098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-cni-netd\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-cni-bin\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572290    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-modprobe-d\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572324    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-cnibin\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572592    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-host\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572622    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-var-lib-kubelet\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572922    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.572951    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-system-cni-dir\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573071    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573109    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31ff9cf6-df23-4a47-9244-cbd109c8dccc-host-slash\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysctl-d\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-systemd\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-node-log\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-system-cni-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.626780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-multus-certs\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573416    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysctl-d\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573441    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-systemd\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-host\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxhcp\" (UniqueName: \"kubernetes.io/projected/2fe605be-a403-46ec-8e29-89278da41672-kube-api-access-rxhcp\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-kubelet\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-slash\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-socket-dir-parent\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmrc2\" (UniqueName: \"kubernetes.io/projected/334e493e-188e-4f56-bb02-541877b376f2-kube-api-access-dmrc2\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd28ad52-cc89-42b1-9d5f-211dc3061bd1-konnectivity-ca\") pod \"konnectivity-agent-sz7lt\" (UID: \"fd28ad52-cc89-42b1-9d5f-211dc3061bd1\") " pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-os-release\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.627346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq2h4\" (UniqueName: \"kubernetes.io/projected/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-kube-api-access-sq2h4\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.573876    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.573897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-log-socket\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.573949    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs podName:2fe605be-a403-46ec-8e29-89278da41672 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:35.073929135 +0000 UTC m=+2.010978424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs") pod "network-metrics-daemon-vx6gc" (UID: "2fe605be-a403-46ec-8e29-89278da41672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovnkube-script-lib\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94d267d5-49fe-42da-a581-f2e74ea9c18b-dbus\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-cni-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574163    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3609761-4f85-439e-8e39-7dc1faf96080-os-release\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-lib-modules\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574226    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-host\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-cnibin\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4ksm\" (UniqueName: \"kubernetes.io/projected/32405914-3a78-48e6-bbcc-04c37c5afecd-kube-api-access-q4ksm\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-run-netns\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.627902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574370    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-lib-modules\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysctl-conf\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-run\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-cni-binary-copy\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574637    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysctl-conf\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-serviceca\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31ff9cf6-df23-4a47-9244-cbd109c8dccc-iptables-alerter-script\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32405914-3a78-48e6-bbcc-04c37c5afecd-tmp-dir\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-var-lib-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574838    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd28ad52-cc89-42b1-9d5f-211dc3061bd1-konnectivity-ca\") pod \"konnectivity-agent-sz7lt\" (UID: \"fd28ad52-cc89-42b1-9d5f-211dc3061bd1\") " pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.574862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-netns\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575288    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.628702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575346    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-cni-binary-copy\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575394    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-run\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-cni-multus\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-etc-kubernetes\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysconfig\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-env-overrides\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575550    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7af76860-5555-496b-b14d-8c2e9882acfd-etc-sysconfig\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575587    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31ff9cf6-df23-4a47-9244-cbd109c8dccc-iptables-alerter-script\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.575628    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-serviceca\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.576033    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3609761-4f85-439e-8e39-7dc1faf96080-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.576443    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7af76860-5555-496b-b14d-8c2e9882acfd-tmp\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.576473    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7af76860-5555-496b-b14d-8c2e9882acfd-etc-tuned\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.576612    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd28ad52-cc89-42b1-9d5f-211dc3061bd1-agent-certs\") pod \"konnectivity-agent-sz7lt\" (UID: \"fd28ad52-cc89-42b1-9d5f-211dc3061bd1\") " pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.629281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.578767    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bdnq\" (UniqueName: \"kubernetes.io/projected/31ff9cf6-df23-4a47-9244-cbd109c8dccc-kube-api-access-2bdnq\") pod \"iptables-alerter-97v55\" (UID: \"31ff9cf6-df23-4a47-9244-cbd109c8dccc\") " pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.580443    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwvxx\" (UniqueName: \"kubernetes.io/projected/7af76860-5555-496b-b14d-8c2e9882acfd-kube-api-access-fwvxx\") pod \"tuned-b94x2\" (UID: \"7af76860-5555-496b-b14d-8c2e9882acfd\") " pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.580708    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8b8\" (UniqueName: \"kubernetes.io/projected/e3609761-4f85-439e-8e39-7dc1faf96080-kube-api-access-ts8b8\") pod \"multus-additional-cni-plugins-m4hjr\" (UID: \"e3609761-4f85-439e-8e39-7dc1faf96080\") " pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.581185    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.584912    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxhcp\" (UniqueName: \"kubernetes.io/projected/2fe605be-a403-46ec-8e29-89278da41672-kube-api-access-rxhcp\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.585046    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq2h4\" (UniqueName: \"kubernetes.io/projected/7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf-kube-api-access-sq2h4\") pod \"node-ca-vxmqs\" (UID: \"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf\") " pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.586375    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.586391    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.586400    2575 projected.go:196] Error preparing data for projected volume kube-api-access-gppd9 for pod openshift-network-diagnostics/network-check-target-vvqzr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.586456    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9 podName:bbc937b9-bc6f-4147-9064-2bbbabf3a601 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:35.086442458 +0000 UTC m=+2.023491765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gppd9" (UniqueName: "kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9") pod "network-check-target-vvqzr" (UID: "bbc937b9-bc6f-4147-9064-2bbbabf3a601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.594955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxmqs"
Jul 02 23:01:34.630164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.627666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m4hjr"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.664048    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-97v55"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-kubelet\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676891    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-slash\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-socket-dir-parent\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676951    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-kubelet\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmrc2\" (UniqueName: \"kubernetes.io/projected/334e493e-188e-4f56-bb02-541877b376f2-kube-api-access-dmrc2\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-log-socket\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676975    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676955    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-slash\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-socket-dir-parent\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovnkube-script-lib\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94d267d5-49fe-42da-a581-f2e74ea9c18b-dbus\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.698151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-cni-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-cnibin\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4ksm\" (UniqueName: \"kubernetes.io/projected/32405914-3a78-48e6-bbcc-04c37c5afecd-kube-api-access-q4ksm\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-run-netns\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677898    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-cni-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.677958    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-cnibin\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.676945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678047    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-log-socket\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678064    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94d267d5-49fe-42da-a581-f2e74ea9c18b-dbus\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678115    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-run-netns\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678192    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32405914-3a78-48e6-bbcc-04c37c5afecd-tmp-dir\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-var-lib-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-netns\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.698985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-cni-multus\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-etc-kubernetes\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-env-overrides\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovnkube-config\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32405914-3a78-48e6-bbcc-04c37c5afecd-hosts-file\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-systemd\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678922    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-netns\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-ovn\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.678975    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-ovn\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679025    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-etc-kubernetes\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b0d4b43-4df7-41f4-87aa-706c96829d6b-cni-binary-copy\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-k8s-cni-cncf-io\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-cni-bin\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.699811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94d267d5-49fe-42da-a581-f2e74ea9c18b-kubelet-config\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-kubelet\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-conf-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-sys-fs\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-etc-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-device-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-os-release\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679446    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-env-overrides\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-socket-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx46r\" (UniqueName: \"kubernetes.io/projected/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-kube-api-access-zx46r\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovn-node-metrics-cert\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.679572    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-socket-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-systemd-units\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-hostroot\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-daemon-config\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbb5t\" (UniqueName: \"kubernetes.io/projected/4b0d4b43-4df7-41f4-87aa-706c96829d6b-kube-api-access-qbb5t\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-registration-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-cni-netd\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-cni-bin\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-node-log\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-system-cni-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-multus-certs\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680412    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32405914-3a78-48e6-bbcc-04c37c5afecd-tmp-dir\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.680568    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681045    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovnkube-config\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32405914-3a78-48e6-bbcc-04c37c5afecd-hosts-file\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681155    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b0d4b43-4df7-41f4-87aa-706c96829d6b-cni-binary-copy\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681237    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-cni-bin\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681314    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94d267d5-49fe-42da-a581-f2e74ea9c18b-kubelet-config\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:34.700906 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681362    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-kubelet\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681437    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-conf-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681505    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-sys-fs\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681552    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-etc-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681621    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-hostroot\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-registration-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681886    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681930    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-host-cni-netd\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681980    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-cni-bin\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682031    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-node-log\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682082    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-system-cni-dir\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682104    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b0d4b43-4df7-41f4-87aa-706c96829d6b-multus-daemon-config\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682143    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-multus-certs\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682180    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-var-lib-openvswitch\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-var-lib-cni-multus\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.701505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682221    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-os-release\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682285    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b0d4b43-4df7-41f4-87aa-706c96829d6b-host-run-k8s-cni-cncf-io\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.682297    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.681506    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-run-systemd\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682380    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovnkube-script-lib\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:34.682464    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret podName:94d267d5-49fe-42da-a581-f2e74ea9c18b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:35.182439112 +0000 UTC m=+2.119488399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret") pod "global-pull-secret-syncer-79qqj" (UID: "94d267d5-49fe-42da-a581-f2e74ea9c18b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682644    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/334e493e-188e-4f56-bb02-541877b376f2-device-dir\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.682706    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-systemd-units\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.684745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-ovn-node-metrics-cert\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.688660    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmrc2\" (UniqueName: \"kubernetes.io/projected/334e493e-188e-4f56-bb02-541877b376f2-kube-api-access-dmrc2\") pod \"aws-ebs-csi-driver-node-pwr4r\" (UID: \"334e493e-188e-4f56-bb02-541877b376f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.689892    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbb5t\" (UniqueName: \"kubernetes.io/projected/4b0d4b43-4df7-41f4-87aa-706c96829d6b-kube-api-access-qbb5t\") pod \"multus-j6mrv\" (UID: \"4b0d4b43-4df7-41f4-87aa-706c96829d6b\") " pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.690662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4ksm\" (UniqueName: \"kubernetes.io/projected/32405914-3a78-48e6-bbcc-04c37c5afecd-kube-api-access-q4ksm\") pod \"node-resolver-2xwww\" (UID: \"32405914-3a78-48e6-bbcc-04c37c5afecd\") " pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.702009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.691100    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx46r\" (UniqueName: \"kubernetes.io/projected/328eb2bc-7a95-4e95-a06f-bce9fe8630fc-kube-api-access-zx46r\") pod \"ovnkube-node-4bx2l\" (UID: \"328eb2bc-7a95-4e95-a06f-bce9fe8630fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:34.776622 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.726381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r"
Jul 02 23:01:34.776622 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.755866    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2xwww"
Jul 02 23:01:34.776622 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.760668    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6mrv"
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.822079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.822083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b94x2"
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.836990    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.838028    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32405914_3a78_48e6_bbcc_04c37c5afecd.slice/crio-ded8d4e6c1be76473fbb381fdc46d7bc284e0e779d9904b8e1494dbbcba3cab7 WatchSource:0}: Error finding container ded8d4e6c1be76473fbb381fdc46d7bc284e0e779d9904b8e1494dbbcba3cab7: Status 404 returned error can't find the container with id ded8d4e6c1be76473fbb381fdc46d7bc284e0e779d9904b8e1494dbbcba3cab7
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.838496    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4171bb48f6e62864b15f6dcc9fa0fe2a.slice/crio-d63c98c71f5f876b89e8d670eab0480d8dcb8cce9dfab4b8b6ddae5d7c5908c1 WatchSource:0}: Error finding container d63c98c71f5f876b89e8d670eab0480d8dcb8cce9dfab4b8b6ddae5d7c5908c1: Status 404 returned error can't find the container with id d63c98c71f5f876b89e8d670eab0480d8dcb8cce9dfab4b8b6ddae5d7c5908c1
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.839847    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b613f510a320d3ccc3ec79b1f26f861.slice/crio-8183ac137091b92f291612d6155f371b68c14029d971c800ad7624a9c17b01a2 WatchSource:0}: Error finding container 8183ac137091b92f291612d6155f371b68c14029d971c800ad7624a9c17b01a2: Status 404 returned error can't find the container with id 8183ac137091b92f291612d6155f371b68c14029d971c800ad7624a9c17b01a2
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.840544    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0d4b43_4df7_41f4_87aa_706c96829d6b.slice/crio-0cdb8b50c3680be707d18fe6e2aedb0fa96e01dfd03668c466f82871ba91ad2c WatchSource:0}: Error finding container 0cdb8b50c3680be707d18fe6e2aedb0fa96e01dfd03668c466f82871ba91ad2c: Status 404 returned error can't find the container with id 0cdb8b50c3680be707d18fe6e2aedb0fa96e01dfd03668c466f82871ba91ad2c
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.843560    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.847020    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd28ad52_cc89_42b1_9d5f_211dc3061bd1.slice/crio-c31f39daa19eaee51cc0f52ad07d8e7e7c0e65236742ae83ac562dd706976357 WatchSource:0}: Error finding container c31f39daa19eaee51cc0f52ad07d8e7e7c0e65236742ae83ac562dd706976357: Status 404 returned error can't find the container with id c31f39daa19eaee51cc0f52ad07d8e7e7c0e65236742ae83ac562dd706976357
Jul 02 23:01:34.864631 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.848241    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af76860_5555_496b_b14d_8c2e9882acfd.slice/crio-909e41116289d41268e12b7871d9e033b89bfb4bf5f19f796ff2ce582597dcba WatchSource:0}: Error finding container 909e41116289d41268e12b7871d9e033b89bfb4bf5f19f796ff2ce582597dcba: Status 404 returned error can't find the container with id 909e41116289d41268e12b7871d9e033b89bfb4bf5f19f796ff2ce582597dcba
Jul 02 23:01:35.005349 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.928426    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2e7f2c_5a35_4e82_a2a6_edda721b7dcf.slice/crio-a08d3f1b3612a24a5761806fe4ab5f2658957093ff0c061434e6fc0fa53c8c18 WatchSource:0}: Error finding container a08d3f1b3612a24a5761806fe4ab5f2658957093ff0c061434e6fc0fa53c8c18: Status 404 returned error can't find the container with id a08d3f1b3612a24a5761806fe4ab5f2658957093ff0c061434e6fc0fa53c8c18
Jul 02 23:01:35.005349 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:34.974955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:01:35.005349 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:34.982741    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328eb2bc_7a95_4e95_a06f_bce9fe8630fc.slice/crio-b0810994c02635618f66fb723ee6511688bc345e0c750cdd40a80cf3d3d71153 WatchSource:0}: Error finding container b0810994c02635618f66fb723ee6511688bc345e0c750cdd40a80cf3d3d71153: Status 404 returned error can't find the container with id b0810994c02635618f66fb723ee6511688bc345e0c750cdd40a80cf3d3d71153
Jul 02 23:01:35.118833 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.084116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:35.118833 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.084240    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:35.118833 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.084299    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs podName:2fe605be-a403-46ec-8e29-89278da41672 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:36.08428033 +0000 UTC m=+3.021329617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs") pod "network-metrics-daemon-vx6gc" (UID: "2fe605be-a403-46ec-8e29-89278da41672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:35.118833 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:35.115111    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334e493e_188e_4f56_bb02_541877b376f2.slice/crio-efcec5c3831f7512fd2da024fb86f40aad6510b1013ef5500d9f1b95c23c0cab WatchSource:0}: Error finding container efcec5c3831f7512fd2da024fb86f40aad6510b1013ef5500d9f1b95c23c0cab: Status 404 returned error can't find the container with id efcec5c3831f7512fd2da024fb86f40aad6510b1013ef5500d9f1b95c23c0cab
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:35.156086    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3609761_4f85_439e_8e39_7dc1faf96080.slice/crio-c8ff8bf10503f2bf369dc02670227f4bea0a1a95ad403fd8fa9b96335dfa2e1b WatchSource:0}: Error finding container c8ff8bf10503f2bf369dc02670227f4bea0a1a95ad403fd8fa9b96335dfa2e1b: Status 404 returned error can't find the container with id c8ff8bf10503f2bf369dc02670227f4bea0a1a95ad403fd8fa9b96335dfa2e1b
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.185146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.185174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.185284    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.185290    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.185311    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.185321    2575 projected.go:196] Error preparing data for projected volume kube-api-access-gppd9 for pod openshift-network-diagnostics/network-check-target-vvqzr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.185330    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret podName:94d267d5-49fe-42da-a581-f2e74ea9c18b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:36.185311776 +0000 UTC m=+3.122361064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret") pod "global-pull-secret-syncer-79qqj" (UID: "94d267d5-49fe-42da-a581-f2e74ea9c18b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:35.185357    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9 podName:bbc937b9-bc6f-4147-9064-2bbbabf3a601 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:36.185345573 +0000 UTC m=+3.122394889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gppd9" (UniqueName: "kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9") pod "network-check-target-vvqzr" (UID: "bbc937b9-bc6f-4147-9064-2bbbabf3a601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:35.227459 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:01:35.216996    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ff9cf6_df23_4a47_9244_cbd109c8dccc.slice/crio-37bb8d18591b47ae99e3019a7396713b4040f801a447ebdfd8a5668e5d78119e WatchSource:0}: Error finding container 37bb8d18591b47ae99e3019a7396713b4040f801a447ebdfd8a5668e5d78119e: Status 404 returned error can't find the container with id 37bb8d18591b47ae99e3019a7396713b4040f801a447ebdfd8a5668e5d78119e
Jul 02 23:01:35.466911 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.466430    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:01:35.530584 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.530543    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 22:56:35 +0000 UTC" deadline="2027-12-07 18:01:16.663679586 +0000 UTC"
Jul 02 23:01:35.530584 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.530585    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12546h59m41.133098769s"
Jul 02 23:01:35.624624 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.624529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-97v55" event={"ID":"31ff9cf6-df23-4a47-9244-cbd109c8dccc","Type":"ContainerStarted","Data":"37bb8d18591b47ae99e3019a7396713b4040f801a447ebdfd8a5668e5d78119e"}
Jul 02 23:01:35.626934 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.626849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r" event={"ID":"334e493e-188e-4f56-bb02-541877b376f2","Type":"ContainerStarted","Data":"efcec5c3831f7512fd2da024fb86f40aad6510b1013ef5500d9f1b95c23c0cab"}
Jul 02 23:01:35.632444 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.632331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"b0810994c02635618f66fb723ee6511688bc345e0c750cdd40a80cf3d3d71153"}
Jul 02 23:01:35.636754 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.636726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxmqs" event={"ID":"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf","Type":"ContainerStarted","Data":"a08d3f1b3612a24a5761806fe4ab5f2658957093ff0c061434e6fc0fa53c8c18"}
Jul 02 23:01:35.642611 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.642544    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" event={"ID":"5b613f510a320d3ccc3ec79b1f26f861","Type":"ContainerStarted","Data":"8183ac137091b92f291612d6155f371b68c14029d971c800ad7624a9c17b01a2"}
Jul 02 23:01:35.645972 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.645894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2xwww" event={"ID":"32405914-3a78-48e6-bbcc-04c37c5afecd","Type":"ContainerStarted","Data":"ded8d4e6c1be76473fbb381fdc46d7bc284e0e779d9904b8e1494dbbcba3cab7"}
Jul 02 23:01:35.647636 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.647559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6mrv" event={"ID":"4b0d4b43-4df7-41f4-87aa-706c96829d6b","Type":"ContainerStarted","Data":"0cdb8b50c3680be707d18fe6e2aedb0fa96e01dfd03668c466f82871ba91ad2c"}
Jul 02 23:01:35.654096 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.654006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" event={"ID":"4171bb48f6e62864b15f6dcc9fa0fe2a","Type":"ContainerStarted","Data":"d63c98c71f5f876b89e8d670eab0480d8dcb8cce9dfab4b8b6ddae5d7c5908c1"}
Jul 02 23:01:35.656581 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.656504    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerStarted","Data":"c8ff8bf10503f2bf369dc02670227f4bea0a1a95ad403fd8fa9b96335dfa2e1b"}
Jul 02 23:01:35.659805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.659720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b94x2" event={"ID":"7af76860-5555-496b-b14d-8c2e9882acfd","Type":"ContainerStarted","Data":"909e41116289d41268e12b7871d9e033b89bfb4bf5f19f796ff2ce582597dcba"}
Jul 02 23:01:35.661905 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:35.661832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sz7lt" event={"ID":"fd28ad52-cc89-42b1-9d5f-211dc3061bd1","Type":"ContainerStarted","Data":"c31f39daa19eaee51cc0f52ad07d8e7e7c0e65236742ae83ac562dd706976357"}
Jul 02 23:01:36.091856 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.091789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:36.092055 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.092006    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:36.092216 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.092066    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs podName:2fe605be-a403-46ec-8e29-89278da41672 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:38.092046859 +0000 UTC m=+5.029096151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs") pod "network-metrics-daemon-vx6gc" (UID: "2fe605be-a403-46ec-8e29-89278da41672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:36.192855 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.192821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:36.193012 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.192878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:36.193012 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.193002    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:36.193151 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.193027    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:01:36.193151 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.193055    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:01:36.193151 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.193086    2575 projected.go:196] Error preparing data for projected volume kube-api-access-gppd9 for pod openshift-network-diagnostics/network-check-target-vvqzr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:36.193151 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.193064    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret podName:94d267d5-49fe-42da-a581-f2e74ea9c18b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:38.193044381 +0000 UTC m=+5.130093676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret") pod "global-pull-secret-syncer-79qqj" (UID: "94d267d5-49fe-42da-a581-f2e74ea9c18b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:36.193151 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.193152    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9 podName:bbc937b9-bc6f-4147-9064-2bbbabf3a601 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:38.193134698 +0000 UTC m=+5.130183984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gppd9" (UniqueName: "kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9") pod "network-check-target-vvqzr" (UID: "bbc937b9-bc6f-4147-9064-2bbbabf3a601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:36.530938 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.530868    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 22:56:35 +0000 UTC" deadline="2028-03-15 11:14:58.674672804 +0000 UTC"
Jul 02 23:01:36.530938 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.530903    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14916h13m22.143774369s"
Jul 02 23:01:36.616042 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.615091    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:36.616042 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.615238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:36.616042 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.615333    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:36.616042 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.615425    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:36.616042 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:36.615491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:36.616042 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:36.615564    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:38.106632 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:38.106588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:38.107093 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.106785    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:38.107093 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.106848    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs podName:2fe605be-a403-46ec-8e29-89278da41672 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:42.106828347 +0000 UTC m=+9.043877642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs") pod "network-metrics-daemon-vx6gc" (UID: "2fe605be-a403-46ec-8e29-89278da41672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:38.207834 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:38.207196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:38.207834 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:38.207250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:38.207834 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.207373    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:38.207834 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.207436    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret podName:94d267d5-49fe-42da-a581-f2e74ea9c18b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:42.207416899 +0000 UTC m=+9.144466214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret") pod "global-pull-secret-syncer-79qqj" (UID: "94d267d5-49fe-42da-a581-f2e74ea9c18b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:38.208178 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.207844    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:01:38.208178 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.207867    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:01:38.208178 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.207879    2575 projected.go:196] Error preparing data for projected volume kube-api-access-gppd9 for pod openshift-network-diagnostics/network-check-target-vvqzr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:38.208178 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.207928    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9 podName:bbc937b9-bc6f-4147-9064-2bbbabf3a601 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:42.207912992 +0000 UTC m=+9.144962286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gppd9" (UniqueName: "kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9") pod "network-check-target-vvqzr" (UID: "bbc937b9-bc6f-4147-9064-2bbbabf3a601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:38.616361 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:38.615301    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:38.616361 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.615438    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:38.616361 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:38.615886    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:38.616361 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.616093    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:38.616361 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:38.616180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:38.616361 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:38.616305    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:40.615614 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:40.615579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:40.616138 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:40.615731    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:40.616198 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:40.616140    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:40.616264 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:40.616242    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:40.616313 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:40.616294    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:40.616416 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:40.616397    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:42.138272 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:42.138216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:42.138728 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.138353    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:42.138728 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.138445    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs podName:2fe605be-a403-46ec-8e29-89278da41672 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:50.138423605 +0000 UTC m=+17.075472908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs") pod "network-metrics-daemon-vx6gc" (UID: "2fe605be-a403-46ec-8e29-89278da41672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:42.238749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:42.238786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.238880    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.238925    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret podName:94d267d5-49fe-42da-a581-f2e74ea9c18b nodeName:}" failed. No retries permitted until 2026-07-02 23:01:50.238908661 +0000 UTC m=+17.175957947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret") pod "global-pull-secret-syncer-79qqj" (UID: "94d267d5-49fe-42da-a581-f2e74ea9c18b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.239275    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.239295    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.239307    2575 projected.go:196] Error preparing data for projected volume kube-api-access-gppd9 for pod openshift-network-diagnostics/network-check-target-vvqzr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:42.239385 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.239359    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9 podName:bbc937b9-bc6f-4147-9064-2bbbabf3a601 nodeName:}" failed. No retries permitted until 2026-07-02 23:01:50.239341521 +0000 UTC m=+17.176390808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gppd9" (UniqueName: "kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9") pod "network-check-target-vvqzr" (UID: "bbc937b9-bc6f-4147-9064-2bbbabf3a601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:42.615527 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:42.615369    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:42.615527 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:42.615399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:42.615527 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:42.615417    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:42.615527 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.615510    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:42.615930 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.615601    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:42.615930 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:42.615684    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:44.615897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:44.615687    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:44.615897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:44.615717    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:44.615897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:44.615788    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:44.615897 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:44.615797    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:44.616603 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:44.615908    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:44.616603 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:44.615985    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:46.615033 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:46.614999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:46.615494 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:46.615030    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:46.615494 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:46.614999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:46.615494 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:46.615156    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:46.615494 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:46.615234    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:46.615494 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:46.615360    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:48.615215 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:48.615173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:48.615215 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:48.615212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:48.615686 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:48.615176    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:48.615686 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:48.615291    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:48.615686 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:48.615367    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:48.615686 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:48.615435    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:50.201911 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:50.201865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:50.202389 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.202014    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:50.202389 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.202104    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs podName:2fe605be-a403-46ec-8e29-89278da41672 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:06.202087672 +0000 UTC m=+33.139136962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs") pod "network-metrics-daemon-vx6gc" (UID: "2fe605be-a403-46ec-8e29-89278da41672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:01:50.302897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:50.302865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:50.303093 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:50.302910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:50.303093 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.303025    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:50.303093 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.303029    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:01:50.303093 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.303069    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:01:50.303093 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.303081    2575 projected.go:196] Error preparing data for projected volume kube-api-access-gppd9 for pod openshift-network-diagnostics/network-check-target-vvqzr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:50.303302 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.303103    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret podName:94d267d5-49fe-42da-a581-f2e74ea9c18b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:06.30308609 +0000 UTC m=+33.240135392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret") pod "global-pull-secret-syncer-79qqj" (UID: "94d267d5-49fe-42da-a581-f2e74ea9c18b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:01:50.303302 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.303121    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9 podName:bbc937b9-bc6f-4147-9064-2bbbabf3a601 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:06.303112913 +0000 UTC m=+33.240162199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gppd9" (UniqueName: "kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9") pod "network-check-target-vvqzr" (UID: "bbc937b9-bc6f-4147-9064-2bbbabf3a601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:01:50.615674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:50.615634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:50.615674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:50.615666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:50.615907 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:50.615635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:50.615907 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.615765    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:50.615907 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.615894    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:50.616031 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:50.615971    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:52.615798 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:52.615732    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:52.615798 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:52.615756    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:52.616210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:52.615836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:52.616210 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:52.615844    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:52.616210 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:52.615902    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:52.616210 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:52.615987    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:54.615771 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:54.615738    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:54.616235 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:54.615738    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:54.616235 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:54.615848    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:54.616235 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:54.615887    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:54.616235 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:54.615937    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:54.616235 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:54.616013    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:55.718388 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:55.718192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b94x2" event={"ID":"7af76860-5555-496b-b14d-8c2e9882acfd","Type":"ContainerStarted","Data":"48f32ead254aa68dea68f3f96857a9264ddc4e120fab802c16690e5a329c6406"}
Jul 02 23:01:55.720208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:55.720179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"2d52d02ce8f41234169021446bddcb9d4b6c6e050daaa2d9bc16e439c4cc2e80"}
Jul 02 23:01:55.720334 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:55.720262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"84a8c9b1ad8ea4a50432ec43fc61500e835926fe90f564cbe149bd768dfb2f92"}
Jul 02 23:01:55.730874 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:55.730844    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" event={"ID":"4171bb48f6e62864b15f6dcc9fa0fe2a","Type":"ContainerStarted","Data":"7d0f0dc18617ea8506c1dff7732848fc3be7b9c2ee72a75c730cfcd1a60efee8"}
Jul 02 23:01:55.737321 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:55.737248    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b94x2" podStartSLOduration=1.252363263 podStartE2EDuration="21.737231592s" totalImagesPullingTime="20.484868329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:55.737112905 +0000 UTC m=+22.674162214" watchObservedRunningTime="2026-07-02 23:01:55.737231592 +0000 UTC m=+22.674280900"
Jul 02 23:01:55.750540 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:55.750504    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-239.ec2.internal" podStartSLOduration=20.750495519 podStartE2EDuration="20.750495519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:55.750140789 +0000 UTC m=+22.687190095" watchObservedRunningTime="2026-07-02 23:01:55.750495519 +0000 UTC m=+22.687544825"
Jul 02 23:01:56.615779 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.615555    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:56.615879 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.615604    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:56.615879 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:56.615795    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:56.615879 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.615607    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:56.615879 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:56.615866    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:56.616128 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:56.615931    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:56.733823 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.733796    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3609761-4f85-439e-8e39-7dc1faf96080" containerID="23b4f8d1565d62daaf88d291511028a82c6e02ae5bcbf1e8415c00ab71b3c537" exitCode=0
Jul 02 23:01:56.734541 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.733887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerDied","Data":"23b4f8d1565d62daaf88d291511028a82c6e02ae5bcbf1e8415c00ab71b3c537"}
Jul 02 23:01:56.735512 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.735491    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sz7lt" event={"ID":"fd28ad52-cc89-42b1-9d5f-211dc3061bd1","Type":"ContainerStarted","Data":"f951aa1b0cfaf84846b5ec9b4fdd5cd5d55c59dbf8542f40094a95a0aea63ca7"}
Jul 02 23:01:56.737089 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.737044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-97v55" event={"ID":"31ff9cf6-df23-4a47-9244-cbd109c8dccc","Type":"ContainerStarted","Data":"11502bac44b58febed513bd51c4287b8fee607647816c89ecd4e477f261dca03"}
Jul 02 23:01:56.741718 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.741687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r" event={"ID":"334e493e-188e-4f56-bb02-541877b376f2","Type":"ContainerStarted","Data":"45706481db52d9066089a2a50dcd2285436cb52f7265b0d7d6a2b146cd9a4bed"}
Jul 02 23:01:56.744336 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.744319    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:01:56.744654 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.744638    2575 generic.go:356] "Generic (PLEG): container finished" podID="328eb2bc-7a95-4e95-a06f-bce9fe8630fc" containerID="2d52d02ce8f41234169021446bddcb9d4b6c6e050daaa2d9bc16e439c4cc2e80" exitCode=1
Jul 02 23:01:56.744716 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.744701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerDied","Data":"2d52d02ce8f41234169021446bddcb9d4b6c6e050daaa2d9bc16e439c4cc2e80"}
Jul 02 23:01:56.744767 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.744754    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"af8514931afba7e2a8726182c099fa8e3986706260b7ba8f862052518858d857"}
Jul 02 23:01:56.744807 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.744798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"763f793bff82b683e679b55d3bc60b5e6ab0570476c4d5cfca1082d32df67ea3"}
Jul 02 23:01:56.744849 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.744837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"945f4d016cc02b78dca037b8ab03dc4a7767983aed7dbf19c5b4cf2381fc1041"}
Jul 02 23:01:56.744897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.744883    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"28a8765317b1673536f735a82b172096ad419e54ba433fcbbd507866cb4fc7e2"}
Jul 02 23:01:56.746133 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.746094    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxmqs" event={"ID":"7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf","Type":"ContainerStarted","Data":"1be68ab34151031e01176145cbd195b3408e6c7aed4475bcbf8821fa7595ac4a"}
Jul 02 23:01:56.747490 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.747469    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b613f510a320d3ccc3ec79b1f26f861" containerID="334f7853e9b678610069771c818b61cd96c86a31cde242d623075d0ba869562b" exitCode=0
Jul 02 23:01:56.747586 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.747551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" event={"ID":"5b613f510a320d3ccc3ec79b1f26f861","Type":"ContainerDied","Data":"334f7853e9b678610069771c818b61cd96c86a31cde242d623075d0ba869562b"}
Jul 02 23:01:56.748910 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.748890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2xwww" event={"ID":"32405914-3a78-48e6-bbcc-04c37c5afecd","Type":"ContainerStarted","Data":"8c85cb12de95408b01a419d234aa3f86e73db70abfffdddcd5e21864101cc08a"}
Jul 02 23:01:56.750339 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.750318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6mrv" event={"ID":"4b0d4b43-4df7-41f4-87aa-706c96829d6b","Type":"ContainerStarted","Data":"636bef5c95d67cfb0ebab00c53f62c20a8a6c35dfd8915fedd173e8200e58626"}
Jul 02 23:01:56.786845 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.786802    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2xwww" podStartSLOduration=2.297930594 podStartE2EDuration="22.786785863s" totalImagesPullingTime="20.488855269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:56.771836161 +0000 UTC m=+23.708885469" watchObservedRunningTime="2026-07-02 23:01:56.786785863 +0000 UTC m=+23.723835174"
Jul 02 23:01:56.787135 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.787105    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sz7lt" podStartSLOduration=2.303649865 podStartE2EDuration="22.787096122s" totalImagesPullingTime="20.483446257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:56.78634966 +0000 UTC m=+23.723398966" watchObservedRunningTime="2026-07-02 23:01:56.787096122 +0000 UTC m=+23.724145431"
Jul 02 23:01:56.799690 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.799649    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vxmqs" podStartSLOduration=2.397066682 podStartE2EDuration="22.799634917s" totalImagesPullingTime="20.402568235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:56.799291367 +0000 UTC m=+23.736340679" watchObservedRunningTime="2026-07-02 23:01:56.799634917 +0000 UTC m=+23.736684226"
Jul 02 23:01:56.812787 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.812753    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-97v55" podStartSLOduration=2.698787809 podStartE2EDuration="22.812740299s" totalImagesPullingTime="20.11395249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:56.812660732 +0000 UTC m=+23.749710041" watchObservedRunningTime="2026-07-02 23:01:56.812740299 +0000 UTC m=+23.749789609"
Jul 02 23:01:56.829108 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:56.829075    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j6mrv" podStartSLOduration=1.993018894 podStartE2EDuration="22.829065233s" totalImagesPullingTime="20.836046339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:56.828647646 +0000 UTC m=+23.765696964" watchObservedRunningTime="2026-07-02 23:01:56.829065233 +0000 UTC m=+23.766114532"
Jul 02 23:01:57.754724 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:57.754691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" event={"ID":"5b613f510a320d3ccc3ec79b1f26f861","Type":"ContainerStarted","Data":"96eb7ea4be95a699edbddf5030c7605ed9a0f7a5345cdb3e57f3ebc50fadd129"}
Jul 02 23:01:57.768031 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:57.768002    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 23:01:57.770536 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:57.770495    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-239.ec2.internal" podStartSLOduration=22.770481512 podStartE2EDuration="22.770481512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:57.770257997 +0000 UTC m=+24.707307296" watchObservedRunningTime="2026-07-02 23:01:57.770481512 +0000 UTC m=+24.707530819"
Jul 02 23:01:58.579989 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.579453    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:01:57.76801921Z","UUID":"3c2a4e33-b9e0-4632-8d02-8df34b92e0c3","Handler":null,"Name":"","Endpoint":""}
Jul 02 23:01:58.580994 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.580973    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 23:01:58.581126 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.581018    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 23:01:58.615158 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.615124    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:01:58.615304 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.615126    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:01:58.615304 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:58.615240    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:01:58.615420 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:58.615321    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:01:58.615420 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.615128    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:01:58.615589 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:01:58.615417    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:01:58.761991 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.761958    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r" event={"ID":"334e493e-188e-4f56-bb02-541877b376f2","Type":"ContainerStarted","Data":"a34b2de174c64388cdb558695f05450950cc1b54c46c589d44eed6d24cce9bdf"}
Jul 02 23:01:58.765326 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.765304    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:01:58.765739 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:58.765714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"c108058845f0831abff2f57c3f09e88ae51a600556b246e467924d06691201d6"}
Jul 02 23:01:59.770096 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:59.769874    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r" event={"ID":"334e493e-188e-4f56-bb02-541877b376f2","Type":"ContainerStarted","Data":"b7073fa752a1a024f1b7555e574890fada1cf987d96cb3c4df07cc23c60f88e4"}
Jul 02 23:01:59.788890 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:01:59.788842    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pwr4r" podStartSLOduration=3.0245986990000002 podStartE2EDuration="25.788822761s" totalImagesPullingTime="22.764224062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:01:59.787944352 +0000 UTC m=+26.724993659" watchObservedRunningTime="2026-07-02 23:01:59.788822761 +0000 UTC m=+26.725872073"
Jul 02 23:02:00.004202 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:00.004169    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:02:00.004747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:00.004726    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:02:00.615213 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:00.615186    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:00.615213 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:00.615213    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:00.615454 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:00.615194    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:00.615454 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:00.615298    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:02:00.615454 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:00.615365    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:02:00.615569 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:00.615462    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:02:00.772266 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:00.772233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:02:00.772763 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:00.772745    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sz7lt"
Jul 02 23:02:01.777088 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.776917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:02:01.777688 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.777429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"da4bd8d0ab4fd512e7a74676b93f96951f6fde84880dc4c623b37f922cd22513"}
Jul 02 23:02:01.777749 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.777715    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:02:01.777798 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.777775    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:02:01.777850 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.777815    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:02:01.777939 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.777922    2575 scope.go:117] "RemoveContainer" containerID="2d52d02ce8f41234169021446bddcb9d4b6c6e050daaa2d9bc16e439c4cc2e80"
Jul 02 23:02:01.779492 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.779457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerStarted","Data":"f40c9c8a1e27824d023003e15ac4c8f1721444299760be3ed95eaf3980b704bd"}
Jul 02 23:02:01.799507 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.799483    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:02:01.799616 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:01.799603    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:02:02.615208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.615155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:02.615208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.615197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:02.615208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.615200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:02.615519 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:02.615310    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:02:02.615519 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:02.615351    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:02:02.615519 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:02.615430    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:02:02.785839 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.785816    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:02:02.786379 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.786180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" event={"ID":"328eb2bc-7a95-4e95-a06f-bce9fe8630fc","Type":"ContainerStarted","Data":"76d3283b9980a0c28a8fb7dfc0e6b38b1487410bb08d9006cbe4912f9630bdf5"}
Jul 02 23:02:02.788070 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.788032    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3609761-4f85-439e-8e39-7dc1faf96080" containerID="f40c9c8a1e27824d023003e15ac4c8f1721444299760be3ed95eaf3980b704bd" exitCode=0
Jul 02 23:02:02.788175 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.788111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerDied","Data":"f40c9c8a1e27824d023003e15ac4c8f1721444299760be3ed95eaf3980b704bd"}
Jul 02 23:02:02.812767 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:02.812731    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l" podStartSLOduration=8.433747161 podStartE2EDuration="28.812719256s" totalImagesPullingTime="20.378972095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:02.812436839 +0000 UTC m=+29.749486146" watchObservedRunningTime="2026-07-02 23:02:02.812719256 +0000 UTC m=+29.749768563"
Jul 02 23:02:03.586374 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.586348    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvqzr"]
Jul 02 23:02:03.586481 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.586451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:03.586586 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:03.586561    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:02:03.587107 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.587090    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-79qqj"]
Jul 02 23:02:03.587170 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.587160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:03.587251 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:03.587236    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:02:03.589799 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.589586    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vx6gc"]
Jul 02 23:02:03.592677 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.591973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:03.592677 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:03.592163    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:02:03.792375 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.792192    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3609761-4f85-439e-8e39-7dc1faf96080" containerID="2019efc1b08dbd9ca5bd5046d879470108b442fe56c93130a42f185712649633" exitCode=0
Jul 02 23:02:03.792721 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:03.792281    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerDied","Data":"2019efc1b08dbd9ca5bd5046d879470108b442fe56c93130a42f185712649633"}
Jul 02 23:02:05.615375 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:05.615349    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:05.616020 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:05.615351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:05.616020 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:05.615668    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:05.616020 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:05.615671    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:02:05.616020 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:05.615793    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:02:05.616020 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:05.615906    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:02:05.798186 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:05.798162    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3609761-4f85-439e-8e39-7dc1faf96080" containerID="b5090360f818d7ba47b2dbd66f79e1e866d2d0ca3e9c3b6a71891fe26fe808c9" exitCode=0
Jul 02 23:02:05.798294 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:05.798200    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerDied","Data":"b5090360f818d7ba47b2dbd66f79e1e866d2d0ca3e9c3b6a71891fe26fe808c9"}
Jul 02 23:02:06.227244 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:06.227190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:06.227349 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.227287    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:02:06.227349 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.227342    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs podName:2fe605be-a403-46ec-8e29-89278da41672 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:38.227325657 +0000 UTC m=+65.164374949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs") pod "network-metrics-daemon-vx6gc" (UID: "2fe605be-a403-46ec-8e29-89278da41672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:02:06.328318 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:06.328297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:06.328428 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:06.328335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:06.328499 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.328434    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:02:06.328499 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.328441    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:02:06.328499 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.328463    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:02:06.328499 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.328473    2575 projected.go:196] Error preparing data for projected volume kube-api-access-gppd9 for pod openshift-network-diagnostics/network-check-target-vvqzr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:02:06.328499 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.328487    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret podName:94d267d5-49fe-42da-a581-f2e74ea9c18b nodeName:}" failed. No retries permitted until 2026-07-02 23:02:38.328471112 +0000 UTC m=+65.265520398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret") pod "global-pull-secret-syncer-79qqj" (UID: "94d267d5-49fe-42da-a581-f2e74ea9c18b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:02:06.328742 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:06.328507    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9 podName:bbc937b9-bc6f-4147-9064-2bbbabf3a601 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:38.328496362 +0000 UTC m=+65.265545648 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gppd9" (UniqueName: "kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9") pod "network-check-target-vvqzr" (UID: "bbc937b9-bc6f-4147-9064-2bbbabf3a601") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:02:07.615277 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:07.615000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:07.615277 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:07.615126    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79qqj" podUID="94d267d5-49fe-42da-a581-f2e74ea9c18b"
Jul 02 23:02:07.615277 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:07.615160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:07.615277 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:07.615278    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvqzr" podUID="bbc937b9-bc6f-4147-9064-2bbbabf3a601"
Jul 02 23:02:07.615844 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:07.615310    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:07.615844 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:07.615397    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vx6gc" podUID="2fe605be-a403-46ec-8e29-89278da41672"
Jul 02 23:02:08.294199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.294174    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-239.ec2.internal" event="NodeReady"
Jul 02 23:02:08.294347 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.294303    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 23:02:08.339752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.339688    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ncm48"]
Jul 02 23:02:08.342290 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.342268    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.344540 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.344511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6szd7\""
Jul 02 23:02:08.345149 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.344978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 23:02:08.345149 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.344979    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 23:02:08.345836 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.345811    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sbrzn"]
Jul 02 23:02:08.347430 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.347411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:08.349786 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.349478    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 23:02:08.349786 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.349507    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 23:02:08.349786 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.349670    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 23:02:08.349989 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.349971    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qbct9\""
Jul 02 23:02:08.356314 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.356274    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ncm48"]
Jul 02 23:02:08.362168 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.362149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbrzn"]
Jul 02 23:02:08.444607 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.444582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92vhf\" (UniqueName: \"kubernetes.io/projected/9197928e-2c0c-4048-899e-42458ba4f15f-kube-api-access-92vhf\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.444752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.444670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af9820d9-4a63-4154-be88-d7e6b0b8f97e-cert\") pod \"ingress-canary-sbrzn\" (UID: \"af9820d9-4a63-4154-be88-d7e6b0b8f97e\") " pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:08.444752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.444703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlj2w\" (UniqueName: \"kubernetes.io/projected/af9820d9-4a63-4154-be88-d7e6b0b8f97e-kube-api-access-xlj2w\") pod \"ingress-canary-sbrzn\" (UID: \"af9820d9-4a63-4154-be88-d7e6b0b8f97e\") " pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:08.444752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.444741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9197928e-2c0c-4048-899e-42458ba4f15f-config-volume\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.444877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.444763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9197928e-2c0c-4048-899e-42458ba4f15f-tmp-dir\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.444877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.444847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.545914 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.545889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.546045 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.545947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92vhf\" (UniqueName: \"kubernetes.io/projected/9197928e-2c0c-4048-899e-42458ba4f15f-kube-api-access-92vhf\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.546045 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.545981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af9820d9-4a63-4154-be88-d7e6b0b8f97e-cert\") pod \"ingress-canary-sbrzn\" (UID: \"af9820d9-4a63-4154-be88-d7e6b0b8f97e\") " pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:08.546045 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.546004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj2w\" (UniqueName: \"kubernetes.io/projected/af9820d9-4a63-4154-be88-d7e6b0b8f97e-kube-api-access-xlj2w\") pod \"ingress-canary-sbrzn\" (UID: \"af9820d9-4a63-4154-be88-d7e6b0b8f97e\") " pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:08.546219 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.546040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9197928e-2c0c-4048-899e-42458ba4f15f-config-volume\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.546219 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:08.546065    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:02:08.546219 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.546081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9197928e-2c0c-4048-899e-42458ba4f15f-tmp-dir\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.546219 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:08.546130    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls podName:9197928e-2c0c-4048-899e-42458ba4f15f nodeName:}" failed. No retries permitted until 2026-07-02 23:02:09.046109207 +0000 UTC m=+35.983158496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls") pod "dns-default-ncm48" (UID: "9197928e-2c0c-4048-899e-42458ba4f15f") : secret "dns-default-metrics-tls" not found
Jul 02 23:02:08.546436 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.546418    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9197928e-2c0c-4048-899e-42458ba4f15f-tmp-dir\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.546777 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.546752    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9197928e-2c0c-4048-899e-42458ba4f15f-config-volume\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.550527 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.550506    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af9820d9-4a63-4154-be88-d7e6b0b8f97e-cert\") pod \"ingress-canary-sbrzn\" (UID: \"af9820d9-4a63-4154-be88-d7e6b0b8f97e\") " pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:08.554606 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.554564    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlj2w\" (UniqueName: \"kubernetes.io/projected/af9820d9-4a63-4154-be88-d7e6b0b8f97e-kube-api-access-xlj2w\") pod \"ingress-canary-sbrzn\" (UID: \"af9820d9-4a63-4154-be88-d7e6b0b8f97e\") " pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:08.554738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.554712    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92vhf\" (UniqueName: \"kubernetes.io/projected/9197928e-2c0c-4048-899e-42458ba4f15f-kube-api-access-92vhf\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:08.664507 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:08.664443    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbrzn"
Jul 02 23:02:09.051339 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.051135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:09.051513 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:09.051312    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:02:09.051513 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:09.051473    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls podName:9197928e-2c0c-4048-899e-42458ba4f15f nodeName:}" failed. No retries permitted until 2026-07-02 23:02:10.05145155 +0000 UTC m=+36.988500839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls") pod "dns-default-ncm48" (UID: "9197928e-2c0c-4048-899e-42458ba4f15f") : secret "dns-default-metrics-tls" not found
Jul 02 23:02:09.463743 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.463641    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hbkrr"]
Jul 02 23:02:09.465914 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.465894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.468208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.468184    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 23:02:09.468692 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.468674    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 23:02:09.468802 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.468769    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 23:02:09.469248 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.469226    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 23:02:09.469553 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.469529    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jp64q\""
Jul 02 23:02:09.479854 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.479835    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hbkrr"]
Jul 02 23:02:09.556310 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.556280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6wqc\" (UniqueName: \"kubernetes.io/projected/60464393-f98e-4d2d-8456-69abcde0af08-kube-api-access-h6wqc\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.556446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.556324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/60464393-f98e-4d2d-8456-69abcde0af08-data-volume\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.556446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.556346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/60464393-f98e-4d2d-8456-69abcde0af08-crio-socket\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.556446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.556386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.556588 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.556444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.615704 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.615679    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:09.615831 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.615679    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:09.615885 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.615839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:09.618434 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.618412    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:02:09.618537 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.618433    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llzj2\""
Jul 02 23:02:09.618537 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.618412    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:02:09.618537 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.618465    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:02:09.618758 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.618741    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:02:09.618838 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.618794    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9lfbh\""
Jul 02 23:02:09.657106 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.657083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6wqc\" (UniqueName: \"kubernetes.io/projected/60464393-f98e-4d2d-8456-69abcde0af08-kube-api-access-h6wqc\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.657210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.657131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/60464393-f98e-4d2d-8456-69abcde0af08-data-volume\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.657210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.657162    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/60464393-f98e-4d2d-8456-69abcde0af08-crio-socket\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.657210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.657187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.657374 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.657231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.657374 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:09.657351    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:09.657374 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:09.657360    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:02:09.657503 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:09.657416    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm podName:60464393-f98e-4d2d-8456-69abcde0af08 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:10.157399207 +0000 UTC m=+37.094448511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbkrr" (UID: "60464393-f98e-4d2d-8456-69abcde0af08") : configmap "kube-rbac-proxy" not found
Jul 02 23:02:09.657503 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.657420    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/60464393-f98e-4d2d-8456-69abcde0af08-crio-socket\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.657503 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.657433    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/60464393-f98e-4d2d-8456-69abcde0af08-data-volume\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.657503 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:09.657432    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls podName:60464393-f98e-4d2d-8456-69abcde0af08 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:10.157424177 +0000 UTC m=+37.094473467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbkrr" (UID: "60464393-f98e-4d2d-8456-69abcde0af08") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:09.665713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.665695    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6wqc\" (UniqueName: \"kubernetes.io/projected/60464393-f98e-4d2d-8456-69abcde0af08-kube-api-access-h6wqc\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:09.853830 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:09.853804    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbrzn"]
Jul 02 23:02:09.857785 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:09.857749    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9820d9_4a63_4154_be88_d7e6b0b8f97e.slice/crio-e84c0a2fb33c5f5f3353036596e6ae34c9a25035081f8fb85d5f0732dad341ae WatchSource:0}: Error finding container e84c0a2fb33c5f5f3353036596e6ae34c9a25035081f8fb85d5f0732dad341ae: Status 404 returned error can't find the container with id e84c0a2fb33c5f5f3353036596e6ae34c9a25035081f8fb85d5f0732dad341ae
Jul 02 23:02:10.060452 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.060421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:10.060554 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:10.060541    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:02:10.060601 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:10.060593    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls podName:9197928e-2c0c-4048-899e-42458ba4f15f nodeName:}" failed. No retries permitted until 2026-07-02 23:02:12.060580838 +0000 UTC m=+38.997630124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls") pod "dns-default-ncm48" (UID: "9197928e-2c0c-4048-899e-42458ba4f15f") : secret "dns-default-metrics-tls" not found
Jul 02 23:02:10.161667 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.161640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:10.161742 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.161679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:10.161786 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:10.161778    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:02:10.161815 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:10.161781    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:10.161847 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:10.161822    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm podName:60464393-f98e-4d2d-8456-69abcde0af08 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:11.161810497 +0000 UTC m=+38.098859782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbkrr" (UID: "60464393-f98e-4d2d-8456-69abcde0af08") : configmap "kube-rbac-proxy" not found
Jul 02 23:02:10.161847 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:10.161833    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls podName:60464393-f98e-4d2d-8456-69abcde0af08 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:11.161827885 +0000 UTC m=+38.098877170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbkrr" (UID: "60464393-f98e-4d2d-8456-69abcde0af08") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:10.737931 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.737902    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"]
Jul 02 23:02:10.741456 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.741323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"
Jul 02 23:02:10.745352 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.745328    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 23:02:10.745502 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.745482    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 23:02:10.745574 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.745552    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5g49l\""
Jul 02 23:02:10.765435 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.765413    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"]
Jul 02 23:02:10.812895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.812865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbrzn" event={"ID":"af9820d9-4a63-4154-be88-d7e6b0b8f97e","Type":"ContainerStarted","Data":"e84c0a2fb33c5f5f3353036596e6ae34c9a25035081f8fb85d5f0732dad341ae"}
Jul 02 23:02:10.815892 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.815864    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3609761-4f85-439e-8e39-7dc1faf96080" containerID="1918f71e17d6504d43ed15e71c75377955fdaf2655ff6a8cbb41b2fed425b673" exitCode=0
Jul 02 23:02:10.815983 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.815907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerDied","Data":"1918f71e17d6504d43ed15e71c75377955fdaf2655ff6a8cbb41b2fed425b673"}
Jul 02 23:02:10.867109 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.867081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qbsj\" (UniqueName: \"kubernetes.io/projected/464e7b60-b431-4fd2-924d-a7dd5f932226-kube-api-access-6qbsj\") pod \"migrator-d57d58cc9-dtrx7\" (UID: \"464e7b60-b431-4fd2-924d-a7dd5f932226\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"
Jul 02 23:02:10.968124 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.967873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qbsj\" (UniqueName: \"kubernetes.io/projected/464e7b60-b431-4fd2-924d-a7dd5f932226-kube-api-access-6qbsj\") pod \"migrator-d57d58cc9-dtrx7\" (UID: \"464e7b60-b431-4fd2-924d-a7dd5f932226\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"
Jul 02 23:02:10.977290 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:10.977259    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qbsj\" (UniqueName: \"kubernetes.io/projected/464e7b60-b431-4fd2-924d-a7dd5f932226-kube-api-access-6qbsj\") pod \"migrator-d57d58cc9-dtrx7\" (UID: \"464e7b60-b431-4fd2-924d-a7dd5f932226\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"
Jul 02 23:02:11.052200 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.052173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"
Jul 02 23:02:11.169755 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.169727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:11.169903 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.169783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:11.169903 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:11.169873    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:11.169985 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:11.169939    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls podName:60464393-f98e-4d2d-8456-69abcde0af08 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:13.169921793 +0000 UTC m=+40.106971079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbkrr" (UID: "60464393-f98e-4d2d-8456-69abcde0af08") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:11.170386 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.170362    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60464393-f98e-4d2d-8456-69abcde0af08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:11.174259 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.174177    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7"]
Jul 02 23:02:11.268428 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.268403    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2xwww_32405914-3a78-48e6-bbcc-04c37c5afecd/dns-node-resolver/0.log"
Jul 02 23:02:11.821688 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.821656    2575 generic.go:356] "Generic (PLEG): container finished" podID="e3609761-4f85-439e-8e39-7dc1faf96080" containerID="4bc1b0548f188e7ff7d7c580538ddec974d178b822364506461beaa186f28e00" exitCode=0
Jul 02 23:02:11.822437 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:11.821702    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerDied","Data":"4bc1b0548f188e7ff7d7c580538ddec974d178b822364506461beaa186f28e00"}
Jul 02 23:02:11.896859 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:11.896831    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464e7b60_b431_4fd2_924d_a7dd5f932226.slice/crio-394b30dceba65a188950452d9b170661374240a582c58838ef80c672cd873a2b WatchSource:0}: Error finding container 394b30dceba65a188950452d9b170661374240a582c58838ef80c672cd873a2b: Status 404 returned error can't find the container with id 394b30dceba65a188950452d9b170661374240a582c58838ef80c672cd873a2b
Jul 02 23:02:12.075821 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.075773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:12.075914 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:12.075898    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:02:12.075965 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:12.075953    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls podName:9197928e-2c0c-4048-899e-42458ba4f15f nodeName:}" failed. No retries permitted until 2026-07-02 23:02:16.075936085 +0000 UTC m=+43.012985392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls") pod "dns-default-ncm48" (UID: "9197928e-2c0c-4048-899e-42458ba4f15f") : secret "dns-default-metrics-tls" not found
Jul 02 23:02:12.120398 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.120373    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-2fgvg"]
Jul 02 23:02:12.144963 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.144946    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-2fgvg"]
Jul 02 23:02:12.145032 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.145020    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.147575 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.147555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 02 23:02:12.147722 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.147708    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 02 23:02:12.147897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.147881    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 02 23:02:12.147967 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.147886    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hblmf\""
Jul 02 23:02:12.147967 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.147955    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 02 23:02:12.277679 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.277663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q84f8\" (UniqueName: \"kubernetes.io/projected/c6a34107-c238-49c6-ad85-a511baafe2fb-kube-api-access-q84f8\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.277760 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.277715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6a34107-c238-49c6-ad85-a511baafe2fb-signing-key\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.277803 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.277766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6a34107-c238-49c6-ad85-a511baafe2fb-signing-cabundle\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.378105 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.378080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6a34107-c238-49c6-ad85-a511baafe2fb-signing-cabundle\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.378242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.378226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q84f8\" (UniqueName: \"kubernetes.io/projected/c6a34107-c238-49c6-ad85-a511baafe2fb-kube-api-access-q84f8\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.378314 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.378299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6a34107-c238-49c6-ad85-a511baafe2fb-signing-key\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.378767 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.378662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6a34107-c238-49c6-ad85-a511baafe2fb-signing-cabundle\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.380667 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.380647    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6a34107-c238-49c6-ad85-a511baafe2fb-signing-key\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.387288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.387267    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q84f8\" (UniqueName: \"kubernetes.io/projected/c6a34107-c238-49c6-ad85-a511baafe2fb-kube-api-access-q84f8\") pod \"service-ca-758f599c5-2fgvg\" (UID: \"c6a34107-c238-49c6-ad85-a511baafe2fb\") " pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.453633 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.453608    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-2fgvg"
Jul 02 23:02:12.628411 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.628344    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-2fgvg"]
Jul 02 23:02:12.668421 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.668371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vxmqs_7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf/node-ca/0.log"
Jul 02 23:02:12.827953 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.827919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" event={"ID":"e3609761-4f85-439e-8e39-7dc1faf96080","Type":"ContainerStarted","Data":"c01e43ebeee5df8c9a66b80986e1d668f006537c0915996c5fbc72aa3f0622aa"}
Jul 02 23:02:12.829662 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.829639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbrzn" event={"ID":"af9820d9-4a63-4154-be88-d7e6b0b8f97e","Type":"ContainerStarted","Data":"3f0ade4e56aaadf8f4250fe14f53daa9e5c219b1facb0c23e70623b9a9284c4a"}
Jul 02 23:02:12.830927 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.830895    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-2fgvg" event={"ID":"c6a34107-c238-49c6-ad85-a511baafe2fb","Type":"ContainerStarted","Data":"93ccc4344a441a8f22f88d0e6f81bf8d27a8b9e243eb9380a195819fae6027b1"}
Jul 02 23:02:12.832173 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.832146    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7" event={"ID":"464e7b60-b431-4fd2-924d-a7dd5f932226","Type":"ContainerStarted","Data":"394b30dceba65a188950452d9b170661374240a582c58838ef80c672cd873a2b"}
Jul 02 23:02:12.852470 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.852424    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m4hjr" podStartSLOduration=8.084711852 podStartE2EDuration="38.852408315s" totalImagesPullingTime="30.767696463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:12.851471301 +0000 UTC m=+39.788520610" watchObservedRunningTime="2026-07-02 23:02:12.852408315 +0000 UTC m=+39.789457625"
Jul 02 23:02:12.868678 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:12.868638    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sbrzn" podStartSLOduration=2.476752911 podStartE2EDuration="4.868626169s" totalImagesPullingTime="2.391873258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:12.868016097 +0000 UTC m=+39.805065402" watchObservedRunningTime="2026-07-02 23:02:12.868626169 +0000 UTC m=+39.805675476"
Jul 02 23:02:13.184905 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:13.184872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:13.185042 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:13.184976    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:13.185042 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:13.185026    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls podName:60464393-f98e-4d2d-8456-69abcde0af08 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:17.185012795 +0000 UTC m=+44.122062080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbkrr" (UID: "60464393-f98e-4d2d-8456-69abcde0af08") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:13.469778 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:13.469749    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbrzn_af9820d9-4a63-4154-be88-d7e6b0b8f97e/serve-healthcheck-canary/0.log"
Jul 02 23:02:13.837028 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:13.836818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7" event={"ID":"464e7b60-b431-4fd2-924d-a7dd5f932226","Type":"ContainerStarted","Data":"b42085288060a05053b4aabc899fd8e46480c9c9cdece9fd7898898bd536553a"}
Jul 02 23:02:13.837437 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:13.837175    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7" event={"ID":"464e7b60-b431-4fd2-924d-a7dd5f932226","Type":"ContainerStarted","Data":"5b603eb8dfc5a435947988b69e9975c6750280c8ec5e86b83c76d0593615183c"}
Jul 02 23:02:13.853896 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:13.853854    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dtrx7" podStartSLOduration=2.164212647 podStartE2EDuration="3.853841419s" totalImagesPullingTime="1.689628772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:13.853042248 +0000 UTC m=+40.790091558" watchObservedRunningTime="2026-07-02 23:02:13.853841419 +0000 UTC m=+40.790890725"
Jul 02 23:02:15.843615 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:15.843575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-2fgvg" event={"ID":"c6a34107-c238-49c6-ad85-a511baafe2fb","Type":"ContainerStarted","Data":"a9ff5549fd8a7708f56a8bf4bea2375d900e4d22fd14dbf818f1f8960cd113d2"}
Jul 02 23:02:15.859045 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:15.859004    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-2fgvg" podStartSLOduration=0.866109578 podStartE2EDuration="3.858989349s" totalImagesPullingTime="2.992879771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:15.858213354 +0000 UTC m=+42.795262663" watchObservedRunningTime="2026-07-02 23:02:15.858989349 +0000 UTC m=+42.796038656"
Jul 02 23:02:16.102747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:16.102726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:16.102880 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:16.102859    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:02:16.102981 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:16.102921    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls podName:9197928e-2c0c-4048-899e-42458ba4f15f nodeName:}" failed. No retries permitted until 2026-07-02 23:02:24.102902383 +0000 UTC m=+51.039951689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls") pod "dns-default-ncm48" (UID: "9197928e-2c0c-4048-899e-42458ba4f15f") : secret "dns-default-metrics-tls" not found
Jul 02 23:02:17.212317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:17.212268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:17.212757 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:17.212428    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:17.212757 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:17.212499    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls podName:60464393-f98e-4d2d-8456-69abcde0af08 nodeName:}" failed. No retries permitted until 2026-07-02 23:02:25.212479786 +0000 UTC m=+52.149529078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbkrr" (UID: "60464393-f98e-4d2d-8456-69abcde0af08") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:02:24.157684 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:24.157650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:24.161242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:24.161219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9197928e-2c0c-4048-899e-42458ba4f15f-metrics-tls\") pod \"dns-default-ncm48\" (UID: \"9197928e-2c0c-4048-899e-42458ba4f15f\") " pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:24.256678 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:24.256652    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:24.403372 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:24.403349    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ncm48"]
Jul 02 23:02:24.405464 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:24.405443    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9197928e_2c0c_4048_899e_42458ba4f15f.slice/crio-c97d033a60be8ee185fdd9aaf6dd3450fea9fe8f99199cee229cdad08165e708 WatchSource:0}: Error finding container c97d033a60be8ee185fdd9aaf6dd3450fea9fe8f99199cee229cdad08165e708: Status 404 returned error can't find the container with id c97d033a60be8ee185fdd9aaf6dd3450fea9fe8f99199cee229cdad08165e708
Jul 02 23:02:24.866005 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:24.865975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ncm48" event={"ID":"9197928e-2c0c-4048-899e-42458ba4f15f","Type":"ContainerStarted","Data":"c97d033a60be8ee185fdd9aaf6dd3450fea9fe8f99199cee229cdad08165e708"}
Jul 02 23:02:25.265689 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:25.265651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:25.268434 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:25.268408    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60464393-f98e-4d2d-8456-69abcde0af08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbkrr\" (UID: \"60464393-f98e-4d2d-8456-69abcde0af08\") " pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:25.376681 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:25.376658    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hbkrr"
Jul 02 23:02:25.513081 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:25.513034    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hbkrr"]
Jul 02 23:02:25.953833 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:25.953806    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60464393_f98e_4d2d_8456_69abcde0af08.slice/crio-13c0600b73bcac960dc02a61c3272ad988767b6cadff3666e3e18ed861a7ca19 WatchSource:0}: Error finding container 13c0600b73bcac960dc02a61c3272ad988767b6cadff3666e3e18ed861a7ca19: Status 404 returned error can't find the container with id 13c0600b73bcac960dc02a61c3272ad988767b6cadff3666e3e18ed861a7ca19
Jul 02 23:02:26.876860 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:26.876775    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ncm48" event={"ID":"9197928e-2c0c-4048-899e-42458ba4f15f","Type":"ContainerStarted","Data":"2ede65f75f87e061a9fb7c02d036127edca024899b6f59bc5e06d18b04418858"}
Jul 02 23:02:26.877542 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:26.876889    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ncm48" event={"ID":"9197928e-2c0c-4048-899e-42458ba4f15f","Type":"ContainerStarted","Data":"c168f7969cacb2222e79b4a53a542b4e8d30ee5a054161829a28f64efda24070"}
Jul 02 23:02:26.877920 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:26.877897    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:26.879580 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:26.879554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbkrr" event={"ID":"60464393-f98e-4d2d-8456-69abcde0af08","Type":"ContainerStarted","Data":"13c0600b73bcac960dc02a61c3272ad988767b6cadff3666e3e18ed861a7ca19"}
Jul 02 23:02:26.895381 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:26.895338    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ncm48" podStartSLOduration=16.990241122 podStartE2EDuration="18.895319724s" totalImagesPullingTime="1.905078602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:26.8951911 +0000 UTC m=+53.832240408" watchObservedRunningTime="2026-07-02 23:02:26.895319724 +0000 UTC m=+53.832369030"
Jul 02 23:02:29.891377 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:29.891346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbkrr" event={"ID":"60464393-f98e-4d2d-8456-69abcde0af08","Type":"ContainerStarted","Data":"56dd2f6586e82487e7b7017c1066e01d2e85634a0e72f4fa5feb1a9cb1de6130"}
Jul 02 23:02:30.897250 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:30.897211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbkrr" event={"ID":"60464393-f98e-4d2d-8456-69abcde0af08","Type":"ContainerStarted","Data":"de19f8958086f0fd48f89ba8034f99d09cd1275b339c1496339b7394b487e02f"}
Jul 02 23:02:32.671185 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.671156    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"]
Jul 02 23:02:32.681479 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.681459    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.684089 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.684043    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 23:02:32.684089 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.684084    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 23:02:32.685098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.685077    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 23:02:32.685098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.685094    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 23:02:32.685293 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.685099    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 23:02:32.685293 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.685130    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 23:02:32.685293 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.685077    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 23:02:32.697498 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.697478    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"]
Jul 02 23:02:32.717254 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.717229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.717355 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.717268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-hub\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.717418 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.717374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.717481 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.717456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-ca\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.717529 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.717495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52c8\" (UniqueName: \"kubernetes.io/projected/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-kube-api-access-p52c8\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.717579 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.717548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.818678 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.818644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-ca\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.818678 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.818683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52c8\" (UniqueName: \"kubernetes.io/projected/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-kube-api-access-p52c8\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.818820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.818716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.818820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.818764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.818820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.818791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-hub\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.818820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.818813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.819567 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.819545    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.820837 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.820820    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-ca\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.821195 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.821169    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.821419 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.821403    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.821493 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.821477    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-hub\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.827584 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.827560    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52c8\" (UniqueName: \"kubernetes.io/projected/7f3cf96b-c5c2-4098-8a20-d270738ae8e8-kube-api-access-p52c8\") pod \"cluster-proxy-proxy-agent-57877968c6-kpbfk\" (UID: \"7f3cf96b-c5c2-4098-8a20-d270738ae8e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:32.906369 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.906347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbkrr" event={"ID":"60464393-f98e-4d2d-8456-69abcde0af08","Type":"ContainerStarted","Data":"dc1364d2ae7d0f539573b4a8f76d532a7a9edacaf7ba5e5fa823f98e9293fc93"}
Jul 02 23:02:32.928768 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.928704    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hbkrr" podStartSLOduration=17.271324048 podStartE2EDuration="23.92869152s" totalImagesPullingTime="6.657367472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:02:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:32.92811943 +0000 UTC m=+59.865168741" watchObservedRunningTime="2026-07-02 23:02:32.92869152 +0000 UTC m=+59.865740828"
Jul 02 23:02:32.996645 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:32.996622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"
Jul 02 23:02:33.113789 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:33.113761    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk"]
Jul 02 23:02:33.116730 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:33.116694    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f3cf96b_c5c2_4098_8a20_d270738ae8e8.slice/crio-1924bfb8a2ec1edcc1fb530134577718388c13b6987ece31264a0e4ce76a2ab1 WatchSource:0}: Error finding container 1924bfb8a2ec1edcc1fb530134577718388c13b6987ece31264a0e4ce76a2ab1: Status 404 returned error can't find the container with id 1924bfb8a2ec1edcc1fb530134577718388c13b6987ece31264a0e4ce76a2ab1
Jul 02 23:02:33.802516 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:33.802491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bx2l"
Jul 02 23:02:33.909946 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:33.909921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk" event={"ID":"7f3cf96b-c5c2-4098-8a20-d270738ae8e8","Type":"ContainerStarted","Data":"1924bfb8a2ec1edcc1fb530134577718388c13b6987ece31264a0e4ce76a2ab1"}
Jul 02 23:02:37.890395 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:37.890366    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ncm48"
Jul 02 23:02:37.926682 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:37.926646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk" event={"ID":"7f3cf96b-c5c2-4098-8a20-d270738ae8e8","Type":"ContainerStarted","Data":"14f2bebe038825ac0d71e9a14b7b83a4406c70532cb273df661d41f4ce4c780f"}
Jul 02 23:02:37.926821 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:37.926695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk" event={"ID":"7f3cf96b-c5c2-4098-8a20-d270738ae8e8","Type":"ContainerStarted","Data":"7986159cd967b95d43cc97e2d81b89f454f62b2677a73ac9705b07b7a7bc06d2"}
Jul 02 23:02:37.926821 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:37.926713    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk" event={"ID":"7f3cf96b-c5c2-4098-8a20-d270738ae8e8","Type":"ContainerStarted","Data":"6be9b1bc2a5622cf4edda25986ab4f3ddb74e1f253422449ccdeff71d8b8db15"}
Jul 02 23:02:37.943626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:37.943572    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57877968c6-kpbfk" podStartSLOduration=2.12786728 podStartE2EDuration="5.943552706s" totalImagesPullingTime="3.815685426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:37.942901438 +0000 UTC m=+64.879950748" watchObservedRunningTime="2026-07-02 23:02:37.943552706 +0000 UTC m=+64.880602097"
Jul 02 23:02:38.253123 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.253096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:38.255611 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.255593    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:02:38.265762 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.265743    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fe605be-a403-46ec-8e29-89278da41672-metrics-certs\") pod \"network-metrics-daemon-vx6gc\" (UID: \"2fe605be-a403-46ec-8e29-89278da41672\") " pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:38.354038 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.354012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:38.354140 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.354093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:38.356508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.356489    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:02:38.356651 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.356632    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:02:38.366567 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.366544    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94d267d5-49fe-42da-a581-f2e74ea9c18b-original-pull-secret\") pod \"global-pull-secret-syncer-79qqj\" (UID: \"94d267d5-49fe-42da-a581-f2e74ea9c18b\") " pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:38.366650 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.366587    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:02:38.377617 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.377592    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gppd9\" (UniqueName: \"kubernetes.io/projected/bbc937b9-bc6f-4147-9064-2bbbabf3a601-kube-api-access-gppd9\") pod \"network-check-target-vvqzr\" (UID: \"bbc937b9-bc6f-4147-9064-2bbbabf3a601\") " pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:38.429995 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.429976    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llzj2\""
Jul 02 23:02:38.437097 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.437083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9lfbh\""
Jul 02 23:02:38.438107 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.438096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vx6gc"
Jul 02 23:02:38.441958 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.441939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79qqj"
Jul 02 23:02:38.445685 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.445664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:38.574380 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.574345    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vx6gc"]
Jul 02 23:02:38.577986 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:38.577958    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe605be_a403_46ec_8e29_89278da41672.slice/crio-c375a6524c3fa116c402af0b70dbb992d204dae2720a961e541e9f9309006aa0 WatchSource:0}: Error finding container c375a6524c3fa116c402af0b70dbb992d204dae2720a961e541e9f9309006aa0: Status 404 returned error can't find the container with id c375a6524c3fa116c402af0b70dbb992d204dae2720a961e541e9f9309006aa0
Jul 02 23:02:38.796922 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.796860    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-79qqj"]
Jul 02 23:02:38.799745 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:38.799707    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d267d5_49fe_42da_a581_f2e74ea9c18b.slice/crio-71d72f5f349445f9fd3d84019435a92c8aeddddaab7857424e118181bae62b88 WatchSource:0}: Error finding container 71d72f5f349445f9fd3d84019435a92c8aeddddaab7857424e118181bae62b88: Status 404 returned error can't find the container with id 71d72f5f349445f9fd3d84019435a92c8aeddddaab7857424e118181bae62b88
Jul 02 23:02:38.800023 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.800005    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvqzr"]
Jul 02 23:02:38.803154 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:38.803131    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc937b9_bc6f_4147_9064_2bbbabf3a601.slice/crio-afbbe13f912cc22b788b28427f132d91af32056753208c353bc57bec23a9e921 WatchSource:0}: Error finding container afbbe13f912cc22b788b28427f132d91af32056753208c353bc57bec23a9e921: Status 404 returned error can't find the container with id afbbe13f912cc22b788b28427f132d91af32056753208c353bc57bec23a9e921
Jul 02 23:02:38.930549 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.930518    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvqzr" event={"ID":"bbc937b9-bc6f-4147-9064-2bbbabf3a601","Type":"ContainerStarted","Data":"afbbe13f912cc22b788b28427f132d91af32056753208c353bc57bec23a9e921"}
Jul 02 23:02:38.931663 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.931641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-79qqj" event={"ID":"94d267d5-49fe-42da-a581-f2e74ea9c18b","Type":"ContainerStarted","Data":"71d72f5f349445f9fd3d84019435a92c8aeddddaab7857424e118181bae62b88"}
Jul 02 23:02:38.932794 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:38.932771    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx6gc" event={"ID":"2fe605be-a403-46ec-8e29-89278da41672","Type":"ContainerStarted","Data":"c375a6524c3fa116c402af0b70dbb992d204dae2720a961e541e9f9309006aa0"}
Jul 02 23:02:39.938197 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:39.938125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx6gc" event={"ID":"2fe605be-a403-46ec-8e29-89278da41672","Type":"ContainerStarted","Data":"5b642cbb90b0f2dd5a600bede71d4429c9b243cbfdc947e80cc2a780a6b426e6"}
Jul 02 23:02:39.938605 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:39.938195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vx6gc" event={"ID":"2fe605be-a403-46ec-8e29-89278da41672","Type":"ContainerStarted","Data":"6b13965ead9ba36a7b5b6a18c6853cb7ac07e537d1c9d44b30eae2084a80d1e6"}
Jul 02 23:02:39.955897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:39.955853    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vx6gc" podStartSLOduration=64.953646297 podStartE2EDuration="1m5.955834545s" totalImagesPullingTime="1.002188248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:39.95453962 +0000 UTC m=+66.891588929" watchObservedRunningTime="2026-07-02 23:02:39.955834545 +0000 UTC m=+66.892883855"
Jul 02 23:02:44.499565 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.499533    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pg2j6"]
Jul 02 23:02:44.502203 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.502183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.504422 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.504400    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 23:02:44.505132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.504906    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 23:02:44.505132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.504986    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 23:02:44.505461 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.505445    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 23:02:44.505529 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.505459    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 23:02:44.505941 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.505923    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-25f5f\""
Jul 02 23:02:44.506045 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.506011    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 23:02:44.595880 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.595853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-textfile\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.595980 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.595887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.595980 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.595908    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.595980 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.595940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-wtmp\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.596179 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.596014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-root\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.596179 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.596070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-sys\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.596179 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.596146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad084328-c6d5-4bd5-9152-19f55a612c4c-metrics-client-ca\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.596179 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.596172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.596362 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.596203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28dmr\" (UniqueName: \"kubernetes.io/projected/ad084328-c6d5-4bd5-9152-19f55a612c4c-kube-api-access-28dmr\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697362 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-wtmp\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697473 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-root\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697473 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697438    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-root\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697473 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-sys\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad084328-c6d5-4bd5-9152-19f55a612c4c-metrics-client-ca\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697499    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-sys\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28dmr\" (UniqueName: \"kubernetes.io/projected/ad084328-c6d5-4bd5-9152-19f55a612c4c-kube-api-access-28dmr\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-textfile\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697613    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-wtmp\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697968 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697968 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.697664    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.697968 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:44.697849    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 23:02:44.697968 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:44.697918    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls podName:ad084328-c6d5-4bd5-9152-19f55a612c4c nodeName:}" failed. No retries permitted until 2026-07-02 23:02:45.197887344 +0000 UTC m=+72.134936657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls") pod "node-exporter-pg2j6" (UID: "ad084328-c6d5-4bd5-9152-19f55a612c4c") : secret "node-exporter-tls" not found
Jul 02 23:02:44.698319 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.698266    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.698435 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.698400    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-textfile\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.698724 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.698705    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad084328-c6d5-4bd5-9152-19f55a612c4c-metrics-client-ca\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.700376 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.700355    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.710153 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.710128    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28dmr\" (UniqueName: \"kubernetes.io/projected/ad084328-c6d5-4bd5-9152-19f55a612c4c-kube-api-access-28dmr\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:44.957851 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.957815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvqzr" event={"ID":"bbc937b9-bc6f-4147-9064-2bbbabf3a601","Type":"ContainerStarted","Data":"16bfd785fc4ebd83aba6c7b6dc447828dfbd7cbba2abee3a501e50c29b19aba8"}
Jul 02 23:02:44.957960 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.957932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:02:44.959333 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.959312    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-79qqj" event={"ID":"94d267d5-49fe-42da-a581-f2e74ea9c18b","Type":"ContainerStarted","Data":"998158ce44a6a8984abec4e784152b1ee289ec2c51c3066f39b2d5ef3aca54a9"}
Jul 02 23:02:44.973301 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.973253    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vvqzr" podStartSLOduration=65.800828884 podStartE2EDuration="1m10.973240452s" totalImagesPullingTime="5.172411568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:44.972414222 +0000 UTC m=+71.909463530" watchObservedRunningTime="2026-07-02 23:02:44.973240452 +0000 UTC m=+71.910289759"
Jul 02 23:02:44.986266 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:44.986229    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-79qqj" podStartSLOduration=65.800032281 podStartE2EDuration="1m10.986216956s" totalImagesPullingTime="5.186184675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:44.985366439 +0000 UTC m=+71.922415745" watchObservedRunningTime="2026-07-02 23:02:44.986216956 +0000 UTC m=+71.923266265"
Jul 02 23:02:45.201806 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:45.201772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:45.201920 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:45.201897    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 23:02:45.201993 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:02:45.201942    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls podName:ad084328-c6d5-4bd5-9152-19f55a612c4c nodeName:}" failed. No retries permitted until 2026-07-02 23:02:46.201930753 +0000 UTC m=+73.138980043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls") pod "node-exporter-pg2j6" (UID: "ad084328-c6d5-4bd5-9152-19f55a612c4c") : secret "node-exporter-tls" not found
Jul 02 23:02:46.209655 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.209613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:46.212128 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.212104    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad084328-c6d5-4bd5-9152-19f55a612c4c-node-exporter-tls\") pod \"node-exporter-pg2j6\" (UID: \"ad084328-c6d5-4bd5-9152-19f55a612c4c\") " pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:46.313317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.313288    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pg2j6"
Jul 02 23:02:46.324580 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:46.324549    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad084328_c6d5_4bd5_9152_19f55a612c4c.slice/crio-82d7b178646098e1c81e7474231b5b447a0444d99250f29f7b695db1a166961a WatchSource:0}: Error finding container 82d7b178646098e1c81e7474231b5b447a0444d99250f29f7b695db1a166961a: Status 404 returned error can't find the container with id 82d7b178646098e1c81e7474231b5b447a0444d99250f29f7b695db1a166961a
Jul 02 23:02:46.527993 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.527972    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5975468578-49vgq"]
Jul 02 23:02:46.531002 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.530985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.533755 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.533735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 23:02:46.534071 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.534036    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 23:02:46.534147 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.534074    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 23:02:46.534201 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.534158    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 23:02:46.534280 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.534255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qnk9t\""
Jul 02 23:02:46.534387 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.534331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 23:02:46.534448 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.534392    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7fgv19ovtjhd0\""
Jul 02 23:02:46.546324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.546305    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5975468578-49vgq"]
Jul 02 23:02:46.613156 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brtxw\" (UniqueName: \"kubernetes.io/projected/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-kube-api-access-brtxw\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.613324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.613324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-tls\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.613324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.613324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-grpc-tls\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.613513 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.613513 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-metrics-client-ca\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.613513 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.613410    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.713866 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.713839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-metrics-client-ca\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.713970 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.713874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.713970 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.713908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brtxw\" (UniqueName: \"kubernetes.io/projected/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-kube-api-access-brtxw\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.713970 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.713943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.714157 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.713980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-tls\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.714210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.714182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.714259 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.714220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-grpc-tls\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.714259 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.714250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.715074 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.715032    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-metrics-client-ca\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.716430 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.716401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.716804 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.716777    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.716896 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.716864    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-tls\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.716969 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.716946    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-grpc-tls\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.717025 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.717005    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.717356 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.717338    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.722512 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.722490    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brtxw\" (UniqueName: \"kubernetes.io/projected/05da4a93-70a6-4c2f-bb83-694f48a5f5dc-kube-api-access-brtxw\") pod \"thanos-querier-5975468578-49vgq\" (UID: \"05da4a93-70a6-4c2f-bb83-694f48a5f5dc\") " pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.839737 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.839690    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:46.967653 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.967613    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg2j6" event={"ID":"ad084328-c6d5-4bd5-9152-19f55a612c4c","Type":"ContainerStarted","Data":"82d7b178646098e1c81e7474231b5b447a0444d99250f29f7b695db1a166961a"}
Jul 02 23:02:46.980323 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:46.980295    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5975468578-49vgq"]
Jul 02 23:02:46.984236 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:46.984208    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05da4a93_70a6_4c2f_bb83_694f48a5f5dc.slice/crio-d766b39df33e12880d9d5c59a8baa412f772da21f8a5651646d6bf8fdce98a78 WatchSource:0}: Error finding container d766b39df33e12880d9d5c59a8baa412f772da21f8a5651646d6bf8fdce98a78: Status 404 returned error can't find the container with id d766b39df33e12880d9d5c59a8baa412f772da21f8a5651646d6bf8fdce98a78
Jul 02 23:02:47.974234 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:47.974196    2575 generic.go:356] "Generic (PLEG): container finished" podID="ad084328-c6d5-4bd5-9152-19f55a612c4c" containerID="52f5cf87fd09d14789bbdf7e45d785a3c4823218eea7d0a7ae28c15d27e87581" exitCode=0
Jul 02 23:02:47.974760 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:47.974289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg2j6" event={"ID":"ad084328-c6d5-4bd5-9152-19f55a612c4c","Type":"ContainerDied","Data":"52f5cf87fd09d14789bbdf7e45d785a3c4823218eea7d0a7ae28c15d27e87581"}
Jul 02 23:02:47.975643 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:47.975609    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" event={"ID":"05da4a93-70a6-4c2f-bb83-694f48a5f5dc","Type":"ContainerStarted","Data":"d766b39df33e12880d9d5c59a8baa412f772da21f8a5651646d6bf8fdce98a78"}
Jul 02 23:02:48.982824 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:48.982725    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg2j6" event={"ID":"ad084328-c6d5-4bd5-9152-19f55a612c4c","Type":"ContainerStarted","Data":"0434694fc0cb6d914fb0d7fed90df642e27287cedb9c0517e9cd1a78e2bcfc81"}
Jul 02 23:02:48.982824 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:48.982816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pg2j6" event={"ID":"ad084328-c6d5-4bd5-9152-19f55a612c4c","Type":"ContainerStarted","Data":"f61e8cb9f83114b339b88c870f80fb80187a9e9de08dbc1f64ac1d9a9db20991"}
Jul 02 23:02:48.984526 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:48.984492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" event={"ID":"05da4a93-70a6-4c2f-bb83-694f48a5f5dc","Type":"ContainerStarted","Data":"06ea60237351afdcad00811d9c44a62af6325d1ceee4501aa7f667269367c63c"}
Jul 02 23:02:49.011304 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:49.011261    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pg2j6" podStartSLOduration=3.88556008 podStartE2EDuration="5.011246016s" totalImagesPullingTime="1.061550509s" totalInitContainerRuntime="64.135427ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:49.009633438 +0000 UTC m=+75.946682746" watchObservedRunningTime="2026-07-02 23:02:49.011246016 +0000 UTC m=+75.948295323"
Jul 02 23:02:49.990807 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:49.990771    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" event={"ID":"05da4a93-70a6-4c2f-bb83-694f48a5f5dc","Type":"ContainerStarted","Data":"6ab76b420223b55b5327f166f12cbe8f0e1b40c4af84625d2c1d941c4292f5e8"}
Jul 02 23:02:49.991243 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:49.990847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" event={"ID":"05da4a93-70a6-4c2f-bb83-694f48a5f5dc","Type":"ContainerStarted","Data":"3edf19077d7d318da782d8fbc768667af8d163cd9f05abe2b48a1d095e705a80"}
Jul 02 23:02:50.955768 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.955727    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9db89b67-n9tb9"]
Jul 02 23:02:50.958131 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.958112    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:50.960707 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.960677    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 23:02:50.962013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.961761    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 23:02:50.962013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.961760    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 23:02:50.962013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.961817    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 23:02:50.962013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.961769    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 23:02:50.962013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.961774    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 23:02:50.962013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.961875    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pflx7\""
Jul 02 23:02:50.962013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.961807    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 23:02:50.970622 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.970597    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9db89b67-n9tb9"]
Jul 02 23:02:50.997909 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.997881    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" event={"ID":"05da4a93-70a6-4c2f-bb83-694f48a5f5dc","Type":"ContainerStarted","Data":"11215d455bd3f7ff7d144bb09585e34a34a612bdc6ae8ea062463b9015a752d0"}
Jul 02 23:02:50.998239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.997938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" event={"ID":"05da4a93-70a6-4c2f-bb83-694f48a5f5dc","Type":"ContainerStarted","Data":"942f6727656a0713b3031d82f59836d32a5ccdd77332b032e186bd68367d2c7d"}
Jul 02 23:02:50.998239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.997978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" event={"ID":"05da4a93-70a6-4c2f-bb83-694f48a5f5dc","Type":"ContainerStarted","Data":"a16cb768f8ac772c484f6f03c48489eee637bf7888799a2e46bf9c2b0e0db5c9"}
Jul 02 23:02:50.998239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:50.998013    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:51.020741 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.020696    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5975468578-49vgq" podStartSLOduration=2.121455312 podStartE2EDuration="5.020683274s" totalImagesPullingTime="2.899227962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:51.019132912 +0000 UTC m=+77.956182217" watchObservedRunningTime="2026-07-02 23:02:51.020683274 +0000 UTC m=+77.957732581"
Jul 02 23:02:51.045971 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.045948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-service-ca\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.046076 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.045974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-config\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.046239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.046217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-oauth-config\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.046301 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.046286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-serving-cert\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.046528 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.046447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-oauth-serving-cert\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.046528 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.046501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l5fr\" (UniqueName: \"kubernetes.io/projected/98846c49-8d42-4cd4-94de-bf86f8b6121f-kube-api-access-6l5fr\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.147272 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.147251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-oauth-config\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.147361 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.147278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-serving-cert\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.147361 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.147311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-oauth-serving-cert\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.147361 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.147335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l5fr\" (UniqueName: \"kubernetes.io/projected/98846c49-8d42-4cd4-94de-bf86f8b6121f-kube-api-access-6l5fr\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.147508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.147370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-service-ca\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.147508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.147405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-config\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.147975 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.147955    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-oauth-serving-cert\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.148133 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.148113    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-config\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.148201 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.148119    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-service-ca\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.149782 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.149762    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-oauth-config\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.149867 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.149843    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-serving-cert\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.157997 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.157973    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l5fr\" (UniqueName: \"kubernetes.io/projected/98846c49-8d42-4cd4-94de-bf86f8b6121f-kube-api-access-6l5fr\") pod \"console-6f9db89b67-n9tb9\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") " pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.268165 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.268142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:02:51.386276 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:51.386251    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9db89b67-n9tb9"]
Jul 02 23:02:51.389031 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:51.388999    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98846c49_8d42_4cd4_94de_bf86f8b6121f.slice/crio-d6b55f79b31ea8129d0d2bbe6df17ed00c6e6ff0e560dde5da839b4a63db39ba WatchSource:0}: Error finding container d6b55f79b31ea8129d0d2bbe6df17ed00c6e6ff0e560dde5da839b4a63db39ba: Status 404 returned error can't find the container with id d6b55f79b31ea8129d0d2bbe6df17ed00c6e6ff0e560dde5da839b4a63db39ba
Jul 02 23:02:52.002697 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:52.002665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9db89b67-n9tb9" event={"ID":"98846c49-8d42-4cd4-94de-bf86f8b6121f","Type":"ContainerStarted","Data":"d6b55f79b31ea8129d0d2bbe6df17ed00c6e6ff0e560dde5da839b4a63db39ba"}
Jul 02 23:02:55.015769 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.015735    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9db89b67-n9tb9" event={"ID":"98846c49-8d42-4cd4-94de-bf86f8b6121f","Type":"ContainerStarted","Data":"08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07"}
Jul 02 23:02:55.034587 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.034543    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9db89b67-n9tb9" podStartSLOduration=2.175245911 podStartE2EDuration="5.034527312s" totalImagesPullingTime="2.859281401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:55.032953883 +0000 UTC m=+81.970003191" watchObservedRunningTime="2026-07-02 23:02:55.034527312 +0000 UTC m=+81.971576618"
Jul 02 23:02:55.743538 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.743507    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77f7687768-wfkr7"]
Jul 02 23:02:55.745608 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.745592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.753635 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.753615    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 23:02:55.758261 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.758238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77f7687768-wfkr7"]
Jul 02 23:02:55.778691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.778660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-config\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.778791 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.778699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-trusted-ca-bundle\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.778791 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.778731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpgrc\" (UniqueName: \"kubernetes.io/projected/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-kube-api-access-cpgrc\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.778791 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.778762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-service-ca\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.778942 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.778833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-serving-cert\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.778942 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.778867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-oauth-config\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.778942 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.778888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-oauth-serving-cert\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879196 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-config\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879282 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-trusted-ca-bundle\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879282 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpgrc\" (UniqueName: \"kubernetes.io/projected/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-kube-api-access-cpgrc\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879282 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-service-ca\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879282 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-serving-cert\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879404 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-oauth-config\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879404 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-oauth-serving-cert\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.879931 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.879895    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-service-ca\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.880085 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.880037    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-oauth-serving-cert\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.880199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.880145    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-config\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.880199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.880181    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-trusted-ca-bundle\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.881962 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.881940    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-oauth-config\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.882026 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.881948    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-serving-cert\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:55.886145 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:55.886126    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpgrc\" (UniqueName: \"kubernetes.io/projected/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-kube-api-access-cpgrc\") pod \"console-77f7687768-wfkr7\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") " pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:56.055833 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:56.055809    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:02:56.180282 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:56.180252    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77f7687768-wfkr7"]
Jul 02 23:02:56.183071 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:02:56.183029    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918d0da1_d8ab_41e3_bb3a_f99b0e9ab006.slice/crio-c1ac0559acb9addf7823c8ec951167d79b275425d8fb5da38d792be816c1ca45 WatchSource:0}: Error finding container c1ac0559acb9addf7823c8ec951167d79b275425d8fb5da38d792be816c1ca45: Status 404 returned error can't find the container with id c1ac0559acb9addf7823c8ec951167d79b275425d8fb5da38d792be816c1ca45
Jul 02 23:02:57.009156 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:57.009117    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5975468578-49vgq"
Jul 02 23:02:57.028238 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:57.028207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f7687768-wfkr7" event={"ID":"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006","Type":"ContainerStarted","Data":"257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947"}
Jul 02 23:02:57.028392 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:57.028253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f7687768-wfkr7" event={"ID":"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006","Type":"ContainerStarted","Data":"c1ac0559acb9addf7823c8ec951167d79b275425d8fb5da38d792be816c1ca45"}
Jul 02 23:02:57.049705 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:02:57.049651    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77f7687768-wfkr7" podStartSLOduration=2.049634849 podStartE2EDuration="2.049634849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:02:57.048745703 +0000 UTC m=+83.985795011" watchObservedRunningTime="2026-07-02 23:02:57.049634849 +0000 UTC m=+83.986684158"
Jul 02 23:03:01.268860 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:01.268826    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:03:01.269314 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:01.268887    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:03:01.273940 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:01.273913    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:03:02.048308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:02.048279    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:03:06.056476 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:06.056443    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:03:06.057210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:06.056499    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:03:06.061003 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:06.060979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:03:07.067435 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:07.067405    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:03:07.113346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:07.113309    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9db89b67-n9tb9"]
Jul 02 23:03:15.964639 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:15.964603    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vvqzr"
Jul 02 23:03:32.136962 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.136921    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f9db89b67-n9tb9" podUID="98846c49-8d42-4cd4-94de-bf86f8b6121f" containerName="console" containerID="cri-o://08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07" gracePeriod=15
Jul 02 23:03:32.365565 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.365543    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:03:32.418691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.418639    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-serving-cert\") pod \"98846c49-8d42-4cd4-94de-bf86f8b6121f\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") "
Jul 02 23:03:32.418691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.418680    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-config\") pod \"98846c49-8d42-4cd4-94de-bf86f8b6121f\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") "
Jul 02 23:03:32.418817 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.418707    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l5fr\" (UniqueName: \"kubernetes.io/projected/98846c49-8d42-4cd4-94de-bf86f8b6121f-kube-api-access-6l5fr\") pod \"98846c49-8d42-4cd4-94de-bf86f8b6121f\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") "
Jul 02 23:03:32.418817 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.418745    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-oauth-config\") pod \"98846c49-8d42-4cd4-94de-bf86f8b6121f\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") "
Jul 02 23:03:32.418817 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.418762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-service-ca\") pod \"98846c49-8d42-4cd4-94de-bf86f8b6121f\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") "
Jul 02 23:03:32.418817 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.418799    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-oauth-serving-cert\") pod \"98846c49-8d42-4cd4-94de-bf86f8b6121f\" (UID: \"98846c49-8d42-4cd4-94de-bf86f8b6121f\") "
Jul 02 23:03:32.419181 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.419089    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-config" (OuterVolumeSpecName: "console-config") pod "98846c49-8d42-4cd4-94de-bf86f8b6121f" (UID: "98846c49-8d42-4cd4-94de-bf86f8b6121f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:03:32.419275 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.419198    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-service-ca" (OuterVolumeSpecName: "service-ca") pod "98846c49-8d42-4cd4-94de-bf86f8b6121f" (UID: "98846c49-8d42-4cd4-94de-bf86f8b6121f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:03:32.419275 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.419241    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98846c49-8d42-4cd4-94de-bf86f8b6121f" (UID: "98846c49-8d42-4cd4-94de-bf86f8b6121f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:03:32.420912 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.420890    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98846c49-8d42-4cd4-94de-bf86f8b6121f" (UID: "98846c49-8d42-4cd4-94de-bf86f8b6121f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:03:32.420993 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.420926    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98846c49-8d42-4cd4-94de-bf86f8b6121f" (UID: "98846c49-8d42-4cd4-94de-bf86f8b6121f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:03:32.420993 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.420944    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98846c49-8d42-4cd4-94de-bf86f8b6121f-kube-api-access-6l5fr" (OuterVolumeSpecName: "kube-api-access-6l5fr") pod "98846c49-8d42-4cd4-94de-bf86f8b6121f" (UID: "98846c49-8d42-4cd4-94de-bf86f8b6121f"). InnerVolumeSpecName "kube-api-access-6l5fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:03:32.519514 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.519490    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:03:32.519514 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.519510    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l5fr\" (UniqueName: \"kubernetes.io/projected/98846c49-8d42-4cd4-94de-bf86f8b6121f-kube-api-access-6l5fr\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:03:32.519642 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.519521    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-oauth-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:03:32.519642 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.519530    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:03:32.519642 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.519539    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98846c49-8d42-4cd4-94de-bf86f8b6121f-oauth-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:03:32.519642 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:32.519548    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98846c49-8d42-4cd4-94de-bf86f8b6121f-console-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:03:33.159992 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.159962    2575 generic.go:356] "Generic (PLEG): container finished" podID="98846c49-8d42-4cd4-94de-bf86f8b6121f" containerID="08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07" exitCode=0
Jul 02 23:03:33.160417 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.159999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9db89b67-n9tb9" event={"ID":"98846c49-8d42-4cd4-94de-bf86f8b6121f","Type":"ContainerDied","Data":"08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07"}
Jul 02 23:03:33.160417 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.160012    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9db89b67-n9tb9"
Jul 02 23:03:33.160417 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.160037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9db89b67-n9tb9" event={"ID":"98846c49-8d42-4cd4-94de-bf86f8b6121f","Type":"ContainerDied","Data":"d6b55f79b31ea8129d0d2bbe6df17ed00c6e6ff0e560dde5da839b4a63db39ba"}
Jul 02 23:03:33.160714 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.160700    2575 scope.go:117] "RemoveContainer" containerID="08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07"
Jul 02 23:03:33.170464 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.170444    2575 scope.go:117] "RemoveContainer" containerID="08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07"
Jul 02 23:03:33.170791 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:03:33.170769    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07\": container with ID starting with 08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07 not found: ID does not exist" containerID="08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07"
Jul 02 23:03:33.170854 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.170799    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07"} err="failed to get container status \"08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07\": rpc error: code = NotFound desc = could not find container \"08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07\": container with ID starting with 08ae1db13b7c9f2c8635cd5b134d47660d9fe6ad208e1bca035cef6ae0feec07 not found: ID does not exist"
Jul 02 23:03:33.179841 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.179817    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9db89b67-n9tb9"]
Jul 02 23:03:33.183868 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.183841    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9db89b67-n9tb9"]
Jul 02 23:03:33.623548 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:03:33.623525    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98846c49-8d42-4cd4-94de-bf86f8b6121f" path="/var/lib/kubelet/pods/98846c49-8d42-4cd4-94de-bf86f8b6121f/volumes"
Jul 02 23:04:12.884406 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.884368    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664d596c64-sl8vt"]
Jul 02 23:04:12.884915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.884618    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98846c49-8d42-4cd4-94de-bf86f8b6121f" containerName="console"
Jul 02 23:04:12.884915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.884630    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="98846c49-8d42-4cd4-94de-bf86f8b6121f" containerName="console"
Jul 02 23:04:12.884915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.884689    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="98846c49-8d42-4cd4-94de-bf86f8b6121f" containerName="console"
Jul 02 23:04:12.886526 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.886507    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:12.901249 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.901217    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d596c64-sl8vt"]
Jul 02 23:04:12.985112 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.985092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-config\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:12.985191 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.985133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wf7f\" (UniqueName: \"kubernetes.io/projected/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-kube-api-access-6wf7f\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:12.985191 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.985157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-oauth-serving-cert\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:12.985260 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.985230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-serving-cert\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:12.985293 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.985257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-oauth-config\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:12.985293 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.985274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-service-ca\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:12.985293 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:12.985290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-trusted-ca-bundle\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.086480 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.086448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-config\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.086596 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.086492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wf7f\" (UniqueName: \"kubernetes.io/projected/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-kube-api-access-6wf7f\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.086596 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.086508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-oauth-serving-cert\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.086596 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.086531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-serving-cert\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.086750 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.086661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-oauth-config\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.086750 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.086712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-service-ca\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.086750 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.086734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-trusted-ca-bundle\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.087306 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.087279    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-config\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.087438 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.087337    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-oauth-serving-cert\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.087507 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.087488    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-service-ca\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.087614 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.087595    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-trusted-ca-bundle\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.089110 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.089091    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-serving-cert\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.089281 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.089255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-oauth-config\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.095160 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.095135    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wf7f\" (UniqueName: \"kubernetes.io/projected/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-kube-api-access-6wf7f\") pod \"console-664d596c64-sl8vt\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") " pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.196256 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.196201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:13.321940 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:13.321904    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d596c64-sl8vt"]
Jul 02 23:04:13.324579 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:04:13.324556    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea633c4_3dbb_4a37_9199_2d0cc0426f33.slice/crio-23f9eaf1f677492485d9025d227639e99b4bb6ebabfc0da1149f1d9d6581d10c WatchSource:0}: Error finding container 23f9eaf1f677492485d9025d227639e99b4bb6ebabfc0da1149f1d9d6581d10c: Status 404 returned error can't find the container with id 23f9eaf1f677492485d9025d227639e99b4bb6ebabfc0da1149f1d9d6581d10c
Jul 02 23:04:14.312577 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:14.312530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d596c64-sl8vt" event={"ID":"4ea633c4-3dbb-4a37-9199-2d0cc0426f33","Type":"ContainerStarted","Data":"64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418"}
Jul 02 23:04:14.313105 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:14.312595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d596c64-sl8vt" event={"ID":"4ea633c4-3dbb-4a37-9199-2d0cc0426f33","Type":"ContainerStarted","Data":"23f9eaf1f677492485d9025d227639e99b4bb6ebabfc0da1149f1d9d6581d10c"}
Jul 02 23:04:14.333600 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:14.333540    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664d596c64-sl8vt" podStartSLOduration=2.333524703 podStartE2EDuration="2.333524703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:04:14.332209456 +0000 UTC m=+161.269258764" watchObservedRunningTime="2026-07-02 23:04:14.333524703 +0000 UTC m=+161.270574010"
Jul 02 23:04:23.196928 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:23.196886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:23.197492 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:23.196989    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:23.201869 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:23.201839    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:23.352565 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:23.352538    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:04:23.395715 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:23.395690    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77f7687768-wfkr7"]
Jul 02 23:04:48.415407 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.415311    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77f7687768-wfkr7" podUID="918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" containerName="console" containerID="cri-o://257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947" gracePeriod=15
Jul 02 23:04:48.656491 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.656470    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:04:48.721587 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721534    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-config\") pod \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") "
Jul 02 23:04:48.721587 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721563    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpgrc\" (UniqueName: \"kubernetes.io/projected/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-kube-api-access-cpgrc\") pod \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") "
Jul 02 23:04:48.721734 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721611    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-serving-cert\") pod \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") "
Jul 02 23:04:48.721734 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721639    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-oauth-serving-cert\") pod \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") "
Jul 02 23:04:48.721734 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721667    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-service-ca\") pod \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") "
Jul 02 23:04:48.721734 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721706    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-oauth-config\") pod \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") "
Jul 02 23:04:48.721923 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721735    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-trusted-ca-bundle\") pod \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\" (UID: \"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006\") "
Jul 02 23:04:48.721981 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.721924    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-config" (OuterVolumeSpecName: "console-config") pod "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" (UID: "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:04:48.722102 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.722074    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" (UID: "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:04:48.722253 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.722207    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" (UID: "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:04:48.722253 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.722232    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:04:48.722253 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.722237    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-service-ca" (OuterVolumeSpecName: "service-ca") pod "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" (UID: "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:04:48.723730 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.723706    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-kube-api-access-cpgrc" (OuterVolumeSpecName: "kube-api-access-cpgrc") pod "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" (UID: "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006"). InnerVolumeSpecName "kube-api-access-cpgrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:04:48.723802 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.723745    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" (UID: "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:04:48.723854 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.723804    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" (UID: "918d0da1-d8ab-41e3-bb3a-f99b0e9ab006"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:04:48.823231 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.823210    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-oauth-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:04:48.823231 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.823228    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:04:48.823383 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.823237    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-oauth-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:04:48.823383 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.823245    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-trusted-ca-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:04:48.823383 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.823253    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpgrc\" (UniqueName: \"kubernetes.io/projected/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-kube-api-access-cpgrc\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:04:48.823383 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:48.823262    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006-console-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:04:49.445779 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.445742    2575 generic.go:356] "Generic (PLEG): container finished" podID="918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" containerID="257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947" exitCode=0
Jul 02 23:04:49.446210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.445801    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f7687768-wfkr7"
Jul 02 23:04:49.446210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.445808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f7687768-wfkr7" event={"ID":"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006","Type":"ContainerDied","Data":"257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947"}
Jul 02 23:04:49.446210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.445869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f7687768-wfkr7" event={"ID":"918d0da1-d8ab-41e3-bb3a-f99b0e9ab006","Type":"ContainerDied","Data":"c1ac0559acb9addf7823c8ec951167d79b275425d8fb5da38d792be816c1ca45"}
Jul 02 23:04:49.446210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.445906    2575 scope.go:117] "RemoveContainer" containerID="257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947"
Jul 02 23:04:49.455408 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.455391    2575 scope.go:117] "RemoveContainer" containerID="257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947"
Jul 02 23:04:49.455690 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:04:49.455668    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947\": container with ID starting with 257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947 not found: ID does not exist" containerID="257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947"
Jul 02 23:04:49.455759 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.455696    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947"} err="failed to get container status \"257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947\": rpc error: code = NotFound desc = could not find container \"257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947\": container with ID starting with 257cbb5b54ad4e3e9e24ea5777b0baf6196091fce6db5f7ae67051e1468c2947 not found: ID does not exist"
Jul 02 23:04:49.466809 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.466781    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77f7687768-wfkr7"]
Jul 02 23:04:49.470664 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.470635    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77f7687768-wfkr7"]
Jul 02 23:04:49.619394 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:04:49.619364    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" path="/var/lib/kubelet/pods/918d0da1-d8ab-41e3-bb3a-f99b0e9ab006/volumes"
Jul 02 23:05:27.655697 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.655663    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77bd94dcb5-qfw69"]
Jul 02 23:05:27.656273 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.655932    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" containerName="console"
Jul 02 23:05:27.656273 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.655944    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" containerName="console"
Jul 02 23:05:27.656273 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.655992    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="918d0da1-d8ab-41e3-bb3a-f99b0e9ab006" containerName="console"
Jul 02 23:05:27.657782 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.657763    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.671394 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.671361    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bd94dcb5-qfw69"]
Jul 02 23:05:27.780090 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.780046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-config\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.780230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.780096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-service-ca\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.780230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.780126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-trusted-ca-bundle\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.780230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.780162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-oauth-serving-cert\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.780230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.780187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-oauth-config\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.780230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.780210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-serving-cert\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.780444 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.780258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smrx9\" (UniqueName: \"kubernetes.io/projected/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-kube-api-access-smrx9\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.881427 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.881394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-config\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.881525 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.881429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-service-ca\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.881525 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.881448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-trusted-ca-bundle\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.881525 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.881472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-oauth-serving-cert\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.881674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.881581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-oauth-config\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.881674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.881612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-serving-cert\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.881674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.881643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smrx9\" (UniqueName: \"kubernetes.io/projected/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-kube-api-access-smrx9\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.882365 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.882332    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-service-ca\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.882494 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.882395    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-config\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.882494 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.882415    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-oauth-serving-cert\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.882606 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.882520    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-trusted-ca-bundle\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.884508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.884473    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-oauth-config\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.884611 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.884584    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-serving-cert\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.889434 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.889404    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smrx9\" (UniqueName: \"kubernetes.io/projected/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-kube-api-access-smrx9\") pod \"console-77bd94dcb5-qfw69\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") " pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:27.967100 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:27.967026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:28.094174 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:28.094147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bd94dcb5-qfw69"]
Jul 02 23:05:28.097302 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:05:28.097272    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69c2cd0_45e2_4120_a5f3_a4dff832cd49.slice/crio-a4c2b5fad46264b66d140e21fba6b23d0f2b779266d18e9de035f2544bb527f3 WatchSource:0}: Error finding container a4c2b5fad46264b66d140e21fba6b23d0f2b779266d18e9de035f2544bb527f3: Status 404 returned error can't find the container with id a4c2b5fad46264b66d140e21fba6b23d0f2b779266d18e9de035f2544bb527f3
Jul 02 23:05:28.594615 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:28.594567    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd94dcb5-qfw69" event={"ID":"b69c2cd0-45e2-4120-a5f3-a4dff832cd49","Type":"ContainerStarted","Data":"34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec"}
Jul 02 23:05:28.594805 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:28.594644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd94dcb5-qfw69" event={"ID":"b69c2cd0-45e2-4120-a5f3-a4dff832cd49","Type":"ContainerStarted","Data":"a4c2b5fad46264b66d140e21fba6b23d0f2b779266d18e9de035f2544bb527f3"}
Jul 02 23:05:28.609858 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:28.609803    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77bd94dcb5-qfw69" podStartSLOduration=1.609784956 podStartE2EDuration="1.609784956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:05:28.609608491 +0000 UTC m=+235.546657801" watchObservedRunningTime="2026-07-02 23:05:28.609784956 +0000 UTC m=+235.546834246"
Jul 02 23:05:37.967450 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:37.967409    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:37.967872 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:37.967473    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:37.972568 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:37.972541    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:38.633003 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:38.632967    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:05:38.679463 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:05:38.679438    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d596c64-sl8vt"]
Jul 02 23:06:03.699313 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:03.699227    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-664d596c64-sl8vt" podUID="4ea633c4-3dbb-4a37-9199-2d0cc0426f33" containerName="console" containerID="cri-o://64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418" gracePeriod=15
Jul 02 23:06:03.929848 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:03.929826    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:06:04.020169 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020144    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-service-ca\") pod \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") "
Jul 02 23:06:04.020268 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020179    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-oauth-config\") pod \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") "
Jul 02 23:06:04.020268 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020222    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-config\") pod \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") "
Jul 02 23:06:04.020268 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020240    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-oauth-serving-cert\") pod \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") "
Jul 02 23:06:04.020268 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020256    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wf7f\" (UniqueName: \"kubernetes.io/projected/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-kube-api-access-6wf7f\") pod \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") "
Jul 02 23:06:04.020438 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020284    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-trusted-ca-bundle\") pod \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") "
Jul 02 23:06:04.020438 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020399    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-serving-cert\") pod \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\" (UID: \"4ea633c4-3dbb-4a37-9199-2d0cc0426f33\") "
Jul 02 23:06:04.020657 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020602    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ea633c4-3dbb-4a37-9199-2d0cc0426f33" (UID: "4ea633c4-3dbb-4a37-9199-2d0cc0426f33"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:06:04.020768 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020703    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-config" (OuterVolumeSpecName: "console-config") pod "4ea633c4-3dbb-4a37-9199-2d0cc0426f33" (UID: "4ea633c4-3dbb-4a37-9199-2d0cc0426f33"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:06:04.020830 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020766    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ea633c4-3dbb-4a37-9199-2d0cc0426f33" (UID: "4ea633c4-3dbb-4a37-9199-2d0cc0426f33"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:06:04.020830 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.020791    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4ea633c4-3dbb-4a37-9199-2d0cc0426f33" (UID: "4ea633c4-3dbb-4a37-9199-2d0cc0426f33"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:06:04.022440 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.022414    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ea633c4-3dbb-4a37-9199-2d0cc0426f33" (UID: "4ea633c4-3dbb-4a37-9199-2d0cc0426f33"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:06:04.022440 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.022426    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-kube-api-access-6wf7f" (OuterVolumeSpecName: "kube-api-access-6wf7f") pod "4ea633c4-3dbb-4a37-9199-2d0cc0426f33" (UID: "4ea633c4-3dbb-4a37-9199-2d0cc0426f33"). InnerVolumeSpecName "kube-api-access-6wf7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:06:04.022718 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.022544    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ea633c4-3dbb-4a37-9199-2d0cc0426f33" (UID: "4ea633c4-3dbb-4a37-9199-2d0cc0426f33"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:06:04.121462 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.121442    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:06:04.121462 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.121462    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-oauth-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:06:04.121582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.121472    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wf7f\" (UniqueName: \"kubernetes.io/projected/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-kube-api-access-6wf7f\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:06:04.121582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.121482    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-trusted-ca-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:06:04.121582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.121491    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:06:04.121582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.121499    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:06:04.121582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.121507    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ea633c4-3dbb-4a37-9199-2d0cc0426f33-console-oauth-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:06:04.728926 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.728889    2575 generic.go:356] "Generic (PLEG): container finished" podID="4ea633c4-3dbb-4a37-9199-2d0cc0426f33" containerID="64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418" exitCode=0
Jul 02 23:06:04.729562 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.728966    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d596c64-sl8vt"
Jul 02 23:06:04.729562 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.728977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d596c64-sl8vt" event={"ID":"4ea633c4-3dbb-4a37-9199-2d0cc0426f33","Type":"ContainerDied","Data":"64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418"}
Jul 02 23:06:04.729562 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.729081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d596c64-sl8vt" event={"ID":"4ea633c4-3dbb-4a37-9199-2d0cc0426f33","Type":"ContainerDied","Data":"23f9eaf1f677492485d9025d227639e99b4bb6ebabfc0da1149f1d9d6581d10c"}
Jul 02 23:06:04.729562 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.729106    2575 scope.go:117] "RemoveContainer" containerID="64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418"
Jul 02 23:06:04.738213 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.738190    2575 scope.go:117] "RemoveContainer" containerID="64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418"
Jul 02 23:06:04.738511 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:06:04.738491    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418\": container with ID starting with 64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418 not found: ID does not exist" containerID="64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418"
Jul 02 23:06:04.738560 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.738519    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418"} err="failed to get container status \"64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418\": rpc error: code = NotFound desc = could not find container \"64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418\": container with ID starting with 64847e9743f95b7528d34b2bace20ad3c8c15748bc4238c7bf5931d3d13a9418 not found: ID does not exist"
Jul 02 23:06:04.749564 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.749542    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d596c64-sl8vt"]
Jul 02 23:06:04.755548 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:04.755526    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664d596c64-sl8vt"]
Jul 02 23:06:05.619360 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:05.619329    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ea633c4-3dbb-4a37-9199-2d0cc0426f33" path="/var/lib/kubelet/pods/4ea633c4-3dbb-4a37-9199-2d0cc0426f33/volumes"
Jul 02 23:06:33.488353 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:33.488318    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:06:33.492748 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:33.492392    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:06:33.493613 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:33.493592    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 23:06:58.556072 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.555990    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xkc5x"]
Jul 02 23:06:58.558267 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.556313    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea633c4-3dbb-4a37-9199-2d0cc0426f33" containerName="console"
Jul 02 23:06:58.558267 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.556327    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea633c4-3dbb-4a37-9199-2d0cc0426f33" containerName="console"
Jul 02 23:06:58.558267 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.556396    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea633c4-3dbb-4a37-9199-2d0cc0426f33" containerName="console"
Jul 02 23:06:58.558926 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.558908    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.561384 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.561347    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 23:06:58.561384 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.561351    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 23:06:58.562172 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.562153    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9vfws\""
Jul 02 23:06:58.566703 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.566677    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xkc5x"]
Jul 02 23:06:58.580938 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.580911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-456zv\" (UniqueName: \"kubernetes.io/projected/86add0ca-2bfb-483f-bf83-f988e08e250a-kube-api-access-456zv\") pod \"cert-manager-55b4d954d5-xkc5x\" (UID: \"86add0ca-2bfb-483f-bf83-f988e08e250a\") " pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.581036 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.580947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86add0ca-2bfb-483f-bf83-f988e08e250a-bound-sa-token\") pod \"cert-manager-55b4d954d5-xkc5x\" (UID: \"86add0ca-2bfb-483f-bf83-f988e08e250a\") " pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.681374 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.681346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86add0ca-2bfb-483f-bf83-f988e08e250a-bound-sa-token\") pod \"cert-manager-55b4d954d5-xkc5x\" (UID: \"86add0ca-2bfb-483f-bf83-f988e08e250a\") " pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.681484 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.681416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-456zv\" (UniqueName: \"kubernetes.io/projected/86add0ca-2bfb-483f-bf83-f988e08e250a-kube-api-access-456zv\") pod \"cert-manager-55b4d954d5-xkc5x\" (UID: \"86add0ca-2bfb-483f-bf83-f988e08e250a\") " pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.689395 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.689367    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86add0ca-2bfb-483f-bf83-f988e08e250a-bound-sa-token\") pod \"cert-manager-55b4d954d5-xkc5x\" (UID: \"86add0ca-2bfb-483f-bf83-f988e08e250a\") " pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.689718 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.689697    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-456zv\" (UniqueName: \"kubernetes.io/projected/86add0ca-2bfb-483f-bf83-f988e08e250a-kube-api-access-456zv\") pod \"cert-manager-55b4d954d5-xkc5x\" (UID: \"86add0ca-2bfb-483f-bf83-f988e08e250a\") " pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.869602 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.869530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xkc5x"
Jul 02 23:06:58.997607 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:58.997556    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xkc5x"]
Jul 02 23:06:58.999701 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:06:58.999665    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86add0ca_2bfb_483f_bf83_f988e08e250a.slice/crio-bb2cb90ff0c6541b6be69727d50723007a39c1e96ff703a3109383a3053d24bb WatchSource:0}: Error finding container bb2cb90ff0c6541b6be69727d50723007a39c1e96ff703a3109383a3053d24bb: Status 404 returned error can't find the container with id bb2cb90ff0c6541b6be69727d50723007a39c1e96ff703a3109383a3053d24bb
Jul 02 23:06:59.001635 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:59.001620    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:06:59.921500 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:06:59.921464    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xkc5x" event={"ID":"86add0ca-2bfb-483f-bf83-f988e08e250a","Type":"ContainerStarted","Data":"bb2cb90ff0c6541b6be69727d50723007a39c1e96ff703a3109383a3053d24bb"}
Jul 02 23:07:00.838435 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.838401    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"]
Jul 02 23:07:00.842814 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.842792    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:00.845209 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.845170    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 23:07:00.846110 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.846093    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:07:00.846110 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.846103    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zrzz2\""
Jul 02 23:07:00.849266 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.849244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"]
Jul 02 23:07:00.896073 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.896036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpbp4\" (UniqueName: \"kubernetes.io/projected/adbcd450-8787-4f40-8246-361512dadfe6-kube-api-access-hpbp4\") pod \"openshift-lws-operator-fd8ccff4c-6mgn8\" (UID: \"adbcd450-8787-4f40-8246-361512dadfe6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:00.896197 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.896101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adbcd450-8787-4f40-8246-361512dadfe6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6mgn8\" (UID: \"adbcd450-8787-4f40-8246-361512dadfe6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:00.996720 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.996685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adbcd450-8787-4f40-8246-361512dadfe6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6mgn8\" (UID: \"adbcd450-8787-4f40-8246-361512dadfe6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:00.997116 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.996771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpbp4\" (UniqueName: \"kubernetes.io/projected/adbcd450-8787-4f40-8246-361512dadfe6-kube-api-access-hpbp4\") pod \"openshift-lws-operator-fd8ccff4c-6mgn8\" (UID: \"adbcd450-8787-4f40-8246-361512dadfe6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:00.997116 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:00.997082    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adbcd450-8787-4f40-8246-361512dadfe6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6mgn8\" (UID: \"adbcd450-8787-4f40-8246-361512dadfe6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:01.007892 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:01.007866    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpbp4\" (UniqueName: \"kubernetes.io/projected/adbcd450-8787-4f40-8246-361512dadfe6-kube-api-access-hpbp4\") pod \"openshift-lws-operator-fd8ccff4c-6mgn8\" (UID: \"adbcd450-8787-4f40-8246-361512dadfe6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:01.154300 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:01.154234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"
Jul 02 23:07:02.081961 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:02.081936    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8"]
Jul 02 23:07:02.083908 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:07:02.083885    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadbcd450_8787_4f40_8246_361512dadfe6.slice/crio-c9e6124bf292d6378fbfc6f61353b68c99ad15bda956aff6719970224100866b WatchSource:0}: Error finding container c9e6124bf292d6378fbfc6f61353b68c99ad15bda956aff6719970224100866b: Status 404 returned error can't find the container with id c9e6124bf292d6378fbfc6f61353b68c99ad15bda956aff6719970224100866b
Jul 02 23:07:02.935830 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:02.935769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xkc5x" event={"ID":"86add0ca-2bfb-483f-bf83-f988e08e250a","Type":"ContainerStarted","Data":"04d01766c96024d3fc733b799a291a0badeb54c620f2d3124a9f141f6c6138f3"}
Jul 02 23:07:02.937947 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:02.937902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8" event={"ID":"adbcd450-8787-4f40-8246-361512dadfe6","Type":"ContainerStarted","Data":"c9e6124bf292d6378fbfc6f61353b68c99ad15bda956aff6719970224100866b"}
Jul 02 23:07:02.953595 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:02.953520    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xkc5x" podStartSLOduration=1.920588053 podStartE2EDuration="4.953499381s" totalImagesPullingTime="3.032911328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:02.951573716 +0000 UTC m=+329.888623025" watchObservedRunningTime="2026-07-02 23:07:02.953499381 +0000 UTC m=+329.890548699"
Jul 02 23:07:04.947813 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:04.947739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8" event={"ID":"adbcd450-8787-4f40-8246-361512dadfe6","Type":"ContainerStarted","Data":"015f5172cffd9185e3e01a697dfcd8671f84a5774d6e963fe2a89db6c030ca70"}
Jul 02 23:07:04.963201 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:04.963152    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6mgn8" podStartSLOduration=2.51215304 podStartE2EDuration="4.963137511s" totalImagesPullingTime="2.450984471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:04.96221736 +0000 UTC m=+331.899266662" watchObservedRunningTime="2026-07-02 23:07:04.963137511 +0000 UTC m=+331.900186820"
Jul 02 23:07:20.685703 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.685672    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"]
Jul 02 23:07:20.688877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.688861    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.691376 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.691356    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 23:07:20.692108 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.692078    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tznn6\""
Jul 02 23:07:20.692262 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.692244    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 23:07:20.692328 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.692312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 23:07:20.692386 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.692312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 23:07:20.704835 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.704813    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"]
Jul 02 23:07:20.722626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.722605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-manifests\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.722721 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.722669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-webhook-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.722721 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.722714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.722862 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.722763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-tmp\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.722862 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.722849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzf7t\" (UniqueName: \"kubernetes.io/projected/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-kube-api-access-pzf7t\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.823114 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.823089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzf7t\" (UniqueName: \"kubernetes.io/projected/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-kube-api-access-pzf7t\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.823208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.823127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-manifests\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.823208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.823152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-webhook-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.823208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.823183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.823322 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.823216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-tmp\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.823547 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.823529    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-manifests\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.825491 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.825468    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-tmp\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.825588 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.825563    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-webhook-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.825713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.825693    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.830856 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.830838    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzf7t\" (UniqueName: \"kubernetes.io/projected/3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7-kube-api-access-pzf7t\") pod \"opendatahub-operator-controller-manager-676b9dcdc-6srp8\" (UID: \"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7\") " pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:20.999131 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:20.999075    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:21.129677 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:21.129649    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"]
Jul 02 23:07:21.132945 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:07:21.132921    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a29a2fa_74c2_4b11_95ed_ecd5683a5ea7.slice/crio-58c4a5c8ee7023a14ebace3f3f94f7f4b425001633400eecf660ae104eab9f8c WatchSource:0}: Error finding container 58c4a5c8ee7023a14ebace3f3f94f7f4b425001633400eecf660ae104eab9f8c: Status 404 returned error can't find the container with id 58c4a5c8ee7023a14ebace3f3f94f7f4b425001633400eecf660ae104eab9f8c
Jul 02 23:07:22.015447 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:22.015415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8" event={"ID":"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7","Type":"ContainerStarted","Data":"58c4a5c8ee7023a14ebace3f3f94f7f4b425001633400eecf660ae104eab9f8c"}
Jul 02 23:07:25.030295 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:25.030253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8" event={"ID":"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7","Type":"ContainerStarted","Data":"6972428ce0a96f190e9e8222b26bdbe4dd856ba851788b869dc88140def2c25c"}
Jul 02 23:07:26.035159 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:26.035122    2575 generic.go:356] "Generic (PLEG): container finished" podID="3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7" containerID="6972428ce0a96f190e9e8222b26bdbe4dd856ba851788b869dc88140def2c25c" exitCode=0
Jul 02 23:07:26.035542 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:26.035216    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8" event={"ID":"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7","Type":"ContainerDied","Data":"6972428ce0a96f190e9e8222b26bdbe4dd856ba851788b869dc88140def2c25c"}
Jul 02 23:07:27.041239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:27.041196    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8" event={"ID":"3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7","Type":"ContainerStarted","Data":"d344cfa149dacc70e40a52f101a05e21e2545d5a5cfe3abeec4b9fe8388efe0f"}
Jul 02 23:07:27.041635 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:27.041303    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:27.065608 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:27.065554    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8" podStartSLOduration=2.710230106 podStartE2EDuration="7.065535736s" totalImagesPullingTime="3.322954067s" totalInitContainerRuntime="1.032351563s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:27.063399472 +0000 UTC m=+354.000448780" watchObservedRunningTime="2026-07-02 23:07:27.065535736 +0000 UTC m=+354.002585043"
Jul 02 23:07:38.046496 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:38.046470    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-676b9dcdc-6srp8"
Jul 02 23:07:40.708922 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.708891    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"]
Jul 02 23:07:40.722402 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.722380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.725519 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.725499    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 23:07:40.726863 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.726845    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 23:07:40.726972 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.726863    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 23:07:40.726972 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.726899    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 23:07:40.727254 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.727236    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t8vmt\""
Jul 02 23:07:40.729559 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.729538    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"]
Jul 02 23:07:40.754517 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.754491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-tmp\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.754594 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.754532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-tls-certs\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.754594 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.754548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwc5\" (UniqueName: \"kubernetes.io/projected/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-kube-api-access-wpwc5\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.854850 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.854827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-tls-certs\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.854972 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.854855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwc5\" (UniqueName: \"kubernetes.io/projected/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-kube-api-access-wpwc5\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.854972 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.854902    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-tmp\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.857171 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.857149    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-tmp\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.857308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.857289    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-tls-certs\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:40.863843 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:40.863821    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwc5\" (UniqueName: \"kubernetes.io/projected/c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84-kube-api-access-wpwc5\") pod \"kube-auth-proxy-99946bbb8-m9zfj\" (UID: \"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84\") " pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:41.032544 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.032526    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"
Jul 02 23:07:41.157317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.157289    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj"]
Jul 02 23:07:41.160588 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:07:41.160551    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bfb0fb_b7d9_45d9_b8a1_7fb1a6005e84.slice/crio-e56828246618f270991139b01c3a65866eac43ea671f1ce3eb7485a0d910259d WatchSource:0}: Error finding container e56828246618f270991139b01c3a65866eac43ea671f1ce3eb7485a0d910259d: Status 404 returned error can't find the container with id e56828246618f270991139b01c3a65866eac43ea671f1ce3eb7485a0d910259d
Jul 02 23:07:41.495295 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.495230    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q7xjc"]
Jul 02 23:07:41.498476 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.498458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.500915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.500892    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hn6qc\""
Jul 02 23:07:41.501215 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.501194    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 02 23:07:41.513625 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.513606    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q7xjc"]
Jul 02 23:07:41.560178 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.560150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0934ce68-7e2b-4e91-adbe-5486cc3c8d58-tls-certs\") pod \"model-serving-api-54d89bd5fc-q7xjc\" (UID: \"0934ce68-7e2b-4e91-adbe-5486cc3c8d58\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.560272 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.560186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4crq\" (UniqueName: \"kubernetes.io/projected/0934ce68-7e2b-4e91-adbe-5486cc3c8d58-kube-api-access-f4crq\") pod \"model-serving-api-54d89bd5fc-q7xjc\" (UID: \"0934ce68-7e2b-4e91-adbe-5486cc3c8d58\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.660951 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.660929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0934ce68-7e2b-4e91-adbe-5486cc3c8d58-tls-certs\") pod \"model-serving-api-54d89bd5fc-q7xjc\" (UID: \"0934ce68-7e2b-4e91-adbe-5486cc3c8d58\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.661067 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.660983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4crq\" (UniqueName: \"kubernetes.io/projected/0934ce68-7e2b-4e91-adbe-5486cc3c8d58-kube-api-access-f4crq\") pod \"model-serving-api-54d89bd5fc-q7xjc\" (UID: \"0934ce68-7e2b-4e91-adbe-5486cc3c8d58\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.663239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.663222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0934ce68-7e2b-4e91-adbe-5486cc3c8d58-tls-certs\") pod \"model-serving-api-54d89bd5fc-q7xjc\" (UID: \"0934ce68-7e2b-4e91-adbe-5486cc3c8d58\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.683246 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.683219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4crq\" (UniqueName: \"kubernetes.io/projected/0934ce68-7e2b-4e91-adbe-5486cc3c8d58-kube-api-access-f4crq\") pod \"model-serving-api-54d89bd5fc-q7xjc\" (UID: \"0934ce68-7e2b-4e91-adbe-5486cc3c8d58\") " pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.810950 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.810924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:41.945400 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.945368    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q7xjc"]
Jul 02 23:07:41.949120 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:07:41.949091    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0934ce68_7e2b_4e91_adbe_5486cc3c8d58.slice/crio-4a65fcf149ea8a170d2711f27c5523a254b010a71d09b716e14f32fb89c1a4d8 WatchSource:0}: Error finding container 4a65fcf149ea8a170d2711f27c5523a254b010a71d09b716e14f32fb89c1a4d8: Status 404 returned error can't find the container with id 4a65fcf149ea8a170d2711f27c5523a254b010a71d09b716e14f32fb89c1a4d8
Jul 02 23:07:41.962729 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.962706    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"]
Jul 02 23:07:41.965303 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.965283    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:41.967746 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.967725    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dhmg8\""
Jul 02 23:07:41.967929 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.967908    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 23:07:41.967987 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.967741    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 23:07:41.968094 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.968005    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 23:07:41.968371 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.968319    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 23:07:41.978107 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:41.978045    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"]
Jul 02 23:07:42.064612 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.064556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-cacerts\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.064612 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.064590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.064766 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.064642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-local-certs\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.064766 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.064697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.064870 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.064781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.064870 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.064803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-token\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.064870 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.064822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4svx\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-kube-api-access-s4svx\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.102764 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.102735    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc" event={"ID":"0934ce68-7e2b-4e91-adbe-5486cc3c8d58","Type":"ContainerStarted","Data":"4a65fcf149ea8a170d2711f27c5523a254b010a71d09b716e14f32fb89c1a4d8"}
Jul 02 23:07:42.104099 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.104039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj" event={"ID":"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84","Type":"ContainerStarted","Data":"e56828246618f270991139b01c3a65866eac43ea671f1ce3eb7485a0d910259d"}
Jul 02 23:07:42.165897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.165875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.165992 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.165905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-token\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.165992 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.165923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4svx\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-kube-api-access-s4svx\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.165992 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.165949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-cacerts\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.165992 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.165972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.166206 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.166021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-local-certs\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.166206 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.166069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.166597 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.166579    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.168565 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.168541    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.168742 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.168720    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.168807 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.168731    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-local-certs\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.168807 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.168759    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-cacerts\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.174641 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.174620    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-token\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.175139 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.175117    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4svx\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-kube-api-access-s4svx\") pod \"istiod-openshift-gateway-7574459656-5d22m\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.276175 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.276148    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:42.415778 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:42.415749    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"]
Jul 02 23:07:42.418780 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:07:42.418748    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb597a85b_1fcf_4501_a1ae_9b8dfd6bcab8.slice/crio-17cfc7fcd982891ef7ca710488c67fb1677e1f6019b4cf89590a11f0afb70124 WatchSource:0}: Error finding container 17cfc7fcd982891ef7ca710488c67fb1677e1f6019b4cf89590a11f0afb70124: Status 404 returned error can't find the container with id 17cfc7fcd982891ef7ca710488c67fb1677e1f6019b4cf89590a11f0afb70124
Jul 02 23:07:43.110107 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:43.110074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" event={"ID":"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8","Type":"ContainerStarted","Data":"17cfc7fcd982891ef7ca710488c67fb1677e1f6019b4cf89590a11f0afb70124"}
Jul 02 23:07:45.491005 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:45.490963    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:07:45.491368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:45.491045    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:07:46.124461 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.124417    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj" event={"ID":"c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84","Type":"ContainerStarted","Data":"1c73ab43271b70b3b81b6257506c2ea75c13bd1fae2617dc6d32f2ae4159265d"}
Jul 02 23:07:46.125936 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.125904    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" event={"ID":"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8","Type":"ContainerStarted","Data":"6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537"}
Jul 02 23:07:46.126078 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.125957    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:46.127596 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.127573    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5d22m container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:07:46.127716 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.127622    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" podUID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:07:46.127716 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.127632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc" event={"ID":"0934ce68-7e2b-4e91-adbe-5486cc3c8d58","Type":"ContainerStarted","Data":"d9dcfc644e01db6cbec22e73d2f33b45d68c61fe70354ab9ad27957e758922b1"}
Jul 02 23:07:46.127716 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.127707    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:46.142726 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.142684    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-99946bbb8-m9zfj" podStartSLOduration=1.875896075 podStartE2EDuration="6.142670561s" totalImagesPullingTime="4.266774486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:46.142239881 +0000 UTC m=+373.079289191" watchObservedRunningTime="2026-07-02 23:07:46.142670561 +0000 UTC m=+373.079719874"
Jul 02 23:07:46.164191 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.164140    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc" podStartSLOduration=1.683437946 podStartE2EDuration="5.164123579s" totalImagesPullingTime="3.480685633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:46.162507626 +0000 UTC m=+373.099556933" watchObservedRunningTime="2026-07-02 23:07:46.164123579 +0000 UTC m=+373.101172889"
Jul 02 23:07:46.183073 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:46.183004    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" podStartSLOduration=2.113146761 podStartE2EDuration="5.182987355s" totalImagesPullingTime="3.069840594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:46.181045612 +0000 UTC m=+373.118095137" watchObservedRunningTime="2026-07-02 23:07:46.182987355 +0000 UTC m=+373.120036668"
Jul 02 23:07:47.132382 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:47.132354    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5d22m container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:07:47.132737 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:47.132402    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" podUID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:07:50.133453 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:50.133418    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:51.093927 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.093895    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"]
Jul 02 23:07:51.097020 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.097000    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:51.099582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.099552    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"]
Jul 02 23:07:51.101446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.101422    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 02 23:07:51.101759 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.101737    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4tznn\""
Jul 02 23:07:51.102734 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.102715    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.106849 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.106831    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-25v5p\""
Jul 02 23:07:51.107040 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.107026    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 02 23:07:51.114973 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.114953    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"]
Jul 02 23:07:51.135711 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.135690    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"]
Jul 02 23:07:51.136044 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.136014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-t2xcs\" (UID: \"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:51.136044 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.136072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9lp6\" (UniqueName: \"kubernetes.io/projected/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-kube-api-access-p9lp6\") pod \"kserve-controller-manager-d6f4b65b8-t2xcs\" (UID: \"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:51.136244 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.136118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6375ea3d-7681-47f8-a405-3f6920eced12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6cq4b\" (UID: \"6375ea3d-7681-47f8-a405-3f6920eced12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.136244 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.136206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hxkh\" (UniqueName: \"kubernetes.io/projected/6375ea3d-7681-47f8-a405-3f6920eced12-kube-api-access-8hxkh\") pod \"llmisvc-controller-manager-777c6bd7d5-6cq4b\" (UID: \"6375ea3d-7681-47f8-a405-3f6920eced12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.237561 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.237502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hxkh\" (UniqueName: \"kubernetes.io/projected/6375ea3d-7681-47f8-a405-3f6920eced12-kube-api-access-8hxkh\") pod \"llmisvc-controller-manager-777c6bd7d5-6cq4b\" (UID: \"6375ea3d-7681-47f8-a405-3f6920eced12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.237707 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.237646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-t2xcs\" (UID: \"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:51.237707 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.237683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9lp6\" (UniqueName: \"kubernetes.io/projected/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-kube-api-access-p9lp6\") pod \"kserve-controller-manager-d6f4b65b8-t2xcs\" (UID: \"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:51.237819 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.237708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6375ea3d-7681-47f8-a405-3f6920eced12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6cq4b\" (UID: \"6375ea3d-7681-47f8-a405-3f6920eced12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.237819 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:07:51.237766    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 02 23:07:51.237912 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:07:51.237854    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-cert podName:9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a nodeName:}" failed. No retries permitted until 2026-07-02 23:07:51.73783405 +0000 UTC m=+378.674883349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-cert") pod "kserve-controller-manager-d6f4b65b8-t2xcs" (UID: "9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a") : secret "kserve-webhook-server-cert" not found
Jul 02 23:07:51.240247 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.240226    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6375ea3d-7681-47f8-a405-3f6920eced12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6cq4b\" (UID: \"6375ea3d-7681-47f8-a405-3f6920eced12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.268394 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.268373    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hxkh\" (UniqueName: \"kubernetes.io/projected/6375ea3d-7681-47f8-a405-3f6920eced12-kube-api-access-8hxkh\") pod \"llmisvc-controller-manager-777c6bd7d5-6cq4b\" (UID: \"6375ea3d-7681-47f8-a405-3f6920eced12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.274110 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.274088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9lp6\" (UniqueName: \"kubernetes.io/projected/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-kube-api-access-p9lp6\") pod \"kserve-controller-manager-d6f4b65b8-t2xcs\" (UID: \"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:51.416993 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.416946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:51.541141 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.541117    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"]
Jul 02 23:07:51.543457 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:07:51.543428    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6375ea3d_7681_47f8_a405_3f6920eced12.slice/crio-0cf51862ff6c7a6a4646270a96d6621f77a924c82cc93f0e75d0f9a7df2a052b WatchSource:0}: Error finding container 0cf51862ff6c7a6a4646270a96d6621f77a924c82cc93f0e75d0f9a7df2a052b: Status 404 returned error can't find the container with id 0cf51862ff6c7a6a4646270a96d6621f77a924c82cc93f0e75d0f9a7df2a052b
Jul 02 23:07:51.741079 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.741014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-t2xcs\" (UID: \"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:51.743226 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:51.743202    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-t2xcs\" (UID: \"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:52.010485 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:52.010457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:52.153474 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:52.153361    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"]
Jul 02 23:07:52.155915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:52.155879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b" event={"ID":"6375ea3d-7681-47f8-a405-3f6920eced12","Type":"ContainerStarted","Data":"0cf51862ff6c7a6a4646270a96d6621f77a924c82cc93f0e75d0f9a7df2a052b"}
Jul 02 23:07:52.173106 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:07:52.173081    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4b6ce8_f4f9_4322_a5c5_be3dd3e8e44a.slice/crio-67879d7c695d11e6bd3f1064fdc2e3295fce2feb4c740472f0cbc76b7a8141dc WatchSource:0}: Error finding container 67879d7c695d11e6bd3f1064fdc2e3295fce2feb4c740472f0cbc76b7a8141dc: Status 404 returned error can't find the container with id 67879d7c695d11e6bd3f1064fdc2e3295fce2feb4c740472f0cbc76b7a8141dc
Jul 02 23:07:53.162524 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:53.162479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs" event={"ID":"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a","Type":"ContainerStarted","Data":"67879d7c695d11e6bd3f1064fdc2e3295fce2feb4c740472f0cbc76b7a8141dc"}
Jul 02 23:07:54.809193 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:54.809131    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"]
Jul 02 23:07:54.809621 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:54.809398    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" podUID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" containerName="discovery" containerID="cri-o://6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537" gracePeriod=30
Jul 02 23:07:55.621695 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.621674    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:55.671737 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.671717    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-token\") pod \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") "
Jul 02 23:07:55.671830 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.671759    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-cacerts\") pod \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") "
Jul 02 23:07:55.671830 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.671796    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4svx\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-kube-api-access-s4svx\") pod \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") "
Jul 02 23:07:55.671830 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.671826    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-local-certs\") pod \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") "
Jul 02 23:07:55.671979 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.671844    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-dns-cert\") pod \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") "
Jul 02 23:07:55.671979 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.671858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-kubeconfig\") pod \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") "
Jul 02 23:07:55.672160 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.671977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-ca-configmap\") pod \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\" (UID: \"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8\") "
Jul 02 23:07:55.672703 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.672677    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" (UID: "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:07:55.674120 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.674092    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-local-certs" (OuterVolumeSpecName: "local-certs") pod "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" (UID: "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:07:55.674219 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.674188    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-token" (OuterVolumeSpecName: "istio-token") pod "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" (UID: "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:07:55.674321 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.674296    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-kube-api-access-s4svx" (OuterVolumeSpecName: "kube-api-access-s4svx") pod "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" (UID: "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8"). InnerVolumeSpecName "kube-api-access-s4svx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:07:55.674498 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.674479    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" (UID: "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:07:55.674575 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.674493    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-cacerts" (OuterVolumeSpecName: "cacerts") pod "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" (UID: "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:07:55.674664 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.674646    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" (UID: "b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:07:55.773162 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.773136    2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-cacerts\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:07:55.773162 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.773161    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4svx\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-kube-api-access-s4svx\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:07:55.773324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.773175    2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-local-certs\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:07:55.773324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.773187    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-dns-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:07:55.773324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.773199    2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-kubeconfig\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:07:55.773324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.773213    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-csr-ca-configmap\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:07:55.773324 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:55.773225    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8-istio-token\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:07:56.177771 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.177734    2575 generic.go:356] "Generic (PLEG): container finished" podID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" containerID="6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537" exitCode=0
Jul 02 23:07:56.178226 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.177787    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"
Jul 02 23:07:56.178226 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.177820    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" event={"ID":"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8","Type":"ContainerDied","Data":"6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537"}
Jul 02 23:07:56.178226 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.177873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5d22m" event={"ID":"b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8","Type":"ContainerDied","Data":"17cfc7fcd982891ef7ca710488c67fb1677e1f6019b4cf89590a11f0afb70124"}
Jul 02 23:07:56.178226 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.177903    2575 scope.go:117] "RemoveContainer" containerID="6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537"
Jul 02 23:07:56.179754 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.179730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b" event={"ID":"6375ea3d-7681-47f8-a405-3f6920eced12","Type":"ContainerStarted","Data":"a012b85d5199037787d8146ddb4c502f1eee6af3f5398bc417d543239335b35f"}
Jul 02 23:07:56.179902 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.179883    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:07:56.181636 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.181612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs" event={"ID":"9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a","Type":"ContainerStarted","Data":"6873df400f0bf921f7ae04856290cff9d85f52d4cc5286000a3f42b09b953dc7"}
Jul 02 23:07:56.182006 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.181987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:07:56.187702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.187677    2575 scope.go:117] "RemoveContainer" containerID="6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537"
Jul 02 23:07:56.187953 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:07:56.187934    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537\": container with ID starting with 6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537 not found: ID does not exist" containerID="6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537"
Jul 02 23:07:56.188026 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.187967    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537"} err="failed to get container status \"6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537\": rpc error: code = NotFound desc = could not find container \"6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537\": container with ID starting with 6331df816e4355d529631f80076c1e687221b15f4288f27674d0a2e899658537 not found: ID does not exist"
Jul 02 23:07:56.198022 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.197980    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs" podStartSLOduration=1.862974972 podStartE2EDuration="5.197967053s" totalImagesPullingTime="3.334992081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:56.197418406 +0000 UTC m=+383.134467716" watchObservedRunningTime="2026-07-02 23:07:56.197967053 +0000 UTC m=+383.135016384"
Jul 02 23:07:56.217202 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.217160    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b" podStartSLOduration=1.247143334 podStartE2EDuration="5.217146566s" totalImagesPullingTime="3.970003232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:56.215454596 +0000 UTC m=+383.152503902" watchObservedRunningTime="2026-07-02 23:07:56.217146566 +0000 UTC m=+383.154195873"
Jul 02 23:07:56.238728 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.238706    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"]
Jul 02 23:07:56.244877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:56.244858    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5d22m"]
Jul 02 23:07:57.135976 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:57.135944    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-q7xjc"
Jul 02 23:07:57.620354 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:07:57.620319    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" path="/var/lib/kubelet/pods/b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8/volumes"
Jul 02 23:08:27.188910 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:27.188878    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6cq4b"
Jul 02 23:08:28.195556 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:28.195520    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-t2xcs"
Jul 02 23:08:41.140916 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.140882    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ms7sz"]
Jul 02 23:08:41.141317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.141225    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" containerName="discovery"
Jul 02 23:08:41.141317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.141240    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" containerName="discovery"
Jul 02 23:08:41.141317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.141311    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b597a85b-1fcf-4501-a1ae-9b8dfd6bcab8" containerName="discovery"
Jul 02 23:08:41.144453 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.144432    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz"
Jul 02 23:08:41.146989 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.146967    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 23:08:41.147798 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.147774    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ggjmw\""
Jul 02 23:08:41.147980 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.147958    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 23:08:41.153391 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.153367    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ms7sz"]
Jul 02 23:08:41.295460 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.295436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-562lk\" (UniqueName: \"kubernetes.io/projected/82f07812-2c15-4b77-a4d4-ef842a11025e-kube-api-access-562lk\") pod \"kuadrant-operator-catalog-ms7sz\" (UID: \"82f07812-2c15-4b77-a4d4-ef842a11025e\") " pod="kuadrant-system/kuadrant-operator-catalog-ms7sz"
Jul 02 23:08:41.396395 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.396335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-562lk\" (UniqueName: \"kubernetes.io/projected/82f07812-2c15-4b77-a4d4-ef842a11025e-kube-api-access-562lk\") pod \"kuadrant-operator-catalog-ms7sz\" (UID: \"82f07812-2c15-4b77-a4d4-ef842a11025e\") " pod="kuadrant-system/kuadrant-operator-catalog-ms7sz"
Jul 02 23:08:41.404744 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.404716    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-562lk\" (UniqueName: \"kubernetes.io/projected/82f07812-2c15-4b77-a4d4-ef842a11025e-kube-api-access-562lk\") pod \"kuadrant-operator-catalog-ms7sz\" (UID: \"82f07812-2c15-4b77-a4d4-ef842a11025e\") " pod="kuadrant-system/kuadrant-operator-catalog-ms7sz"
Jul 02 23:08:41.455780 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.455752    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz"
Jul 02 23:08:41.523891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.521693    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ms7sz"]
Jul 02 23:08:41.609881 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.604310    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ms7sz"]
Jul 02 23:08:41.714408 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.714344    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-btwcf"]
Jul 02 23:08:41.717040 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.717021    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:41.725069 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.725033    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-btwcf"]
Jul 02 23:08:41.799125 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.799099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxjvr\" (UniqueName: \"kubernetes.io/projected/dafd16ca-7eda-49cb-8c67-990da6a7bd0b-kube-api-access-mxjvr\") pod \"kuadrant-operator-catalog-btwcf\" (UID: \"dafd16ca-7eda-49cb-8c67-990da6a7bd0b\") " pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:41.899911 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.899886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxjvr\" (UniqueName: \"kubernetes.io/projected/dafd16ca-7eda-49cb-8c67-990da6a7bd0b-kube-api-access-mxjvr\") pod \"kuadrant-operator-catalog-btwcf\" (UID: \"dafd16ca-7eda-49cb-8c67-990da6a7bd0b\") " pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:41.909474 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:41.909452    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxjvr\" (UniqueName: \"kubernetes.io/projected/dafd16ca-7eda-49cb-8c67-990da6a7bd0b-kube-api-access-mxjvr\") pod \"kuadrant-operator-catalog-btwcf\" (UID: \"dafd16ca-7eda-49cb-8c67-990da6a7bd0b\") " pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:42.026566 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:42.026536    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:42.145499 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:42.145478    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-btwcf"]
Jul 02 23:08:42.147128 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:08:42.147099    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafd16ca_7eda_49cb_8c67_990da6a7bd0b.slice/crio-246479351f4b8a49d4d1bb4dd5fa0c5e68bb79d3b1c42902521400757e725159 WatchSource:0}: Error finding container 246479351f4b8a49d4d1bb4dd5fa0c5e68bb79d3b1c42902521400757e725159: Status 404 returned error can't find the container with id 246479351f4b8a49d4d1bb4dd5fa0c5e68bb79d3b1c42902521400757e725159
Jul 02 23:08:42.375548 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:42.375463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-btwcf" event={"ID":"dafd16ca-7eda-49cb-8c67-990da6a7bd0b","Type":"ContainerStarted","Data":"246479351f4b8a49d4d1bb4dd5fa0c5e68bb79d3b1c42902521400757e725159"}
Jul 02 23:08:42.376746 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:42.376717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz" event={"ID":"82f07812-2c15-4b77-a4d4-ef842a11025e","Type":"ContainerStarted","Data":"0f7ba9a3beda6073728a0d57ee373cdc6b2d2b87682c17a9188f64a67eb662da"}
Jul 02 23:08:44.389768 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.389724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-btwcf" event={"ID":"dafd16ca-7eda-49cb-8c67-990da6a7bd0b","Type":"ContainerStarted","Data":"a92d67c794813b94563fb53610c95a7f68dd6d54d845b79a2e6ce5ffde047538"}
Jul 02 23:08:44.391479 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.391450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz" event={"ID":"82f07812-2c15-4b77-a4d4-ef842a11025e","Type":"ContainerStarted","Data":"7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5"}
Jul 02 23:08:44.391605 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.391513    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz" podUID="82f07812-2c15-4b77-a4d4-ef842a11025e" containerName="registry-server" containerID="cri-o://7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5" gracePeriod=2
Jul 02 23:08:44.405727 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.405676    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-btwcf" podStartSLOduration=1.836784574 podStartE2EDuration="3.405659843s" totalImagesPullingTime="1.568875269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:44.404375442 +0000 UTC m=+431.341424750" watchObservedRunningTime="2026-07-02 23:08:44.405659843 +0000 UTC m=+431.342709149"
Jul 02 23:08:44.418437 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.418392    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz" podStartSLOduration=1.314140527 podStartE2EDuration="3.418379007s" totalImagesPullingTime="2.10423848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:44.418038051 +0000 UTC m=+431.355087358" watchObservedRunningTime="2026-07-02 23:08:44.418379007 +0000 UTC m=+431.355428314"
Jul 02 23:08:44.632068 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.632022    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz"
Jul 02 23:08:44.721747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.721693    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-562lk\" (UniqueName: \"kubernetes.io/projected/82f07812-2c15-4b77-a4d4-ef842a11025e-kube-api-access-562lk\") pod \"82f07812-2c15-4b77-a4d4-ef842a11025e\" (UID: \"82f07812-2c15-4b77-a4d4-ef842a11025e\") "
Jul 02 23:08:44.723732 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.723693    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f07812-2c15-4b77-a4d4-ef842a11025e-kube-api-access-562lk" (OuterVolumeSpecName: "kube-api-access-562lk") pod "82f07812-2c15-4b77-a4d4-ef842a11025e" (UID: "82f07812-2c15-4b77-a4d4-ef842a11025e"). InnerVolumeSpecName "kube-api-access-562lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:08:44.822203 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:44.822184    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-562lk\" (UniqueName: \"kubernetes.io/projected/82f07812-2c15-4b77-a4d4-ef842a11025e-kube-api-access-562lk\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:08:45.397393 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.397353    2575 generic.go:356] "Generic (PLEG): container finished" podID="82f07812-2c15-4b77-a4d4-ef842a11025e" containerID="7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5" exitCode=0
Jul 02 23:08:45.397860 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.397413    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz"
Jul 02 23:08:45.397860 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.397452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz" event={"ID":"82f07812-2c15-4b77-a4d4-ef842a11025e","Type":"ContainerDied","Data":"7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5"}
Jul 02 23:08:45.397860 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.397536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ms7sz" event={"ID":"82f07812-2c15-4b77-a4d4-ef842a11025e","Type":"ContainerDied","Data":"0f7ba9a3beda6073728a0d57ee373cdc6b2d2b87682c17a9188f64a67eb662da"}
Jul 02 23:08:45.397860 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.397579    2575 scope.go:117] "RemoveContainer" containerID="7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5"
Jul 02 23:08:45.408473 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.408457    2575 scope.go:117] "RemoveContainer" containerID="7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5"
Jul 02 23:08:45.408758 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:08:45.408736    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5\": container with ID starting with 7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5 not found: ID does not exist" containerID="7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5"
Jul 02 23:08:45.408810 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.408767    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5"} err="failed to get container status \"7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5\": rpc error: code = NotFound desc = could not find container \"7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5\": container with ID starting with 7edefebc60cb04c5dda228dcf0b58ef62744987f0df588faf226bbcf916d73a5 not found: ID does not exist"
Jul 02 23:08:45.418998 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.418978    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ms7sz"]
Jul 02 23:08:45.422252 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.422230    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ms7sz"]
Jul 02 23:08:45.620697 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:45.620668    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82f07812-2c15-4b77-a4d4-ef842a11025e" path="/var/lib/kubelet/pods/82f07812-2c15-4b77-a4d4-ef842a11025e/volumes"
Jul 02 23:08:52.027603 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:52.027568    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:52.027956 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:52.027638    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:52.048848 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:52.048824    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:08:52.455449 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:08:52.455358    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-btwcf"
Jul 02 23:09:12.769782 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.769690    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"]
Jul 02 23:09:12.770288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.770018    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f07812-2c15-4b77-a4d4-ef842a11025e" containerName="registry-server"
Jul 02 23:09:12.770288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.770030    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f07812-2c15-4b77-a4d4-ef842a11025e" containerName="registry-server"
Jul 02 23:09:12.770288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.770119    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f07812-2c15-4b77-a4d4-ef842a11025e" containerName="registry-server"
Jul 02 23:09:12.773123 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.773098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"
Jul 02 23:09:12.775693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.775664    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tszvv\""
Jul 02 23:09:12.775844 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.775831    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 02 23:09:12.787031 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.787008    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"]
Jul 02 23:09:12.910609 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:12.910581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrpj\" (UniqueName: \"kubernetes.io/projected/a0fc777e-5996-498d-ab57-cfa42e031282-kube-api-access-cdrpj\") pod \"dns-operator-controller-manager-864dd78c4c-g4jgj\" (UID: \"a0fc777e-5996-498d-ab57-cfa42e031282\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"
Jul 02 23:09:13.011584 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:13.011550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrpj\" (UniqueName: \"kubernetes.io/projected/a0fc777e-5996-498d-ab57-cfa42e031282-kube-api-access-cdrpj\") pod \"dns-operator-controller-manager-864dd78c4c-g4jgj\" (UID: \"a0fc777e-5996-498d-ab57-cfa42e031282\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"
Jul 02 23:09:13.025495 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:13.025427    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrpj\" (UniqueName: \"kubernetes.io/projected/a0fc777e-5996-498d-ab57-cfa42e031282-kube-api-access-cdrpj\") pod \"dns-operator-controller-manager-864dd78c4c-g4jgj\" (UID: \"a0fc777e-5996-498d-ab57-cfa42e031282\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"
Jul 02 23:09:13.084661 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:13.084636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"
Jul 02 23:09:13.216631 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:13.213331    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"]
Jul 02 23:09:13.524615 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:13.524585    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj" event={"ID":"a0fc777e-5996-498d-ab57-cfa42e031282","Type":"ContainerStarted","Data":"1764b034bf9e4e26b2ff6fe7758833ad09a2c76daac283372c64761ec84bf9a1"}
Jul 02 23:09:14.644605 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.644575    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f5bcddbc8-dfmrd"]
Jul 02 23:09:14.650601 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.650579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.659953 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.659933    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5bcddbc8-dfmrd"]
Jul 02 23:09:14.823468 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.823436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-trusted-ca-bundle\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.823592 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.823473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5dm4\" (UniqueName: \"kubernetes.io/projected/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-kube-api-access-f5dm4\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.823592 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.823503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-oauth-config\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.823592 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.823541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-serving-cert\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.823693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.823615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-config\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.823693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.823657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-oauth-serving-cert\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.823749 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.823702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-service-ca\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.924934 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.924880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-oauth-serving-cert\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.924934 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.924918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-service-ca\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.925116 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.924945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-trusted-ca-bundle\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.925116 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.925075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5dm4\" (UniqueName: \"kubernetes.io/projected/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-kube-api-access-f5dm4\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.925230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.925128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-oauth-config\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.925230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.925156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-serving-cert\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.925230 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.925200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-config\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.925677 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.925651    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-service-ca\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.925760 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.925743    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-trusted-ca-bundle\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.926214 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.926190    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-oauth-serving-cert\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.926214 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.926206    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-config\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.927746 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.927725    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-oauth-config\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.927836 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.927744    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-console-serving-cert\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.934024 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.933998    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5dm4\" (UniqueName: \"kubernetes.io/projected/e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8-kube-api-access-f5dm4\") pod \"console-f5bcddbc8-dfmrd\" (UID: \"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8\") " pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:14.960666 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:14.960636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:15.406635 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:15.406613    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5bcddbc8-dfmrd"]
Jul 02 23:09:15.408037 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:15.408012    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4981a20_7d1d_4ebb_8d3c_27f55ebe64f8.slice/crio-2493976f9b4cc553d6ff270f1e1f192b6dcef8f7156cfdcf49489d096a2cb8bf WatchSource:0}: Error finding container 2493976f9b4cc553d6ff270f1e1f192b6dcef8f7156cfdcf49489d096a2cb8bf: Status 404 returned error can't find the container with id 2493976f9b4cc553d6ff270f1e1f192b6dcef8f7156cfdcf49489d096a2cb8bf
Jul 02 23:09:15.535620 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:15.535535    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5bcddbc8-dfmrd" event={"ID":"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8","Type":"ContainerStarted","Data":"e0758e5a27a29940909871b5862fbcc234ba0c2bd22aa1a21e39e837e892f775"}
Jul 02 23:09:15.535620 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:15.535604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5bcddbc8-dfmrd" event={"ID":"e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8","Type":"ContainerStarted","Data":"2493976f9b4cc553d6ff270f1e1f192b6dcef8f7156cfdcf49489d096a2cb8bf"}
Jul 02 23:09:15.537373 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:15.537346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj" event={"ID":"a0fc777e-5996-498d-ab57-cfa42e031282","Type":"ContainerStarted","Data":"c336ad923558023fa4f87f40ca01abead1cbd6ba877f907b11542b7404088c94"}
Jul 02 23:09:15.537507 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:15.537395    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"
Jul 02 23:09:15.555644 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:15.555605    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f5bcddbc8-dfmrd" podStartSLOduration=1.555591305 podStartE2EDuration="1.555591305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:15.554539097 +0000 UTC m=+462.491588405" watchObservedRunningTime="2026-07-02 23:09:15.555591305 +0000 UTC m=+462.492640611"
Jul 02 23:09:15.570020 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:15.569980    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj" podStartSLOduration=1.477349876 podStartE2EDuration="3.569968077s" totalImagesPullingTime="2.092618201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:15.569347775 +0000 UTC m=+462.506397097" watchObservedRunningTime="2026-07-02 23:09:15.569968077 +0000 UTC m=+462.507017385"
Jul 02 23:09:16.225288 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.225248    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"]
Jul 02 23:09:16.229024 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.228999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:16.231962 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.231934    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zftqt\""
Jul 02 23:09:16.241406 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.241378    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"]
Jul 02 23:09:16.335595 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.335567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vtm9\" (UniqueName: \"kubernetes.io/projected/2baa0158-22e2-4e78-a62b-c371c6c78581-kube-api-access-6vtm9\") pod \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" (UID: \"2baa0158-22e2-4e78-a62b-c371c6c78581\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:16.436169 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.436137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vtm9\" (UniqueName: \"kubernetes.io/projected/2baa0158-22e2-4e78-a62b-c371c6c78581-kube-api-access-6vtm9\") pod \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" (UID: \"2baa0158-22e2-4e78-a62b-c371c6c78581\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:16.448199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.448170    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vtm9\" (UniqueName: \"kubernetes.io/projected/2baa0158-22e2-4e78-a62b-c371c6c78581-kube-api-access-6vtm9\") pod \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" (UID: \"2baa0158-22e2-4e78-a62b-c371c6c78581\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:16.540804 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.540778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:16.684713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:16.684685    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"]
Jul 02 23:09:16.688269 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:16.688233    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2baa0158_22e2_4e78_a62b_c371c6c78581.slice/crio-b439bf458299ea72c7f203fc413f41620a1a7c0633d702e04acb79dfa2e686dc WatchSource:0}: Error finding container b439bf458299ea72c7f203fc413f41620a1a7c0633d702e04acb79dfa2e686dc: Status 404 returned error can't find the container with id b439bf458299ea72c7f203fc413f41620a1a7c0633d702e04acb79dfa2e686dc
Jul 02 23:09:17.547316 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:17.547283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw" event={"ID":"2baa0158-22e2-4e78-a62b-c371c6c78581","Type":"ContainerStarted","Data":"b439bf458299ea72c7f203fc413f41620a1a7c0633d702e04acb79dfa2e686dc"}
Jul 02 23:09:19.557949 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:19.557909    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw" event={"ID":"2baa0158-22e2-4e78-a62b-c371c6c78581","Type":"ContainerStarted","Data":"3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7"}
Jul 02 23:09:19.558439 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:19.557994    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:19.575833 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:19.575763    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw" podStartSLOduration=1.714363783 podStartE2EDuration="3.575744198s" totalImagesPullingTime="1.861380415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:19.575525357 +0000 UTC m=+466.512574665" watchObservedRunningTime="2026-07-02 23:09:19.575744198 +0000 UTC m=+466.512793505"
Jul 02 23:09:20.202019 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.201986    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"]
Jul 02 23:09:20.205478 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.205459    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"
Jul 02 23:09:20.209268 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.209243    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vvw4z\""
Jul 02 23:09:20.222961 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.222936    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"]
Jul 02 23:09:20.268033 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.268007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v422\" (UniqueName: \"kubernetes.io/projected/6ec9b09c-a223-4d78-a3e7-4390345292ef-kube-api-access-5v422\") pod \"authorino-operator-75cc8d5cb7-6ft77\" (UID: \"6ec9b09c-a223-4d78-a3e7-4390345292ef\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"
Jul 02 23:09:20.368607 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.368582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v422\" (UniqueName: \"kubernetes.io/projected/6ec9b09c-a223-4d78-a3e7-4390345292ef-kube-api-access-5v422\") pod \"authorino-operator-75cc8d5cb7-6ft77\" (UID: \"6ec9b09c-a223-4d78-a3e7-4390345292ef\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"
Jul 02 23:09:20.379778 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.379752    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v422\" (UniqueName: \"kubernetes.io/projected/6ec9b09c-a223-4d78-a3e7-4390345292ef-kube-api-access-5v422\") pod \"authorino-operator-75cc8d5cb7-6ft77\" (UID: \"6ec9b09c-a223-4d78-a3e7-4390345292ef\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"
Jul 02 23:09:20.521742 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.521715    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"
Jul 02 23:09:20.651214 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:20.651189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"]
Jul 02 23:09:20.652995 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:20.652967    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec9b09c_a223_4d78_a3e7_4390345292ef.slice/crio-9da94705abcbfda6f81aac45b123621230caf0ca891028688b5f18575d401f1d WatchSource:0}: Error finding container 9da94705abcbfda6f81aac45b123621230caf0ca891028688b5f18575d401f1d: Status 404 returned error can't find the container with id 9da94705abcbfda6f81aac45b123621230caf0ca891028688b5f18575d401f1d
Jul 02 23:09:21.569718 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:21.569679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77" event={"ID":"6ec9b09c-a223-4d78-a3e7-4390345292ef","Type":"ContainerStarted","Data":"9da94705abcbfda6f81aac45b123621230caf0ca891028688b5f18575d401f1d"}
Jul 02 23:09:23.581568 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:23.581525    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77" event={"ID":"6ec9b09c-a223-4d78-a3e7-4390345292ef","Type":"ContainerStarted","Data":"13e9fec7bc1704d76615b8e92f460c4770d71861c0ebd31a9aedbc7af063d250"}
Jul 02 23:09:23.581969 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:23.581664    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"
Jul 02 23:09:23.605203 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:23.605156    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77" podStartSLOduration=1.505096457 podStartE2EDuration="3.605141206s" totalImagesPullingTime="2.100044749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:23.603199982 +0000 UTC m=+470.540249290" watchObservedRunningTime="2026-07-02 23:09:23.605141206 +0000 UTC m=+470.542190514"
Jul 02 23:09:24.854183 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.854142    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"]
Jul 02 23:09:24.857675 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.857655    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:24.860162 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.860134    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2f7wz\""
Jul 02 23:09:24.871751 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.871723    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"]
Jul 02 23:09:24.907427 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.907404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:24.907521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.907433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvp8\" (UniqueName: \"kubernetes.io/projected/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-kube-api-access-skvp8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:24.961770 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.961744    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:24.961863 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.961786    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:24.966243 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:24.966224    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:25.008776 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.008755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:25.008878 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.008782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvp8\" (UniqueName: \"kubernetes.io/projected/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-kube-api-access-skvp8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:25.009164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.009145    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:25.016994 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.016974    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvp8\" (UniqueName: \"kubernetes.io/projected/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-kube-api-access-skvp8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:25.168984 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.168934    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:25.300400 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.300349    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"]
Jul 02 23:09:25.302665 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:25.302637    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ed0e9b_0e21_46a5_8436_4f07bb4a7612.slice/crio-52bed019edaa4bea97cd8564de29aaf889e4968bb324f8bda41cc40bb7758288 WatchSource:0}: Error finding container 52bed019edaa4bea97cd8564de29aaf889e4968bb324f8bda41cc40bb7758288: Status 404 returned error can't find the container with id 52bed019edaa4bea97cd8564de29aaf889e4968bb324f8bda41cc40bb7758288
Jul 02 23:09:25.592915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.592885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9" event={"ID":"75ed0e9b-0e21-46a5-8436-4f07bb4a7612","Type":"ContainerStarted","Data":"52bed019edaa4bea97cd8564de29aaf889e4968bb324f8bda41cc40bb7758288"}
Jul 02 23:09:25.596694 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.596675    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f5bcddbc8-dfmrd"
Jul 02 23:09:25.648567 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:25.648545    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bd94dcb5-qfw69"]
Jul 02 23:09:26.544485 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:26.544455    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g4jgj"
Jul 02 23:09:30.564560 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:30.564533    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:30.620337 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:30.620306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9" event={"ID":"75ed0e9b-0e21-46a5-8436-4f07bb4a7612","Type":"ContainerStarted","Data":"892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256"}
Jul 02 23:09:30.620469 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:30.620368    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:30.641031 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:30.640992    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9" podStartSLOduration=1.48058313 podStartE2EDuration="6.640976921s" totalImagesPullingTime="5.160393791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:30.639127876 +0000 UTC m=+477.576177184" watchObservedRunningTime="2026-07-02 23:09:30.640976921 +0000 UTC m=+477.578026296"
Jul 02 23:09:33.194219 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.194189    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"]
Jul 02 23:09:33.197578 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.197555    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.200794 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.200768    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 23:09:33.201083 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.200800    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zlgg2\""
Jul 02 23:09:33.201508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.200804    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 23:09:33.209867 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.209826    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"]
Jul 02 23:09:33.271992 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.271973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zb2v\" (UniqueName: \"kubernetes.io/projected/918e8f40-37ac-44b1-ac42-89acea9ce2cb-kube-api-access-2zb2v\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.272115 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.272007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/918e8f40-37ac-44b1-ac42-89acea9ce2cb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.272115 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.272030    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/918e8f40-37ac-44b1-ac42-89acea9ce2cb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.373440 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.373410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zb2v\" (UniqueName: \"kubernetes.io/projected/918e8f40-37ac-44b1-ac42-89acea9ce2cb-kube-api-access-2zb2v\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.373555 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.373450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/918e8f40-37ac-44b1-ac42-89acea9ce2cb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.373555 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.373474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/918e8f40-37ac-44b1-ac42-89acea9ce2cb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.374073 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.374027    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/918e8f40-37ac-44b1-ac42-89acea9ce2cb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.375710 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.375692    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/918e8f40-37ac-44b1-ac42-89acea9ce2cb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.383069 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.383031    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zb2v\" (UniqueName: \"kubernetes.io/projected/918e8f40-37ac-44b1-ac42-89acea9ce2cb-kube-api-access-2zb2v\") pod \"kuadrant-console-plugin-66b5774985-dptb2\" (UID: \"918e8f40-37ac-44b1-ac42-89acea9ce2cb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.516975 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.516958    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zlgg2\""
Jul 02 23:09:33.525215 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.525198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"
Jul 02 23:09:33.652259 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:33.652235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2"]
Jul 02 23:09:33.654299 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:33.654271    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod918e8f40_37ac_44b1_ac42_89acea9ce2cb.slice/crio-1bab39382bf117572b56297cde0006131e1233c7ed1f6b22a3832dabf0fe6fff WatchSource:0}: Error finding container 1bab39382bf117572b56297cde0006131e1233c7ed1f6b22a3832dabf0fe6fff: Status 404 returned error can't find the container with id 1bab39382bf117572b56297cde0006131e1233c7ed1f6b22a3832dabf0fe6fff
Jul 02 23:09:34.589793 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:34.589759    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6ft77"
Jul 02 23:09:34.641398 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:34.641371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2" event={"ID":"918e8f40-37ac-44b1-ac42-89acea9ce2cb","Type":"ContainerStarted","Data":"1bab39382bf117572b56297cde0006131e1233c7ed1f6b22a3832dabf0fe6fff"}
Jul 02 23:09:41.626943 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:41.626916    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:42.496336 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.496307    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"]
Jul 02 23:09:42.503040 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.503020    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:42.515447 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.515423    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"]
Jul 02 23:09:42.555040 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.555011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckl72\" (UniqueName: \"kubernetes.io/projected/8c514ee5-9350-46a8-9c66-c25558fc662d-kube-api-access-ckl72\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:42.555188 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.555126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c514ee5-9350-46a8-9c66-c25558fc662d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:42.655687 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.655653    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c514ee5-9350-46a8-9c66-c25558fc662d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:42.656168 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.655780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckl72\" (UniqueName: \"kubernetes.io/projected/8c514ee5-9350-46a8-9c66-c25558fc662d-kube-api-access-ckl72\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:42.656238 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.656166    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c514ee5-9350-46a8-9c66-c25558fc662d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:42.664555 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.664530    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckl72\" (UniqueName: \"kubernetes.io/projected/8c514ee5-9350-46a8-9c66-c25558fc662d-kube-api-access-ckl72\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:42.815857 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:42.815826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:43.267752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.267718    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"]
Jul 02 23:09:43.273620 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.273594    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"]
Jul 02 23:09:43.288875 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.288843    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"]
Jul 02 23:09:43.289084 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.289042    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" containerName="manager" containerID="cri-o://892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256" gracePeriod=2
Jul 02 23:09:43.298099 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.297819    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"]
Jul 02 23:09:43.307432 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.307407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.309802 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.309767    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"]
Jul 02 23:09:43.313963 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:43.313925    2575 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:43.314141 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.314118    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"]
Jul 02 23:09:43.314598 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.314579    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" containerName="manager"
Jul 02 23:09:43.314678 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.314602    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" containerName="manager"
Jul 02 23:09:43.314732 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.314698    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" containerName="manager"
Jul 02 23:09:43.316376 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:43.316343    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:43.318613 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.318591    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"]
Jul 02 23:09:43.318714 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.318639    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"]
Jul 02 23:09:43.318779 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.318713    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.318779 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.318762    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" containerName="manager" containerID="cri-o://3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7" gracePeriod=2
Jul 02 23:09:43.330256 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.330230    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"]
Jul 02 23:09:43.333588 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.333558    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"]
Jul 02 23:09:43.337490 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.337468    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"]
Jul 02 23:09:43.337935 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.337915    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" containerName="manager"
Jul 02 23:09:43.338086 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.337938    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" containerName="manager"
Jul 02 23:09:43.338086 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.338034    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" containerName="manager"
Jul 02 23:09:43.341499 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.341479    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"
Jul 02 23:09:43.344546 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:43.344515    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:43.351339 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.351315    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"]
Jul 02 23:09:43.361409 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.361382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxbs\" (UniqueName: \"kubernetes.io/projected/84c91aec-ce37-44d4-ab66-6c56b4194d54-kube-api-access-7nxbs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bhlpd\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.361497 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.361455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c91aec-ce37-44d4-ab66-6c56b4194d54-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bhlpd\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.381659 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:43.381624    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:43.462016 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.461994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrx96\" (UniqueName: \"kubernetes.io/projected/bbc193ba-b709-47da-9317-6c244b87504a-kube-api-access-vrx96\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hgwvv\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.462138 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.462022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lncg\" (UniqueName: \"kubernetes.io/projected/912f80e0-c862-4977-a4f1-4a83160a1a9e-kube-api-access-5lncg\") pod \"limitador-operator-controller-manager-859d7b78bd-5rmf4\" (UID: \"912f80e0-c862-4977-a4f1-4a83160a1a9e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"
Jul 02 23:09:43.462138 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.462077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxbs\" (UniqueName: \"kubernetes.io/projected/84c91aec-ce37-44d4-ab66-6c56b4194d54-kube-api-access-7nxbs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bhlpd\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.462240 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.462140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c91aec-ce37-44d4-ab66-6c56b4194d54-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bhlpd\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.462240 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.462168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbc193ba-b709-47da-9317-6c244b87504a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hgwvv\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.462575 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.462554    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c91aec-ce37-44d4-ab66-6c56b4194d54-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bhlpd\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.470840 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.470806    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxbs\" (UniqueName: \"kubernetes.io/projected/84c91aec-ce37-44d4-ab66-6c56b4194d54-kube-api-access-7nxbs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bhlpd\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.563564 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.563499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbc193ba-b709-47da-9317-6c244b87504a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hgwvv\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.563693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.563575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrx96\" (UniqueName: \"kubernetes.io/projected/bbc193ba-b709-47da-9317-6c244b87504a-kube-api-access-vrx96\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hgwvv\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.563693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.563600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lncg\" (UniqueName: \"kubernetes.io/projected/912f80e0-c862-4977-a4f1-4a83160a1a9e-kube-api-access-5lncg\") pod \"limitador-operator-controller-manager-859d7b78bd-5rmf4\" (UID: \"912f80e0-c862-4977-a4f1-4a83160a1a9e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"
Jul 02 23:09:43.563927 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.563895    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbc193ba-b709-47da-9317-6c244b87504a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hgwvv\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.573828 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.573785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrx96\" (UniqueName: \"kubernetes.io/projected/bbc193ba-b709-47da-9317-6c244b87504a-kube-api-access-vrx96\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hgwvv\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.574119 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.574086    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lncg\" (UniqueName: \"kubernetes.io/projected/912f80e0-c862-4977-a4f1-4a83160a1a9e-kube-api-access-5lncg\") pod \"limitador-operator-controller-manager-859d7b78bd-5rmf4\" (UID: \"912f80e0-c862-4977-a4f1-4a83160a1a9e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"
Jul 02 23:09:43.620143 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:43.620100    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:43.621891 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:43.621860    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:43.710646 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.710593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:43.719132 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.719113    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:43.725691 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:43.725672    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"
Jul 02 23:09:50.675770 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:50.675700    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77bd94dcb5-qfw69" podUID="b69c2cd0-45e2-4120-a5f3-a4dff832cd49" containerName="console" containerID="cri-o://34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec" gracePeriod=15
Jul 02 23:09:56.051391 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.051369    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:09:56.098877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.098844    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"]
Jul 02 23:09:56.114166 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:56.114068    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c91aec_ce37_44d4_ab66_6c56b4194d54.slice/crio-41c903f75632a931db94b344764be80236eb7038bb40db913da501483a6bba5d WatchSource:0}: Error finding container 41c903f75632a931db94b344764be80236eb7038bb40db913da501483a6bba5d: Status 404 returned error can't find the container with id 41c903f75632a931db94b344764be80236eb7038bb40db913da501483a6bba5d
Jul 02 23:09:56.115467 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.115215    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:56.117906 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.117835    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:56.120874 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.120798    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:56.122810 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.122781    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:56.124629 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.124600    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:56.143461 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.143436    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"]
Jul 02 23:09:56.146194 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:56.146169    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc193ba_b709_47da_9317_6c244b87504a.slice/crio-86eac0eecc3b827b2d28c4510d2d5d294774e8a397d1b0792433e525256f6e2b WatchSource:0}: Error finding container 86eac0eecc3b827b2d28c4510d2d5d294774e8a397d1b0792433e525256f6e2b: Status 404 returned error can't find the container with id 86eac0eecc3b827b2d28c4510d2d5d294774e8a397d1b0792433e525256f6e2b
Jul 02 23:09:56.162686 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.162639    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"]
Jul 02 23:09:56.164928 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:09:56.164890    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912f80e0_c862_4977_a4f1_4a83160a1a9e.slice/crio-5f6ba923c8def7c3feb12da2f0873353546a0204ecd75a9316ace9132644693b WatchSource:0}: Error finding container 5f6ba923c8def7c3feb12da2f0873353546a0204ecd75a9316ace9132644693b: Status 404 returned error can't find the container with id 5f6ba923c8def7c3feb12da2f0873353546a0204ecd75a9316ace9132644693b
Jul 02 23:09:56.175792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.175085    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-service-ca\") pod \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") "
Jul 02 23:09:56.175792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.175136    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-trusted-ca-bundle\") pod \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") "
Jul 02 23:09:56.175792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.175168    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-serving-cert\") pod \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") "
Jul 02 23:09:56.175792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.175231    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-oauth-serving-cert\") pod \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") "
Jul 02 23:09:56.175792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.175257    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smrx9\" (UniqueName: \"kubernetes.io/projected/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-kube-api-access-smrx9\") pod \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") "
Jul 02 23:09:56.175792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.175295    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-config\") pod \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") "
Jul 02 23:09:56.175792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.175340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-oauth-config\") pod \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\" (UID: \"b69c2cd0-45e2-4120-a5f3-a4dff832cd49\") "
Jul 02 23:09:56.178498 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.177009    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b69c2cd0-45e2-4120-a5f3-a4dff832cd49" (UID: "b69c2cd0-45e2-4120-a5f3-a4dff832cd49"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:56.178498 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.178072    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-service-ca" (OuterVolumeSpecName: "service-ca") pod "b69c2cd0-45e2-4120-a5f3-a4dff832cd49" (UID: "b69c2cd0-45e2-4120-a5f3-a4dff832cd49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:56.178498 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.178230    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-config" (OuterVolumeSpecName: "console-config") pod "b69c2cd0-45e2-4120-a5f3-a4dff832cd49" (UID: "b69c2cd0-45e2-4120-a5f3-a4dff832cd49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:56.179676 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.179083    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b69c2cd0-45e2-4120-a5f3-a4dff832cd49" (UID: "b69c2cd0-45e2-4120-a5f3-a4dff832cd49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:56.180180 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.180151    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b69c2cd0-45e2-4120-a5f3-a4dff832cd49" (UID: "b69c2cd0-45e2-4120-a5f3-a4dff832cd49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:09:56.180582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.180549    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b69c2cd0-45e2-4120-a5f3-a4dff832cd49" (UID: "b69c2cd0-45e2-4120-a5f3-a4dff832cd49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:09:56.181631 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.181605    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-kube-api-access-smrx9" (OuterVolumeSpecName: "kube-api-access-smrx9") pod "b69c2cd0-45e2-4120-a5f3-a4dff832cd49" (UID: "b69c2cd0-45e2-4120-a5f3-a4dff832cd49"). InnerVolumeSpecName "kube-api-access-smrx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:09:56.276266 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276242    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-extensions-socket-volume\") pod \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") "
Jul 02 23:09:56.276408 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276289    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vtm9\" (UniqueName: \"kubernetes.io/projected/2baa0158-22e2-4e78-a62b-c371c6c78581-kube-api-access-6vtm9\") pod \"2baa0158-22e2-4e78-a62b-c371c6c78581\" (UID: \"2baa0158-22e2-4e78-a62b-c371c6c78581\") "
Jul 02 23:09:56.276408 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276313    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skvp8\" (UniqueName: \"kubernetes.io/projected/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-kube-api-access-skvp8\") pod \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\" (UID: \"75ed0e9b-0e21-46a5-8436-4f07bb4a7612\") "
Jul 02 23:09:56.276521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276482    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-oauth-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.276521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276492    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.276521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276500    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-trusted-ca-bundle\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.276521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276508    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.276521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276516    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-oauth-serving-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.276521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276524    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smrx9\" (UniqueName: \"kubernetes.io/projected/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-kube-api-access-smrx9\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.276771 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276531    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69c2cd0-45e2-4120-a5f3-a4dff832cd49-console-config\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.276771 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.276653    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "75ed0e9b-0e21-46a5-8436-4f07bb4a7612" (UID: "75ed0e9b-0e21-46a5-8436-4f07bb4a7612"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:09:56.278179 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.278155    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2baa0158-22e2-4e78-a62b-c371c6c78581-kube-api-access-6vtm9" (OuterVolumeSpecName: "kube-api-access-6vtm9") pod "2baa0158-22e2-4e78-a62b-c371c6c78581" (UID: "2baa0158-22e2-4e78-a62b-c371c6c78581"). InnerVolumeSpecName "kube-api-access-6vtm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:09:56.278263 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.278189    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-kube-api-access-skvp8" (OuterVolumeSpecName: "kube-api-access-skvp8") pod "75ed0e9b-0e21-46a5-8436-4f07bb4a7612" (UID: "75ed0e9b-0e21-46a5-8436-4f07bb4a7612"). InnerVolumeSpecName "kube-api-access-skvp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:09:56.377872 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.377812    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-extensions-socket-volume\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.377872 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.377832    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vtm9\" (UniqueName: \"kubernetes.io/projected/2baa0158-22e2-4e78-a62b-c371c6c78581-kube-api-access-6vtm9\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.377872 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.377841    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skvp8\" (UniqueName: \"kubernetes.io/projected/75ed0e9b-0e21-46a5-8436-4f07bb4a7612-kube-api-access-skvp8\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:56.759329 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.759263    2575 generic.go:356] "Generic (PLEG): container finished" podID="2baa0158-22e2-4e78-a62b-c371c6c78581" containerID="3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7" exitCode=0
Jul 02 23:09:56.759501 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.759350    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:56.759501 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.759358    2575 scope.go:117] "RemoveContainer" containerID="3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7"
Jul 02 23:09:56.761236 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.761206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd" event={"ID":"84c91aec-ce37-44d4-ab66-6c56b4194d54","Type":"ContainerStarted","Data":"a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904"}
Jul 02 23:09:56.761346 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.761266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd" event={"ID":"84c91aec-ce37-44d4-ab66-6c56b4194d54","Type":"ContainerStarted","Data":"41c903f75632a931db94b344764be80236eb7038bb40db913da501483a6bba5d"}
Jul 02 23:09:56.761420 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.761364    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:09:56.761562 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.761475    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:56.762995 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.762969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4" event={"ID":"912f80e0-c862-4977-a4f1-4a83160a1a9e","Type":"ContainerStarted","Data":"6a7ea18a655ec685972b99c7fb7967e6624db4871052b1d79ef2808396b2334d"}
Jul 02 23:09:56.763122 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.763019    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4" event={"ID":"912f80e0-c862-4977-a4f1-4a83160a1a9e","Type":"ContainerStarted","Data":"5f6ba923c8def7c3feb12da2f0873353546a0204ecd75a9316ace9132644693b"}
Jul 02 23:09:56.763122 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.763062    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"
Jul 02 23:09:56.763240 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.763193    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:56.764772 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.764748    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2" event={"ID":"918e8f40-37ac-44b1-ac42-89acea9ce2cb","Type":"ContainerStarted","Data":"494418314fde542fc124d4042649e11f01b0a5c31bf34269f9af2428e3b99b00"}
Jul 02 23:09:56.766175 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.766155    2575 generic.go:356] "Generic (PLEG): container finished" podID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" containerID="892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256" exitCode=0
Jul 02 23:09:56.766264 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.766218    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:56.767772 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.767742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv" event={"ID":"bbc193ba-b709-47da-9317-6c244b87504a","Type":"ContainerStarted","Data":"ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21"}
Jul 02 23:09:56.767857 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.767781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv" event={"ID":"bbc193ba-b709-47da-9317-6c244b87504a","Type":"ContainerStarted","Data":"86eac0eecc3b827b2d28c4510d2d5d294774e8a397d1b0792433e525256f6e2b"}
Jul 02 23:09:56.767857 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.767811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:09:56.769040 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.769019    2575 generic.go:356] "Generic (PLEG): container finished" podID="b69c2cd0-45e2-4120-a5f3-a4dff832cd49" containerID="34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec" exitCode=0
Jul 02 23:09:56.769246 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.769082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd94dcb5-qfw69" event={"ID":"b69c2cd0-45e2-4120-a5f3-a4dff832cd49","Type":"ContainerDied","Data":"34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec"}
Jul 02 23:09:56.769340 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.769272    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bd94dcb5-qfw69" event={"ID":"b69c2cd0-45e2-4120-a5f3-a4dff832cd49","Type":"ContainerDied","Data":"a4c2b5fad46264b66d140e21fba6b23d0f2b779266d18e9de035f2544bb527f3"}
Jul 02 23:09:56.769340 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.769096    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bd94dcb5-qfw69"
Jul 02 23:09:56.769654 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.769636    2575 scope.go:117] "RemoveContainer" containerID="3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7"
Jul 02 23:09:56.770007 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.769879    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7\": container with ID starting with 3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7 not found: ID does not exist" containerID="3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7"
Jul 02 23:09:56.770007 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.769900    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7"} err="failed to get container status \"3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7\": rpc error: code = NotFound desc = could not find container \"3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7\": container with ID starting with 3ce96969ac8292974bd15b75a31c493eb69074979565978fbf4fd9310cb651e7 not found: ID does not exist"
Jul 02 23:09:56.770007 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.769915    2575 scope.go:117] "RemoveContainer" containerID="892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256"
Jul 02 23:09:56.777900 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.777882    2575 scope.go:117] "RemoveContainer" containerID="892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256"
Jul 02 23:09:56.778176 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.778152    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256\": container with ID starting with 892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256 not found: ID does not exist" containerID="892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256"
Jul 02 23:09:56.778269 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.778182    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256"} err="failed to get container status \"892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256\": rpc error: code = NotFound desc = could not find container \"892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256\": container with ID starting with 892343d490aafb725809be2df59ea588e33075324fd38b0f09a3b5bf54d35256 not found: ID does not exist"
Jul 02 23:09:56.778269 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.778202    2575 scope.go:117] "RemoveContainer" containerID="34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec"
Jul 02 23:09:56.785220 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.785182    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd" podStartSLOduration=13.785171001 podStartE2EDuration="13.785171001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:56.783279583 +0000 UTC m=+503.720328890" watchObservedRunningTime="2026-07-02 23:09:56.785171001 +0000 UTC m=+503.722220287"
Jul 02 23:09:56.785307 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.785242    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:56.786247 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.786229    2575 scope.go:117] "RemoveContainer" containerID="34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec"
Jul 02 23:09:56.786483 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.786466    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec\": container with ID starting with 34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec not found: ID does not exist" containerID="34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec"
Jul 02 23:09:56.786546 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.786491    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec"} err="failed to get container status \"34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec\": rpc error: code = NotFound desc = could not find container \"34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec\": container with ID starting with 34cb9379155a08d9d865e86f3cffafa1a3ec329beb17f4aec6aab1372add38ec not found: ID does not exist"
Jul 02 23:09:56.803600 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.803565    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4" podStartSLOduration=13.803554268 podStartE2EDuration="13.803554268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:56.802015702 +0000 UTC m=+503.739065019" watchObservedRunningTime="2026-07-02 23:09:56.803554268 +0000 UTC m=+503.740603574"
Jul 02 23:09:56.803932 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.803912    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:56.824996 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.824962    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dptb2" podStartSLOduration=1.522333537 podStartE2EDuration="23.824950383s" totalImagesPullingTime="22.302616846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:56.823946574 +0000 UTC m=+503.760995881" watchObservedRunningTime="2026-07-02 23:09:56.824950383 +0000 UTC m=+503.761999744"
Jul 02 23:09:56.825898 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.825878    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f5w9\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f5w9"
Jul 02 23:09:56.844243 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.844198    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv" podStartSLOduration=13.84418188 podStartE2EDuration="13.84418188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:09:56.842280318 +0000 UTC m=+503.779329638" watchObservedRunningTime="2026-07-02 23:09:56.84418188 +0000 UTC m=+503.781231188"
Jul 02 23:09:56.856316 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.856293    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bd94dcb5-qfw69"]
Jul 02 23:09:56.860182 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:56.860151    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-b9bhw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9bhw"
Jul 02 23:09:56.860298 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:56.860283    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77bd94dcb5-qfw69"]
Jul 02 23:09:57.620777 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:57.620748    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2baa0158-22e2-4e78-a62b-c371c6c78581" path="/var/lib/kubelet/pods/2baa0158-22e2-4e78-a62b-c371c6c78581/volumes"
Jul 02 23:09:57.621145 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:57.621098    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ed0e9b-0e21-46a5-8436-4f07bb4a7612" path="/var/lib/kubelet/pods/75ed0e9b-0e21-46a5-8436-4f07bb4a7612/volumes"
Jul 02 23:09:57.621473 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:57.621461    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69c2cd0-45e2-4120-a5f3-a4dff832cd49" path="/var/lib/kubelet/pods/b69c2cd0-45e2-4120-a5f3-a4dff832cd49/volumes"
Jul 02 23:09:58.450016 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:58.449974    2575 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-cfwrw_kuadrant-system_8c514ee5-9350-46a8-9c66-c25558fc662d_0(5ac5520a22de35f2775a8bcded5150785712e6fc6a7165c8381702e697ab267f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-cfwrw to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 02 23:09:58.450137 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:58.450070    2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-cfwrw_kuadrant-system_8c514ee5-9350-46a8-9c66-c25558fc662d_0(5ac5520a22de35f2775a8bcded5150785712e6fc6a7165c8381702e697ab267f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-cfwrw to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:58.782500 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.782467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:58.784461 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:58.784431    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="8c514ee5-9350-46a8-9c66-c25558fc662d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:58.789582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.789556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:58.791448 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:58.791418    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="8c514ee5-9350-46a8-9c66-c25558fc662d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:58.899362 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.899338    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckl72\" (UniqueName: \"kubernetes.io/projected/8c514ee5-9350-46a8-9c66-c25558fc662d-kube-api-access-ckl72\") pod \"8c514ee5-9350-46a8-9c66-c25558fc662d\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") "
Jul 02 23:09:58.899457 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.899405    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c514ee5-9350-46a8-9c66-c25558fc662d-extensions-socket-volume\") pod \"8c514ee5-9350-46a8-9c66-c25558fc662d\" (UID: \"8c514ee5-9350-46a8-9c66-c25558fc662d\") "
Jul 02 23:09:58.899707 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.899680    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c514ee5-9350-46a8-9c66-c25558fc662d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8c514ee5-9350-46a8-9c66-c25558fc662d" (UID: "8c514ee5-9350-46a8-9c66-c25558fc662d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:09:58.901656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.901637    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c514ee5-9350-46a8-9c66-c25558fc662d-kube-api-access-ckl72" (OuterVolumeSpecName: "kube-api-access-ckl72") pod "8c514ee5-9350-46a8-9c66-c25558fc662d" (UID: "8c514ee5-9350-46a8-9c66-c25558fc662d"). InnerVolumeSpecName "kube-api-access-ckl72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:09:58.999932 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.999908    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckl72\" (UniqueName: \"kubernetes.io/projected/8c514ee5-9350-46a8-9c66-c25558fc662d-kube-api-access-ckl72\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:58.999932 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:58.999933    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c514ee5-9350-46a8-9c66-c25558fc662d-extensions-socket-volume\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:09:59.622064 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:59.622020    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c514ee5-9350-46a8-9c66-c25558fc662d" path="/var/lib/kubelet/pods/8c514ee5-9350-46a8-9c66-c25558fc662d/volumes"
Jul 02 23:09:59.786895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:09:59.786868    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:59.789379 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:59.789349    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="8c514ee5-9350-46a8-9c66-c25558fc662d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:09:59.791653 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:09:59.791625    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cfwrw\" is forbidden: User \"system:node:ip-10-0-142-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-239.ec2.internal' and this object" podUID="8c514ee5-9350-46a8-9c66-c25558fc662d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfwrw"
Jul 02 23:10:07.778890 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:07.778853    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:10:07.779360 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:07.778955    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5rmf4"
Jul 02 23:10:07.779360 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:07.779117    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:10:07.830965 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:07.830929    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"]
Jul 02 23:10:07.831177 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:07.831147    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv" podUID="bbc193ba-b709-47da-9317-6c244b87504a" containerName="manager" containerID="cri-o://ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21" gracePeriod=10
Jul 02 23:10:08.066866 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.066844    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:10:08.165595 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.165575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrx96\" (UniqueName: \"kubernetes.io/projected/bbc193ba-b709-47da-9317-6c244b87504a-kube-api-access-vrx96\") pod \"bbc193ba-b709-47da-9317-6c244b87504a\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") "
Jul 02 23:10:08.165700 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.165640    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbc193ba-b709-47da-9317-6c244b87504a-extensions-socket-volume\") pod \"bbc193ba-b709-47da-9317-6c244b87504a\" (UID: \"bbc193ba-b709-47da-9317-6c244b87504a\") "
Jul 02 23:10:08.166034 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.166006    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc193ba-b709-47da-9317-6c244b87504a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bbc193ba-b709-47da-9317-6c244b87504a" (UID: "bbc193ba-b709-47da-9317-6c244b87504a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:10:08.167395 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.167373    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc193ba-b709-47da-9317-6c244b87504a-kube-api-access-vrx96" (OuterVolumeSpecName: "kube-api-access-vrx96") pod "bbc193ba-b709-47da-9317-6c244b87504a" (UID: "bbc193ba-b709-47da-9317-6c244b87504a"). InnerVolumeSpecName "kube-api-access-vrx96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:08.209085 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.209060    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"]
Jul 02 23:10:08.209398 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.209387    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69c2cd0-45e2-4120-a5f3-a4dff832cd49" containerName="console"
Jul 02 23:10:08.209446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.209400    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69c2cd0-45e2-4120-a5f3-a4dff832cd49" containerName="console"
Jul 02 23:10:08.209446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.209415    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc193ba-b709-47da-9317-6c244b87504a" containerName="manager"
Jul 02 23:10:08.209446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.209420    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc193ba-b709-47da-9317-6c244b87504a" containerName="manager"
Jul 02 23:10:08.209552 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.209477    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc193ba-b709-47da-9317-6c244b87504a" containerName="manager"
Jul 02 23:10:08.209552 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.209489    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69c2cd0-45e2-4120-a5f3-a4dff832cd49" containerName="console"
Jul 02 23:10:08.211317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.211304    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.223034 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.223013    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"]
Jul 02 23:10:08.267113 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.267093    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrx96\" (UniqueName: \"kubernetes.io/projected/bbc193ba-b709-47da-9317-6c244b87504a-kube-api-access-vrx96\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:10:08.267113 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.267110    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbc193ba-b709-47da-9317-6c244b87504a-extensions-socket-volume\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:10:08.367759 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.367704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076c42a4-1005-423b-ae63-789fd7771612-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vll4z\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.367844 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.367760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npp4f\" (UniqueName: \"kubernetes.io/projected/076c42a4-1005-423b-ae63-789fd7771612-kube-api-access-npp4f\") pod \"kuadrant-operator-controller-manager-86878c769f-vll4z\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.468954 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.468924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npp4f\" (UniqueName: \"kubernetes.io/projected/076c42a4-1005-423b-ae63-789fd7771612-kube-api-access-npp4f\") pod \"kuadrant-operator-controller-manager-86878c769f-vll4z\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.469084 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.468967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076c42a4-1005-423b-ae63-789fd7771612-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vll4z\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.469364 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.469340    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076c42a4-1005-423b-ae63-789fd7771612-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vll4z\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.488618 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.488588    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npp4f\" (UniqueName: \"kubernetes.io/projected/076c42a4-1005-423b-ae63-789fd7771612-kube-api-access-npp4f\") pod \"kuadrant-operator-controller-manager-86878c769f-vll4z\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.521203 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.521160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.654891 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.654868    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"]
Jul 02 23:10:08.656987 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:10:08.656961    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076c42a4_1005_423b_ae63_789fd7771612.slice/crio-868e30c928dbe18de479f559eab13607988987bdfb1192a13ea936703795cd35 WatchSource:0}: Error finding container 868e30c928dbe18de479f559eab13607988987bdfb1192a13ea936703795cd35: Status 404 returned error can't find the container with id 868e30c928dbe18de479f559eab13607988987bdfb1192a13ea936703795cd35
Jul 02 23:10:08.836014 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.835981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z" event={"ID":"076c42a4-1005-423b-ae63-789fd7771612","Type":"ContainerStarted","Data":"b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380"}
Jul 02 23:10:08.836410 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.836151    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:08.836410 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.836198    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z" event={"ID":"076c42a4-1005-423b-ae63-789fd7771612","Type":"ContainerStarted","Data":"868e30c928dbe18de479f559eab13607988987bdfb1192a13ea936703795cd35"}
Jul 02 23:10:08.837405 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.837383    2575 generic.go:356] "Generic (PLEG): container finished" podID="bbc193ba-b709-47da-9317-6c244b87504a" containerID="ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21" exitCode=0
Jul 02 23:10:08.837487 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.837420    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"
Jul 02 23:10:08.837487 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.837466    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv" event={"ID":"bbc193ba-b709-47da-9317-6c244b87504a","Type":"ContainerDied","Data":"ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21"}
Jul 02 23:10:08.837546 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.837509    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv" event={"ID":"bbc193ba-b709-47da-9317-6c244b87504a","Type":"ContainerDied","Data":"86eac0eecc3b827b2d28c4510d2d5d294774e8a397d1b0792433e525256f6e2b"}
Jul 02 23:10:08.837546 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.837537    2575 scope.go:117] "RemoveContainer" containerID="ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21"
Jul 02 23:10:08.853693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.853669    2575 scope.go:117] "RemoveContainer" containerID="ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21"
Jul 02 23:10:08.854530 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:10:08.854030    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21\": container with ID starting with ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21 not found: ID does not exist" containerID="ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21"
Jul 02 23:10:08.854530 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.854094    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21"} err="failed to get container status \"ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21\": rpc error: code = NotFound desc = could not find container \"ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21\": container with ID starting with ddc41074b75ba57f37aa028452e12b86c476ecf900b9e8cc6d2f4f6901549e21 not found: ID does not exist"
Jul 02 23:10:08.854530 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.854409    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z" podStartSLOduration=0.854393031 podStartE2EDuration="854.393031ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:08.853907037 +0000 UTC m=+515.790956345" watchObservedRunningTime="2026-07-02 23:10:08.854393031 +0000 UTC m=+515.791442340"
Jul 02 23:10:08.867641 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.867615    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"]
Jul 02 23:10:08.873432 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:08.873414    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hgwvv"]
Jul 02 23:10:09.621504 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:09.621471    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbc193ba-b709-47da-9317-6c244b87504a" path="/var/lib/kubelet/pods/bbc193ba-b709-47da-9317-6c244b87504a/volumes"
Jul 02 23:10:19.845410 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:19.845380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:10:19.898843 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:19.898813    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"]
Jul 02 23:10:19.899058 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:19.899023    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd" podUID="84c91aec-ce37-44d4-ab66-6c56b4194d54" containerName="manager" containerID="cri-o://a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904" gracePeriod=10
Jul 02 23:10:20.709135 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.709110    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:10:20.755146 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.755123    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c91aec-ce37-44d4-ab66-6c56b4194d54-extensions-socket-volume\") pod \"84c91aec-ce37-44d4-ab66-6c56b4194d54\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") "
Jul 02 23:10:20.755235 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.755182    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nxbs\" (UniqueName: \"kubernetes.io/projected/84c91aec-ce37-44d4-ab66-6c56b4194d54-kube-api-access-7nxbs\") pod \"84c91aec-ce37-44d4-ab66-6c56b4194d54\" (UID: \"84c91aec-ce37-44d4-ab66-6c56b4194d54\") "
Jul 02 23:10:20.755800 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.755767    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c91aec-ce37-44d4-ab66-6c56b4194d54-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "84c91aec-ce37-44d4-ab66-6c56b4194d54" (UID: "84c91aec-ce37-44d4-ab66-6c56b4194d54"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:10:20.757509 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.757486    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c91aec-ce37-44d4-ab66-6c56b4194d54-kube-api-access-7nxbs" (OuterVolumeSpecName: "kube-api-access-7nxbs") pod "84c91aec-ce37-44d4-ab66-6c56b4194d54" (UID: "84c91aec-ce37-44d4-ab66-6c56b4194d54"). InnerVolumeSpecName "kube-api-access-7nxbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:20.856481 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.856427    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84c91aec-ce37-44d4-ab66-6c56b4194d54-extensions-socket-volume\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:10:20.856481 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.856449    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nxbs\" (UniqueName: \"kubernetes.io/projected/84c91aec-ce37-44d4-ab66-6c56b4194d54-kube-api-access-7nxbs\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:10:20.892811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.892784    2575 generic.go:356] "Generic (PLEG): container finished" podID="84c91aec-ce37-44d4-ab66-6c56b4194d54" containerID="a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904" exitCode=0
Jul 02 23:10:20.892893 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.892829    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"
Jul 02 23:10:20.892893 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.892866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd" event={"ID":"84c91aec-ce37-44d4-ab66-6c56b4194d54","Type":"ContainerDied","Data":"a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904"}
Jul 02 23:10:20.892976 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.892918    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd" event={"ID":"84c91aec-ce37-44d4-ab66-6c56b4194d54","Type":"ContainerDied","Data":"41c903f75632a931db94b344764be80236eb7038bb40db913da501483a6bba5d"}
Jul 02 23:10:20.892976 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.892942    2575 scope.go:117] "RemoveContainer" containerID="a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904"
Jul 02 23:10:20.901761 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.901586    2575 scope.go:117] "RemoveContainer" containerID="a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904"
Jul 02 23:10:20.901832 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:10:20.901813    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904\": container with ID starting with a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904 not found: ID does not exist" containerID="a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904"
Jul 02 23:10:20.901901 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.901839    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904"} err="failed to get container status \"a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904\": rpc error: code = NotFound desc = could not find container \"a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904\": container with ID starting with a377e0d75e567d8785fa5cd10226f7e2b2f2d0c277f91ebbf127d9625b749904 not found: ID does not exist"
Jul 02 23:10:20.921626 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.921605    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"]
Jul 02 23:10:20.925950 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:20.925912    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bhlpd"]
Jul 02 23:10:21.620181 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:21.620152    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c91aec-ce37-44d4-ab66-6c56b4194d54" path="/var/lib/kubelet/pods/84c91aec-ce37-44d4-ab66-6c56b4194d54/volumes"
Jul 02 23:10:39.894749 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.894707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c68fh"]
Jul 02 23:10:39.895212 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.895192    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c91aec-ce37-44d4-ab66-6c56b4194d54" containerName="manager"
Jul 02 23:10:39.895283 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.895216    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c91aec-ce37-44d4-ab66-6c56b4194d54" containerName="manager"
Jul 02 23:10:39.895334 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.895317    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c91aec-ce37-44d4-ab66-6c56b4194d54" containerName="manager"
Jul 02 23:10:39.897894 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.897875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:39.900351 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.900331    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 23:10:39.905372 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.905350    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c68fh"]
Jul 02 23:10:39.981253 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.981226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7d3fa836-faa1-47a0-baf6-8ba40fa01877-config-file\") pod \"limitador-limitador-64c94fd64f-c68fh\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:39.981415 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.981294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk5jd\" (UniqueName: \"kubernetes.io/projected/7d3fa836-faa1-47a0-baf6-8ba40fa01877-kube-api-access-nk5jd\") pod \"limitador-limitador-64c94fd64f-c68fh\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:39.991269 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:39.991244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c68fh"]
Jul 02 23:10:40.082068 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.082023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7d3fa836-faa1-47a0-baf6-8ba40fa01877-config-file\") pod \"limitador-limitador-64c94fd64f-c68fh\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:40.082184 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.082101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk5jd\" (UniqueName: \"kubernetes.io/projected/7d3fa836-faa1-47a0-baf6-8ba40fa01877-kube-api-access-nk5jd\") pod \"limitador-limitador-64c94fd64f-c68fh\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:40.082615 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.082595    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7d3fa836-faa1-47a0-baf6-8ba40fa01877-config-file\") pod \"limitador-limitador-64c94fd64f-c68fh\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:40.091689 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.091662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk5jd\" (UniqueName: \"kubernetes.io/projected/7d3fa836-faa1-47a0-baf6-8ba40fa01877-kube-api-access-nk5jd\") pod \"limitador-limitador-64c94fd64f-c68fh\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:40.208243 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.208191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:40.337284 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.337081    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c68fh"]
Jul 02 23:10:40.340537 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:10:40.340512    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3fa836_faa1_47a0_baf6_8ba40fa01877.slice/crio-8efa6b90a6591495753ae180f729c590837cb1b967a1050335097a0ea5e32684 WatchSource:0}: Error finding container 8efa6b90a6591495753ae180f729c590837cb1b967a1050335097a0ea5e32684: Status 404 returned error can't find the container with id 8efa6b90a6591495753ae180f729c590837cb1b967a1050335097a0ea5e32684
Jul 02 23:10:40.892595 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.892563    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hx24q"]
Jul 02 23:10:40.895251 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.895232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hx24q"
Jul 02 23:10:40.897700 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.897681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dckhd\""
Jul 02 23:10:40.902216 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.902084    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hx24q"]
Jul 02 23:10:40.988387 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.988360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhs54\" (UniqueName: \"kubernetes.io/projected/63e11db1-50e3-405e-9ed2-0ee623ac9925-kube-api-access-hhs54\") pod \"authorino-75d556bd77-hx24q\" (UID: \"63e11db1-50e3-405e-9ed2-0ee623ac9925\") " pod="kuadrant-system/authorino-75d556bd77-hx24q"
Jul 02 23:10:40.988655 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:40.988636    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh" event={"ID":"7d3fa836-faa1-47a0-baf6-8ba40fa01877","Type":"ContainerStarted","Data":"8efa6b90a6591495753ae180f729c590837cb1b967a1050335097a0ea5e32684"}
Jul 02 23:10:41.088929 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:41.088908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhs54\" (UniqueName: \"kubernetes.io/projected/63e11db1-50e3-405e-9ed2-0ee623ac9925-kube-api-access-hhs54\") pod \"authorino-75d556bd77-hx24q\" (UID: \"63e11db1-50e3-405e-9ed2-0ee623ac9925\") " pod="kuadrant-system/authorino-75d556bd77-hx24q"
Jul 02 23:10:41.097218 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:41.097199    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhs54\" (UniqueName: \"kubernetes.io/projected/63e11db1-50e3-405e-9ed2-0ee623ac9925-kube-api-access-hhs54\") pod \"authorino-75d556bd77-hx24q\" (UID: \"63e11db1-50e3-405e-9ed2-0ee623ac9925\") " pod="kuadrant-system/authorino-75d556bd77-hx24q"
Jul 02 23:10:41.205078 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:41.205004    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hx24q"
Jul 02 23:10:41.381858 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:41.381806    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hx24q"]
Jul 02 23:10:41.387518 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:10:41.387483    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63e11db1_50e3_405e_9ed2_0ee623ac9925.slice/crio-ccb5e7850ab1344abb1f8511c596f9ba27d2c3cd3dcb5e980bcb22755ca338b9 WatchSource:0}: Error finding container ccb5e7850ab1344abb1f8511c596f9ba27d2c3cd3dcb5e980bcb22755ca338b9: Status 404 returned error can't find the container with id ccb5e7850ab1344abb1f8511c596f9ba27d2c3cd3dcb5e980bcb22755ca338b9
Jul 02 23:10:41.999388 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:41.999329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hx24q" event={"ID":"63e11db1-50e3-405e-9ed2-0ee623ac9925","Type":"ContainerStarted","Data":"ccb5e7850ab1344abb1f8511c596f9ba27d2c3cd3dcb5e980bcb22755ca338b9"}
Jul 02 23:10:44.994083 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:10:44.994037    2575 log.go:32] "ImageFsInfo from image service failed" err="rpc error: code = Unknown desc = get image fs info unable to get usage for /var/lib/containers/storage/overlay-images: get disk usage for path /var/lib/containers/storage/overlay-images: lstat /var/lib/containers/storage/overlay-images/.tmp-images.json3299694930: no such file or directory"
Jul 02 23:10:44.994526 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:10:44.994099    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get imageFs stats: missing image stats: <nil>"
Jul 02 23:10:46.019358 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:46.019319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hx24q" event={"ID":"63e11db1-50e3-405e-9ed2-0ee623ac9925","Type":"ContainerStarted","Data":"a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870"}
Jul 02 23:10:46.020818 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:46.020783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh" event={"ID":"7d3fa836-faa1-47a0-baf6-8ba40fa01877","Type":"ContainerStarted","Data":"600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1"}
Jul 02 23:10:46.020962 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:46.020872    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:46.034846 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:46.034800    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hx24q" podStartSLOduration=2.406174647 podStartE2EDuration="6.034788586s" totalImagesPullingTime="3.628613939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:46.034034605 +0000 UTC m=+552.971083912" watchObservedRunningTime="2026-07-02 23:10:46.034788586 +0000 UTC m=+552.971837892"
Jul 02 23:10:46.051715 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:46.051670    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh" podStartSLOduration=2.383504122 podStartE2EDuration="7.051653107s" totalImagesPullingTime="4.668148985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:46.050620543 +0000 UTC m=+552.987669852" watchObservedRunningTime="2026-07-02 23:10:46.051653107 +0000 UTC m=+552.988702415"
Jul 02 23:10:57.025457 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:57.025427    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:57.086109 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:57.086085    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c68fh"]
Jul 02 23:10:57.086256 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:57.086221    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh" podUID="7d3fa836-faa1-47a0-baf6-8ba40fa01877" containerName="limitador" containerID="cri-o://600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1" gracePeriod=30
Jul 02 23:10:58.035827 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.035798    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:58.077173 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.077150    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d3fa836-faa1-47a0-baf6-8ba40fa01877" containerID="600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1" exitCode=0
Jul 02 23:10:58.077307 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.077202    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh"
Jul 02 23:10:58.077307 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.077233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh" event={"ID":"7d3fa836-faa1-47a0-baf6-8ba40fa01877","Type":"ContainerDied","Data":"600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1"}
Jul 02 23:10:58.077307 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.077302    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c68fh" event={"ID":"7d3fa836-faa1-47a0-baf6-8ba40fa01877","Type":"ContainerDied","Data":"8efa6b90a6591495753ae180f729c590837cb1b967a1050335097a0ea5e32684"}
Jul 02 23:10:58.077408 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.077324    2575 scope.go:117] "RemoveContainer" containerID="600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1"
Jul 02 23:10:58.085856 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.085840    2575 scope.go:117] "RemoveContainer" containerID="600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1"
Jul 02 23:10:58.086144 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:10:58.086126    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1\": container with ID starting with 600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1 not found: ID does not exist" containerID="600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1"
Jul 02 23:10:58.086217 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.086155    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1"} err="failed to get container status \"600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1\": rpc error: code = NotFound desc = could not find container \"600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1\": container with ID starting with 600db2694b9cca9111802f93833b142ecf4c257021598d903af0ba389c7dfea1 not found: ID does not exist"
Jul 02 23:10:58.118432 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.118411    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk5jd\" (UniqueName: \"kubernetes.io/projected/7d3fa836-faa1-47a0-baf6-8ba40fa01877-kube-api-access-nk5jd\") pod \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") "
Jul 02 23:10:58.118508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.118463    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7d3fa836-faa1-47a0-baf6-8ba40fa01877-config-file\") pod \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\" (UID: \"7d3fa836-faa1-47a0-baf6-8ba40fa01877\") "
Jul 02 23:10:58.118823 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.118804    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d3fa836-faa1-47a0-baf6-8ba40fa01877-config-file" (OuterVolumeSpecName: "config-file") pod "7d3fa836-faa1-47a0-baf6-8ba40fa01877" (UID: "7d3fa836-faa1-47a0-baf6-8ba40fa01877"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:58.120343 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.120318    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3fa836-faa1-47a0-baf6-8ba40fa01877-kube-api-access-nk5jd" (OuterVolumeSpecName: "kube-api-access-nk5jd") pod "7d3fa836-faa1-47a0-baf6-8ba40fa01877" (UID: "7d3fa836-faa1-47a0-baf6-8ba40fa01877"). InnerVolumeSpecName "kube-api-access-nk5jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:58.219215 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.219168    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk5jd\" (UniqueName: \"kubernetes.io/projected/7d3fa836-faa1-47a0-baf6-8ba40fa01877-kube-api-access-nk5jd\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:10:58.219215 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.219187    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7d3fa836-faa1-47a0-baf6-8ba40fa01877-config-file\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:10:58.399617 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.399591    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c68fh"]
Jul 02 23:10:58.404478 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:58.404449    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c68fh"]
Jul 02 23:10:59.620977 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:10:59.620936    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d3fa836-faa1-47a0-baf6-8ba40fa01877" path="/var/lib/kubelet/pods/7d3fa836-faa1-47a0-baf6-8ba40fa01877/volumes"
Jul 02 23:11:03.307591 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.307556    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-c8tsc"]
Jul 02 23:11:03.308039 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.308022    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3fa836-faa1-47a0-baf6-8ba40fa01877" containerName="limitador"
Jul 02 23:11:03.308133 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.308041    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3fa836-faa1-47a0-baf6-8ba40fa01877" containerName="limitador"
Jul 02 23:11:03.308172 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.308139    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d3fa836-faa1-47a0-baf6-8ba40fa01877" containerName="limitador"
Jul 02 23:11:03.310974 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.310959    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.313356 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.313335    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2rxlv\""
Jul 02 23:11:03.313491 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.313372    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 02 23:11:03.317365 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.317342    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c8tsc"]
Jul 02 23:11:03.358188 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.358162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6zt\" (UniqueName: \"kubernetes.io/projected/931e54f9-c51a-4bf8-a61a-5b24cc23856c-kube-api-access-bq6zt\") pod \"postgres-69fb4594cf-c8tsc\" (UID: \"931e54f9-c51a-4bf8-a61a-5b24cc23856c\") " pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.358279 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.358223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/931e54f9-c51a-4bf8-a61a-5b24cc23856c-data\") pod \"postgres-69fb4594cf-c8tsc\" (UID: \"931e54f9-c51a-4bf8-a61a-5b24cc23856c\") " pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.459175 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.459142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/931e54f9-c51a-4bf8-a61a-5b24cc23856c-data\") pod \"postgres-69fb4594cf-c8tsc\" (UID: \"931e54f9-c51a-4bf8-a61a-5b24cc23856c\") " pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.459265 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.459190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6zt\" (UniqueName: \"kubernetes.io/projected/931e54f9-c51a-4bf8-a61a-5b24cc23856c-kube-api-access-bq6zt\") pod \"postgres-69fb4594cf-c8tsc\" (UID: \"931e54f9-c51a-4bf8-a61a-5b24cc23856c\") " pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.459496 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.459478    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/931e54f9-c51a-4bf8-a61a-5b24cc23856c-data\") pod \"postgres-69fb4594cf-c8tsc\" (UID: \"931e54f9-c51a-4bf8-a61a-5b24cc23856c\") " pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.468362 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.468336    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6zt\" (UniqueName: \"kubernetes.io/projected/931e54f9-c51a-4bf8-a61a-5b24cc23856c-kube-api-access-bq6zt\") pod \"postgres-69fb4594cf-c8tsc\" (UID: \"931e54f9-c51a-4bf8-a61a-5b24cc23856c\") " pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.620928 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.620870    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:03.756165 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:03.756143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c8tsc"]
Jul 02 23:11:03.758640 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:11:03.758611    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931e54f9_c51a_4bf8_a61a_5b24cc23856c.slice/crio-cc8062f810d4ff4f95aabc38e95a7f27dff629f8f29485bb2517d19b0b4e2961 WatchSource:0}: Error finding container cc8062f810d4ff4f95aabc38e95a7f27dff629f8f29485bb2517d19b0b4e2961: Status 404 returned error can't find the container with id cc8062f810d4ff4f95aabc38e95a7f27dff629f8f29485bb2517d19b0b4e2961
Jul 02 23:11:04.108226 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:04.108199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c8tsc" event={"ID":"931e54f9-c51a-4bf8-a61a-5b24cc23856c","Type":"ContainerStarted","Data":"cc8062f810d4ff4f95aabc38e95a7f27dff629f8f29485bb2517d19b0b4e2961"}
Jul 02 23:11:10.139117 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:10.139074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c8tsc" event={"ID":"931e54f9-c51a-4bf8-a61a-5b24cc23856c","Type":"ContainerStarted","Data":"beeb4326809ddee107dcf59a9a4f21f34a85e56715cbf77f6599cff713f34db1"}
Jul 02 23:11:10.139469 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:10.139145    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:10.157858 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:10.157799    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-c8tsc" podStartSLOduration=1.588938312 podStartE2EDuration="7.157779798s" totalImagesPullingTime="5.568841486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:10.155402846 +0000 UTC m=+577.092452156" watchObservedRunningTime="2026-07-02 23:11:10.157779798 +0000 UTC m=+577.094829105"
Jul 02 23:11:16.174161 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:16.174129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-c8tsc"
Jul 02 23:11:16.943290 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:16.943259    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c4f684748-dz924"]
Jul 02 23:11:16.949617 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:16.949597    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c4f684748-dz924"
Jul 02 23:11:16.953438 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:16.953414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c4f684748-dz924"]
Jul 02 23:11:17.065687 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.065665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9lgt\" (UniqueName: \"kubernetes.io/projected/88396e32-9b97-48d0-b712-8361d3451476-kube-api-access-w9lgt\") pod \"authorino-7c4f684748-dz924\" (UID: \"88396e32-9b97-48d0-b712-8361d3451476\") " pod="kuadrant-system/authorino-7c4f684748-dz924"
Jul 02 23:11:17.067336 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.067316    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c4f684748-dz924"]
Jul 02 23:11:17.067519 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:11:17.067499    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-w9lgt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7c4f684748-dz924" podUID="88396e32-9b97-48d0-b712-8361d3451476"
Jul 02 23:11:17.166919 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.166898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9lgt\" (UniqueName: \"kubernetes.io/projected/88396e32-9b97-48d0-b712-8361d3451476-kube-api-access-w9lgt\") pod \"authorino-7c4f684748-dz924\" (UID: \"88396e32-9b97-48d0-b712-8361d3451476\") " pod="kuadrant-system/authorino-7c4f684748-dz924"
Jul 02 23:11:17.171788 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.171767    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c4f684748-dz924"
Jul 02 23:11:17.175093 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.175066    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9lgt\" (UniqueName: \"kubernetes.io/projected/88396e32-9b97-48d0-b712-8361d3451476-kube-api-access-w9lgt\") pod \"authorino-7c4f684748-dz924\" (UID: \"88396e32-9b97-48d0-b712-8361d3451476\") " pod="kuadrant-system/authorino-7c4f684748-dz924"
Jul 02 23:11:17.178496 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.178475    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c4f684748-dz924"
Jul 02 23:11:17.267181 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.267163    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9lgt\" (UniqueName: \"kubernetes.io/projected/88396e32-9b97-48d0-b712-8361d3451476-kube-api-access-w9lgt\") pod \"88396e32-9b97-48d0-b712-8361d3451476\" (UID: \"88396e32-9b97-48d0-b712-8361d3451476\") "
Jul 02 23:11:17.268954 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.268934    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88396e32-9b97-48d0-b712-8361d3451476-kube-api-access-w9lgt" (OuterVolumeSpecName: "kube-api-access-w9lgt") pod "88396e32-9b97-48d0-b712-8361d3451476" (UID: "88396e32-9b97-48d0-b712-8361d3451476"). InnerVolumeSpecName "kube-api-access-w9lgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:17.368155 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:17.368137    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9lgt\" (UniqueName: \"kubernetes.io/projected/88396e32-9b97-48d0-b712-8361d3451476-kube-api-access-w9lgt\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:11:18.176836 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:18.176814    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c4f684748-dz924"
Jul 02 23:11:18.201129 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:18.201104    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c4f684748-dz924"]
Jul 02 23:11:18.203664 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:18.203642    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c4f684748-dz924"]
Jul 02 23:11:19.261997 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:19.261966    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hx24q"]
Jul 02 23:11:19.262371 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:19.262183    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hx24q" podUID="63e11db1-50e3-405e-9ed2-0ee623ac9925" containerName="authorino" containerID="cri-o://a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870" gracePeriod=30
Jul 02 23:11:19.544804 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:19.544780    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hx24q"
Jul 02 23:11:19.620679 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:19.620652    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88396e32-9b97-48d0-b712-8361d3451476" path="/var/lib/kubelet/pods/88396e32-9b97-48d0-b712-8361d3451476/volumes"
Jul 02 23:11:19.684316 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:19.684292    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhs54\" (UniqueName: \"kubernetes.io/projected/63e11db1-50e3-405e-9ed2-0ee623ac9925-kube-api-access-hhs54\") pod \"63e11db1-50e3-405e-9ed2-0ee623ac9925\" (UID: \"63e11db1-50e3-405e-9ed2-0ee623ac9925\") "
Jul 02 23:11:19.686289 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:19.686266    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e11db1-50e3-405e-9ed2-0ee623ac9925-kube-api-access-hhs54" (OuterVolumeSpecName: "kube-api-access-hhs54") pod "63e11db1-50e3-405e-9ed2-0ee623ac9925" (UID: "63e11db1-50e3-405e-9ed2-0ee623ac9925"). InnerVolumeSpecName "kube-api-access-hhs54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:19.785408 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:19.785357    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhs54\" (UniqueName: \"kubernetes.io/projected/63e11db1-50e3-405e-9ed2-0ee623ac9925-kube-api-access-hhs54\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:11:20.187702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.187635    2575 generic.go:356] "Generic (PLEG): container finished" podID="63e11db1-50e3-405e-9ed2-0ee623ac9925" containerID="a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870" exitCode=0
Jul 02 23:11:20.187702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.187677    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hx24q"
Jul 02 23:11:20.187702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.187683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hx24q" event={"ID":"63e11db1-50e3-405e-9ed2-0ee623ac9925","Type":"ContainerDied","Data":"a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870"}
Jul 02 23:11:20.187877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.187722    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hx24q" event={"ID":"63e11db1-50e3-405e-9ed2-0ee623ac9925","Type":"ContainerDied","Data":"ccb5e7850ab1344abb1f8511c596f9ba27d2c3cd3dcb5e980bcb22755ca338b9"}
Jul 02 23:11:20.187877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.187744    2575 scope.go:117] "RemoveContainer" containerID="a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870"
Jul 02 23:11:20.196433 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.196413    2575 scope.go:117] "RemoveContainer" containerID="a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870"
Jul 02 23:11:20.196701 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:11:20.196682    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870\": container with ID starting with a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870 not found: ID does not exist" containerID="a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870"
Jul 02 23:11:20.196744 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.196709    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870"} err="failed to get container status \"a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870\": rpc error: code = NotFound desc = could not find container \"a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870\": container with ID starting with a7f7ae52e6369b2956650e9ffc91871e7b431851e510747b9cdd2d6978ea8870 not found: ID does not exist"
Jul 02 23:11:20.207748 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.207727    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hx24q"]
Jul 02 23:11:20.211394 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:20.211375    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hx24q"]
Jul 02 23:11:21.620850 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:21.620806    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e11db1-50e3-405e-9ed2-0ee623ac9925" path="/var/lib/kubelet/pods/63e11db1-50e3-405e-9ed2-0ee623ac9925/volumes"
Jul 02 23:11:23.421971 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.421935    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-866d8579fd-bk4h2"]
Jul 02 23:11:23.422469 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.422454    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e11db1-50e3-405e-9ed2-0ee623ac9925" containerName="authorino"
Jul 02 23:11:23.422511 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.422472    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e11db1-50e3-405e-9ed2-0ee623ac9925" containerName="authorino"
Jul 02 23:11:23.422594 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.422584    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e11db1-50e3-405e-9ed2-0ee623ac9925" containerName="authorino"
Jul 02 23:11:23.426243 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.426228    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.428874 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.428843    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zfkp8\""
Jul 02 23:11:23.429007 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.428922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 23:11:23.429007 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.428922    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 23:11:23.438514 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.438495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-866d8579fd-bk4h2"]
Jul 02 23:11:23.510173 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.510144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77g7f\" (UniqueName: \"kubernetes.io/projected/f5489793-8c48-4b42-ba63-9be5e1fd9877-kube-api-access-77g7f\") pod \"maas-controller-866d8579fd-bk4h2\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") " pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.510272 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.510196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5489793-8c48-4b42-ba63-9be5e1fd9877-webhook-cert\") pod \"maas-controller-866d8579fd-bk4h2\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") " pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.610443 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.610423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5489793-8c48-4b42-ba63-9be5e1fd9877-webhook-cert\") pod \"maas-controller-866d8579fd-bk4h2\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") " pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.610561 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.610467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77g7f\" (UniqueName: \"kubernetes.io/projected/f5489793-8c48-4b42-ba63-9be5e1fd9877-kube-api-access-77g7f\") pod \"maas-controller-866d8579fd-bk4h2\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") " pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.612814 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.612792    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5489793-8c48-4b42-ba63-9be5e1fd9877-webhook-cert\") pod \"maas-controller-866d8579fd-bk4h2\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") " pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.620828 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.620807    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77g7f\" (UniqueName: \"kubernetes.io/projected/f5489793-8c48-4b42-ba63-9be5e1fd9877-kube-api-access-77g7f\") pod \"maas-controller-866d8579fd-bk4h2\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") " pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.736147 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.736076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:23.858336 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:23.858312    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-866d8579fd-bk4h2"]
Jul 02 23:11:23.859762 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:11:23.859734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5489793_8c48_4b42_ba63_9be5e1fd9877.slice/crio-b9c28720dbd30c84caa749d8697ee33a65af0cdd5be31ace4213be8ad6183785 WatchSource:0}: Error finding container b9c28720dbd30c84caa749d8697ee33a65af0cdd5be31ace4213be8ad6183785: Status 404 returned error can't find the container with id b9c28720dbd30c84caa749d8697ee33a65af0cdd5be31ace4213be8ad6183785
Jul 02 23:11:24.209526 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:24.209491    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-866d8579fd-bk4h2" event={"ID":"f5489793-8c48-4b42-ba63-9be5e1fd9877","Type":"ContainerStarted","Data":"b9c28720dbd30c84caa749d8697ee33a65af0cdd5be31ace4213be8ad6183785"}
Jul 02 23:11:26.221019 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:26.220979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-866d8579fd-bk4h2" event={"ID":"f5489793-8c48-4b42-ba63-9be5e1fd9877","Type":"ContainerStarted","Data":"d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811"}
Jul 02 23:11:26.221439 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:26.221084    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:26.240097 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:26.240031    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-866d8579fd-bk4h2" podStartSLOduration=1.475791132 podStartE2EDuration="3.240017554s" totalImagesPullingTime="1.764226422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:26.238349183 +0000 UTC m=+593.175398491" watchObservedRunningTime="2026-07-02 23:11:26.240017554 +0000 UTC m=+593.177066862"
Jul 02 23:11:33.525740 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:33.525705    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:11:33.528815 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:33.528793    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:11:37.230945 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:37.230914    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:37.769444 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:37.769411    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-866d8579fd-bk4h2"]
Jul 02 23:11:37.769663 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:37.769624    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-866d8579fd-bk4h2" podUID="f5489793-8c48-4b42-ba63-9be5e1fd9877" containerName="manager" containerID="cri-o://d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811" gracePeriod=30
Jul 02 23:11:38.008269 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.008242    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:38.112225 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.112174    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77g7f\" (UniqueName: \"kubernetes.io/projected/f5489793-8c48-4b42-ba63-9be5e1fd9877-kube-api-access-77g7f\") pod \"f5489793-8c48-4b42-ba63-9be5e1fd9877\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") "
Jul 02 23:11:38.112225 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.112223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5489793-8c48-4b42-ba63-9be5e1fd9877-webhook-cert\") pod \"f5489793-8c48-4b42-ba63-9be5e1fd9877\" (UID: \"f5489793-8c48-4b42-ba63-9be5e1fd9877\") "
Jul 02 23:11:38.114174 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.114150    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5489793-8c48-4b42-ba63-9be5e1fd9877-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f5489793-8c48-4b42-ba63-9be5e1fd9877" (UID: "f5489793-8c48-4b42-ba63-9be5e1fd9877"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:11:38.114265 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.114213    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5489793-8c48-4b42-ba63-9be5e1fd9877-kube-api-access-77g7f" (OuterVolumeSpecName: "kube-api-access-77g7f") pod "f5489793-8c48-4b42-ba63-9be5e1fd9877" (UID: "f5489793-8c48-4b42-ba63-9be5e1fd9877"). InnerVolumeSpecName "kube-api-access-77g7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:38.213184 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.213160    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77g7f\" (UniqueName: \"kubernetes.io/projected/f5489793-8c48-4b42-ba63-9be5e1fd9877-kube-api-access-77g7f\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:11:38.213184 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.213181    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5489793-8c48-4b42-ba63-9be5e1fd9877-webhook-cert\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:11:38.280890 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.280862    2575 generic.go:356] "Generic (PLEG): container finished" podID="f5489793-8c48-4b42-ba63-9be5e1fd9877" containerID="d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811" exitCode=0
Jul 02 23:11:38.281178 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.280908    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-866d8579fd-bk4h2"
Jul 02 23:11:38.281178 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.280949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-866d8579fd-bk4h2" event={"ID":"f5489793-8c48-4b42-ba63-9be5e1fd9877","Type":"ContainerDied","Data":"d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811"}
Jul 02 23:11:38.281178 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.281005    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-866d8579fd-bk4h2" event={"ID":"f5489793-8c48-4b42-ba63-9be5e1fd9877","Type":"ContainerDied","Data":"b9c28720dbd30c84caa749d8697ee33a65af0cdd5be31ace4213be8ad6183785"}
Jul 02 23:11:38.281178 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.281032    2575 scope.go:117] "RemoveContainer" containerID="d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811"
Jul 02 23:11:38.290964 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.290948    2575 scope.go:117] "RemoveContainer" containerID="d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811"
Jul 02 23:11:38.291333 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:11:38.291312    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811\": container with ID starting with d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811 not found: ID does not exist" containerID="d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811"
Jul 02 23:11:38.291403 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.291345    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811"} err="failed to get container status \"d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811\": rpc error: code = NotFound desc = could not find container \"d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811\": container with ID starting with d4a93732a5f5c52fbb36bb61e93dd3a526ca82c532f3a0569ea1e2f547cea811 not found: ID does not exist"
Jul 02 23:11:38.302882 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.302857    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-866d8579fd-bk4h2"]
Jul 02 23:11:38.307154 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:38.307132    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-866d8579fd-bk4h2"]
Jul 02 23:11:39.620683 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:39.620652    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5489793-8c48-4b42-ba63-9be5e1fd9877" path="/var/lib/kubelet/pods/f5489793-8c48-4b42-ba63-9be5e1fd9877/volumes"
Jul 02 23:11:57.611698 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.611623    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-847b8884f6-9288t"]
Jul 02 23:11:57.612165 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.611986    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5489793-8c48-4b42-ba63-9be5e1fd9877" containerName="manager"
Jul 02 23:11:57.612165 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.612000    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5489793-8c48-4b42-ba63-9be5e1fd9877" containerName="manager"
Jul 02 23:11:57.612165 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.612099    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5489793-8c48-4b42-ba63-9be5e1fd9877" containerName="manager"
Jul 02 23:11:57.634756 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.634735    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-847b8884f6-9288t"]
Jul 02 23:11:57.634959 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.634940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.638490 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.638469    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 23:11:57.639656 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.639630    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2mvtr\""
Jul 02 23:11:57.749560 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.749538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7d4785-7f6d-4526-910d-18fe1a902f8f-maas-api-tls\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.749669 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.749566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7d4785-7f6d-4526-910d-18fe1a902f8f-openshift-service-ca\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.749669 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.749644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69xwb\" (UniqueName: \"kubernetes.io/projected/ed7d4785-7f6d-4526-910d-18fe1a902f8f-kube-api-access-69xwb\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.850271 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.850252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7d4785-7f6d-4526-910d-18fe1a902f8f-maas-api-tls\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.850368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.850278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7d4785-7f6d-4526-910d-18fe1a902f8f-openshift-service-ca\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.850368 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.850315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69xwb\" (UniqueName: \"kubernetes.io/projected/ed7d4785-7f6d-4526-910d-18fe1a902f8f-kube-api-access-69xwb\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.850860 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.850841    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7d4785-7f6d-4526-910d-18fe1a902f8f-openshift-service-ca\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.852883 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.852861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7d4785-7f6d-4526-910d-18fe1a902f8f-maas-api-tls\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.858023 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.858000    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69xwb\" (UniqueName: \"kubernetes.io/projected/ed7d4785-7f6d-4526-910d-18fe1a902f8f-kube-api-access-69xwb\") pod \"maas-api-847b8884f6-9288t\" (UID: \"ed7d4785-7f6d-4526-910d-18fe1a902f8f\") " pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:57.951979 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:57.951934    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:11:58.089862 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.089839    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-847b8884f6-9288t"]
Jul 02 23:11:58.092109 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:11:58.092065    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7d4785_7f6d_4526_910d_18fe1a902f8f.slice/crio-26a69af5609a15244dd8d0e3d5ee772092b13cf2397b4b683cbd8391ecc9519e WatchSource:0}: Error finding container 26a69af5609a15244dd8d0e3d5ee772092b13cf2397b4b683cbd8391ecc9519e: Status 404 returned error can't find the container with id 26a69af5609a15244dd8d0e3d5ee772092b13cf2397b4b683cbd8391ecc9519e
Jul 02 23:11:58.156925 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.156899    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-chhpf"]
Jul 02 23:11:58.161400 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.161383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.163758 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.163738    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 23:11:58.164421 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.164403    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sqstf\""
Jul 02 23:11:58.169012 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.168814    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-chhpf"]
Jul 02 23:11:58.353869 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.353839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqx5v\" (UniqueName: \"kubernetes.io/projected/573a8541-1d41-4c55-a0fe-0bd249785cae-kube-api-access-zqx5v\") pod \"payload-processing-58f86c7798-chhpf\" (UID: \"573a8541-1d41-4c55-a0fe-0bd249785cae\") " pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.353982 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.353902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/573a8541-1d41-4c55-a0fe-0bd249785cae-plugins-config-volume\") pod \"payload-processing-58f86c7798-chhpf\" (UID: \"573a8541-1d41-4c55-a0fe-0bd249785cae\") " pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.372924 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.372899    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-847b8884f6-9288t" event={"ID":"ed7d4785-7f6d-4526-910d-18fe1a902f8f","Type":"ContainerStarted","Data":"26a69af5609a15244dd8d0e3d5ee772092b13cf2397b4b683cbd8391ecc9519e"}
Jul 02 23:11:58.454713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.454686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/573a8541-1d41-4c55-a0fe-0bd249785cae-plugins-config-volume\") pod \"payload-processing-58f86c7798-chhpf\" (UID: \"573a8541-1d41-4c55-a0fe-0bd249785cae\") " pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.454827 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.454723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqx5v\" (UniqueName: \"kubernetes.io/projected/573a8541-1d41-4c55-a0fe-0bd249785cae-kube-api-access-zqx5v\") pod \"payload-processing-58f86c7798-chhpf\" (UID: \"573a8541-1d41-4c55-a0fe-0bd249785cae\") " pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.455443 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.455425    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/573a8541-1d41-4c55-a0fe-0bd249785cae-plugins-config-volume\") pod \"payload-processing-58f86c7798-chhpf\" (UID: \"573a8541-1d41-4c55-a0fe-0bd249785cae\") " pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.463484 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.463461    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqx5v\" (UniqueName: \"kubernetes.io/projected/573a8541-1d41-4c55-a0fe-0bd249785cae-kube-api-access-zqx5v\") pod \"payload-processing-58f86c7798-chhpf\" (UID: \"573a8541-1d41-4c55-a0fe-0bd249785cae\") " pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.472198 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.472180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:11:58.605351 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:58.605247    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-chhpf"]
Jul 02 23:11:58.607431 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:11:58.607406    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573a8541_1d41_4c55_a0fe_0bd249785cae.slice/crio-5b13a6164d6ebb4cca96225c39ed4280f389efbc1e2f5f583fac2ec4a1c4ae60 WatchSource:0}: Error finding container 5b13a6164d6ebb4cca96225c39ed4280f389efbc1e2f5f583fac2ec4a1c4ae60: Status 404 returned error can't find the container with id 5b13a6164d6ebb4cca96225c39ed4280f389efbc1e2f5f583fac2ec4a1c4ae60
Jul 02 23:11:59.380987 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:11:59.380947    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-chhpf" event={"ID":"573a8541-1d41-4c55-a0fe-0bd249785cae","Type":"ContainerStarted","Data":"5b13a6164d6ebb4cca96225c39ed4280f389efbc1e2f5f583fac2ec4a1c4ae60"}
Jul 02 23:12:00.387536 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:00.387454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-chhpf" event={"ID":"573a8541-1d41-4c55-a0fe-0bd249785cae","Type":"ContainerStarted","Data":"75a4dd857982c3d494a5edcc3cf1d0768403e24adb77f1290788833255944d84"}
Jul 02 23:12:00.387536 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:00.387521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:12:00.388853 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:00.388829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-847b8884f6-9288t" event={"ID":"ed7d4785-7f6d-4526-910d-18fe1a902f8f","Type":"ContainerStarted","Data":"3627ac40f8b4c890b6c00ff5030b4e3ac2385c5c3636d75140f9dca715f1ab62"}
Jul 02 23:12:00.388971 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:00.388944    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:12:00.404292 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:00.404252    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-chhpf" podStartSLOduration=0.981105251 podStartE2EDuration="2.404238366s" totalImagesPullingTime="1.423133115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:00.40296924 +0000 UTC m=+627.340018547" watchObservedRunningTime="2026-07-02 23:12:00.404238366 +0000 UTC m=+627.341287674"
Jul 02 23:12:00.420719 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:00.420684    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-847b8884f6-9288t" podStartSLOduration=1.483719453 podStartE2EDuration="3.420673108s" totalImagesPullingTime="1.936953655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:00.418268619 +0000 UTC m=+627.355317927" watchObservedRunningTime="2026-07-02 23:12:00.420673108 +0000 UTC m=+627.357722414"
Jul 02 23:12:06.398897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:06.398864    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-847b8884f6-9288t"
Jul 02 23:12:11.395216 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:11.395180    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-chhpf"
Jul 02 23:12:16.281716 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.281686    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"]
Jul 02 23:12:16.286399 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.286375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.288824 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.288804    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 23:12:16.289715 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.289693    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pgtwg\""
Jul 02 23:12:16.289774 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.289746    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 23:12:16.289816 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.289700    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 02 23:12:16.296642 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.296618    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"]
Jul 02 23:12:16.380787 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.380763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jpmv\" (UniqueName: \"kubernetes.io/projected/b4bd8169-66bc-4d72-a705-3e7e5df85479-kube-api-access-7jpmv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.380876 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.380792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.380876 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.380830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bd8169-66bc-4d72-a705-3e7e5df85479-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.380876 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.380871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.380978 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.380894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.380978 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.380921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481351 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jpmv\" (UniqueName: \"kubernetes.io/projected/b4bd8169-66bc-4d72-a705-3e7e5df85479-kube-api-access-7jpmv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481435 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481435 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bd8169-66bc-4d72-a705-3e7e5df85479-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481532 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481504    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481696 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481696 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481882 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481860    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481951 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481885    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.481951 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.481933    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.483515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.483495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bd8169-66bc-4d72-a705-3e7e5df85479-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.483752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.483736    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bd8169-66bc-4d72-a705-3e7e5df85479-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.489146 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.489128    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jpmv\" (UniqueName: \"kubernetes.io/projected/b4bd8169-66bc-4d72-a705-3e7e5df85479-kube-api-access-7jpmv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb\" (UID: \"b4bd8169-66bc-4d72-a705-3e7e5df85479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.597729 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.597677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:16.728622 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.728598    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"]
Jul 02 23:12:16.731196 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:12:16.731169    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bd8169_66bc_4d72_a705_3e7e5df85479.slice/crio-29472f86000bdb992bbe8d22308bc771518debf2033df0bdad88406454f6ac6e WatchSource:0}: Error finding container 29472f86000bdb992bbe8d22308bc771518debf2033df0bdad88406454f6ac6e: Status 404 returned error can't find the container with id 29472f86000bdb992bbe8d22308bc771518debf2033df0bdad88406454f6ac6e
Jul 02 23:12:16.732622 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:16.732602    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:12:17.468254 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:17.468219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb" event={"ID":"b4bd8169-66bc-4d72-a705-3e7e5df85479","Type":"ContainerStarted","Data":"29472f86000bdb992bbe8d22308bc771518debf2033df0bdad88406454f6ac6e"}
Jul 02 23:12:18.477526 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:18.477497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb" event={"ID":"b4bd8169-66bc-4d72-a705-3e7e5df85479","Type":"ContainerStarted","Data":"ba9a6ab5f7460d533e699df4c824deb3c366bf6d0635c5f6834b6658bdcf60e7"}
Jul 02 23:12:18.497034 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:18.496986    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb" podStartSLOduration=1.417875879 podStartE2EDuration="2.496973199s" totalImagesPullingTime="1.07909732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:18.495417696 +0000 UTC m=+645.432467003" watchObservedRunningTime="2026-07-02 23:12:18.496973199 +0000 UTC m=+645.434022507"
Jul 02 23:12:26.597981 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:26.597944    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:26.598428 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:26.597997    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:26.610314 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:26.610287    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:27.531199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:27.531162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb"
Jul 02 23:12:43.276802 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.276769    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"]
Jul 02 23:12:43.281695 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.281674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.284179 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.284159    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 23:12:43.290336 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.290315    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"]
Jul 02 23:12:43.379098 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.379073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.379229 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.379106    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e21bc1-cb68-45d7-984d-31eb4c4b523f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.379229 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.379127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.379229 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.379216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.379367 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.379256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.379367 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.379275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6d66\" (UniqueName: \"kubernetes.io/projected/70e21bc1-cb68-45d7-984d-31eb4c4b523f-kube-api-access-q6d66\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480004 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.479973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480159 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480159 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6d66\" (UniqueName: \"kubernetes.io/projected/70e21bc1-cb68-45d7-984d-31eb4c4b523f-kube-api-access-q6d66\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480159 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480159 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e21bc1-cb68-45d7-984d-31eb4c4b523f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480159 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480449 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480428    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480463    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.480508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.480495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.482417 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.482399    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e21bc1-cb68-45d7-984d-31eb4c4b523f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.482706 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.482688    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e21bc1-cb68-45d7-984d-31eb4c4b523f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.493013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.492994    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6d66\" (UniqueName: \"kubernetes.io/projected/70e21bc1-cb68-45d7-984d-31eb4c4b523f-kube-api-access-q6d66\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d87hx\" (UID: \"70e21bc1-cb68-45d7-984d-31eb4c4b523f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.593770 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.593717    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:43.724848 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:43.724800    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"]
Jul 02 23:12:43.727608 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:12:43.727582    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e21bc1_cb68_45d7_984d_31eb4c4b523f.slice/crio-dc7ae6e13a4d2226b57c8281a680a109747c7142cc9e978b0b285ad44ff285fb WatchSource:0}: Error finding container dc7ae6e13a4d2226b57c8281a680a109747c7142cc9e978b0b285ad44ff285fb: Status 404 returned error can't find the container with id dc7ae6e13a4d2226b57c8281a680a109747c7142cc9e978b0b285ad44ff285fb
Jul 02 23:12:44.606321 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:44.606291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx" event={"ID":"70e21bc1-cb68-45d7-984d-31eb4c4b523f","Type":"ContainerStarted","Data":"32db2fcb3fc4f172ddca26a3e3cec175a6753a6e483c4f39a3ab6a322e3b3b31"}
Jul 02 23:12:44.606671 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:44.606338    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx" event={"ID":"70e21bc1-cb68-45d7-984d-31eb4c4b523f","Type":"ContainerStarted","Data":"dc7ae6e13a4d2226b57c8281a680a109747c7142cc9e978b0b285ad44ff285fb"}
Jul 02 23:12:44.624934 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:44.624887    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx" podStartSLOduration=1.4397415709999999 podStartE2EDuration="1.624874589s" totalImagesPullingTime="185.133018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:44.622536843 +0000 UTC m=+671.559586150" watchObservedRunningTime="2026-07-02 23:12:44.624874589 +0000 UTC m=+671.561923897"
Jul 02 23:12:53.594769 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:53.594728    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:53.595187 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:53.594840    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:53.607083 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:53.607042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:12:53.660226 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:12:53.660196    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d87hx"
Jul 02 23:16:33.561181 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:16:33.561106    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:16:33.561604 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:16:33.561516    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:19:57.905396 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:19:57.905314    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"]
Jul 02 23:19:57.910256 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:19:57.905963    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z" podUID="076c42a4-1005-423b-ae63-789fd7771612" containerName="manager" containerID="cri-o://b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380" gracePeriod=10
Jul 02 23:19:59.843841 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:19:59.843800    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z" podUID="076c42a4-1005-423b-ae63-789fd7771612" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.37:8081/readyz\": dial tcp 10.134.0.37:8081: connect: connection refused"
Jul 02 23:19:59.967738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:19:59.967713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:20:00.022951 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.022923    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npp4f\" (UniqueName: \"kubernetes.io/projected/076c42a4-1005-423b-ae63-789fd7771612-kube-api-access-npp4f\") pod \"076c42a4-1005-423b-ae63-789fd7771612\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") "
Jul 02 23:20:00.023114 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.022993    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076c42a4-1005-423b-ae63-789fd7771612-extensions-socket-volume\") pod \"076c42a4-1005-423b-ae63-789fd7771612\" (UID: \"076c42a4-1005-423b-ae63-789fd7771612\") "
Jul 02 23:20:00.023366 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.023342    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/076c42a4-1005-423b-ae63-789fd7771612-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "076c42a4-1005-423b-ae63-789fd7771612" (UID: "076c42a4-1005-423b-ae63-789fd7771612"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:20:00.024849 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.024827    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076c42a4-1005-423b-ae63-789fd7771612-kube-api-access-npp4f" (OuterVolumeSpecName: "kube-api-access-npp4f") pod "076c42a4-1005-423b-ae63-789fd7771612" (UID: "076c42a4-1005-423b-ae63-789fd7771612"). InnerVolumeSpecName "kube-api-access-npp4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:20:00.123811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.123789    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/076c42a4-1005-423b-ae63-789fd7771612-extensions-socket-volume\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:20:00.123811 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.123810    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npp4f\" (UniqueName: \"kubernetes.io/projected/076c42a4-1005-423b-ae63-789fd7771612-kube-api-access-npp4f\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:20:00.660916 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.660882    2575 generic.go:356] "Generic (PLEG): container finished" podID="076c42a4-1005-423b-ae63-789fd7771612" containerID="b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380" exitCode=0
Jul 02 23:20:00.661102 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.660922    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"
Jul 02 23:20:00.661102 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.660922    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z" event={"ID":"076c42a4-1005-423b-ae63-789fd7771612","Type":"ContainerDied","Data":"b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380"}
Jul 02 23:20:00.661102 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.661026    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z" event={"ID":"076c42a4-1005-423b-ae63-789fd7771612","Type":"ContainerDied","Data":"868e30c928dbe18de479f559eab13607988987bdfb1192a13ea936703795cd35"}
Jul 02 23:20:00.661102 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.661081    2575 scope.go:117] "RemoveContainer" containerID="b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380"
Jul 02 23:20:00.671831 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.671811    2575 scope.go:117] "RemoveContainer" containerID="b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380"
Jul 02 23:20:00.672143 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:20:00.672123    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380\": container with ID starting with b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380 not found: ID does not exist" containerID="b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380"
Jul 02 23:20:00.672186 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.672150    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380"} err="failed to get container status \"b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380\": rpc error: code = NotFound desc = could not find container \"b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380\": container with ID starting with b915c51cea8127c66d24a2e983ed978da5d2cc6683a997a0afd96ecee869c380 not found: ID does not exist"
Jul 02 23:20:00.683184 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.683163    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"]
Jul 02 23:20:00.688863 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:00.688843    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vll4z"]
Jul 02 23:20:01.624109 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:01.624080    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076c42a4-1005-423b-ae63-789fd7771612" path="/var/lib/kubelet/pods/076c42a4-1005-423b-ae63-789fd7771612/volumes"
Jul 02 23:20:59.070262 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.070179    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"]
Jul 02 23:20:59.070724 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.070532    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076c42a4-1005-423b-ae63-789fd7771612" containerName="manager"
Jul 02 23:20:59.070724 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.070544    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="076c42a4-1005-423b-ae63-789fd7771612" containerName="manager"
Jul 02 23:20:59.070724 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.070612    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="076c42a4-1005-423b-ae63-789fd7771612" containerName="manager"
Jul 02 23:20:59.074753 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.074736    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.078077 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.078035    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2f7wz\""
Jul 02 23:20:59.096110 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.096068    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"]
Jul 02 23:20:59.256008 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.255980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d9b8167-f473-4aba-8584-3ffb227ad9d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mnbf7\" (UID: \"6d9b8167-f473-4aba-8584-3ffb227ad9d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.256175 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.256018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl2mh\" (UniqueName: \"kubernetes.io/projected/6d9b8167-f473-4aba-8584-3ffb227ad9d0-kube-api-access-wl2mh\") pod \"kuadrant-operator-controller-manager-86878c769f-mnbf7\" (UID: \"6d9b8167-f473-4aba-8584-3ffb227ad9d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.356721 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.356663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl2mh\" (UniqueName: \"kubernetes.io/projected/6d9b8167-f473-4aba-8584-3ffb227ad9d0-kube-api-access-wl2mh\") pod \"kuadrant-operator-controller-manager-86878c769f-mnbf7\" (UID: \"6d9b8167-f473-4aba-8584-3ffb227ad9d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.356804 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.356728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d9b8167-f473-4aba-8584-3ffb227ad9d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mnbf7\" (UID: \"6d9b8167-f473-4aba-8584-3ffb227ad9d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.357011 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.356996    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d9b8167-f473-4aba-8584-3ffb227ad9d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mnbf7\" (UID: \"6d9b8167-f473-4aba-8584-3ffb227ad9d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.365084 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.365038    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl2mh\" (UniqueName: \"kubernetes.io/projected/6d9b8167-f473-4aba-8584-3ffb227ad9d0-kube-api-access-wl2mh\") pod \"kuadrant-operator-controller-manager-86878c769f-mnbf7\" (UID: \"6d9b8167-f473-4aba-8584-3ffb227ad9d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.384877 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.384852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.521352 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.521328    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"]
Jul 02 23:20:59.523370 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:20:59.523345    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9b8167_f473_4aba_8584_3ffb227ad9d0.slice/crio-1b53d5968fc25eb8ece2568462187d357c6a6d37e8f8cebe4e2d9bc6c2644cbd WatchSource:0}: Error finding container 1b53d5968fc25eb8ece2568462187d357c6a6d37e8f8cebe4e2d9bc6c2644cbd: Status 404 returned error can't find the container with id 1b53d5968fc25eb8ece2568462187d357c6a6d37e8f8cebe4e2d9bc6c2644cbd
Jul 02 23:20:59.944356 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.944321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7" event={"ID":"6d9b8167-f473-4aba-8584-3ffb227ad9d0","Type":"ContainerStarted","Data":"c69ced11456be548fb9bd93b90c50c236645ebf9a0261778948e4eb734cfaca2"}
Jul 02 23:20:59.944510 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.944373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7" event={"ID":"6d9b8167-f473-4aba-8584-3ffb227ad9d0","Type":"ContainerStarted","Data":"1b53d5968fc25eb8ece2568462187d357c6a6d37e8f8cebe4e2d9bc6c2644cbd"}
Jul 02 23:20:59.944510 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.944395    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:20:59.966843 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:20:59.966793    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7" podStartSLOduration=0.966778899 podStartE2EDuration="966.778899ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:59.965865603 +0000 UTC m=+1166.902914911" watchObservedRunningTime="2026-07-02 23:20:59.966778899 +0000 UTC m=+1166.903828206"
Jul 02 23:21:10.953037 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:21:10.952985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mnbf7"
Jul 02 23:21:33.587666 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:21:33.587637    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:21:33.588627 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:21:33.588605    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:26:33.615110 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:26:33.615084    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:26:33.617362 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:26:33.617328    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:27:08.935310 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:08.935281    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"]
Jul 02 23:27:08.938511 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:08.938489    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:08.940876 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:08.940854    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-227deae5-serving-cert\""
Jul 02 23:27:08.950405 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:08.950382    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"]
Jul 02 23:27:09.007829 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.007802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvqf6\" (UniqueName: \"kubernetes.io/projected/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-kube-api-access-gvqf6\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.007941 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.007844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-maas-api-tls\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.007941 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.007878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-openshift-service-ca\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.108818 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.108796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvqf6\" (UniqueName: \"kubernetes.io/projected/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-kube-api-access-gvqf6\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.108921 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.108823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-maas-api-tls\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.108921 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.108855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-openshift-service-ca\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.109513 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.109495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-openshift-service-ca\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.111199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.111180    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-maas-api-tls\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.117320 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.117296    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvqf6\" (UniqueName: \"kubernetes.io/projected/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-kube-api-access-gvqf6\") pod \"maas-api-e2e-ait-227deae5-786c64c964-7zwzz\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") " pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.251450 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.251377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:09.388925 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.388904    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"]
Jul 02 23:27:09.390880 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:27:09.390853    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e6cb4d_3d79_4c7f_92a9_362daf2751bc.slice/crio-fdb8df113136fca272643fd21db7d340faa9b93be0ad29efd4acfb1b8a6eb8fd WatchSource:0}: Error finding container fdb8df113136fca272643fd21db7d340faa9b93be0ad29efd4acfb1b8a6eb8fd: Status 404 returned error can't find the container with id fdb8df113136fca272643fd21db7d340faa9b93be0ad29efd4acfb1b8a6eb8fd
Jul 02 23:27:09.392192 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.392175    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:27:09.689873 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:09.689830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz" event={"ID":"15e6cb4d-3d79-4c7f-92a9-362daf2751bc","Type":"ContainerStarted","Data":"fdb8df113136fca272643fd21db7d340faa9b93be0ad29efd4acfb1b8a6eb8fd"}
Jul 02 23:27:10.696148 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:10.696111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz" event={"ID":"15e6cb4d-3d79-4c7f-92a9-362daf2751bc","Type":"ContainerStarted","Data":"dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1"}
Jul 02 23:27:10.696515 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:10.696245    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:10.712881 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:10.712843    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz" podStartSLOduration=2.095218812 podStartE2EDuration="2.712830586s" totalImagesPullingTime="617.611774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:27:10.710695302 +0000 UTC m=+1537.647744609" watchObservedRunningTime="2026-07-02 23:27:10.712830586 +0000 UTC m=+1537.649879893"
Jul 02 23:27:14.420771 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.420740    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"]
Jul 02 23:27:14.421261 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.420987    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz" podUID="15e6cb4d-3d79-4c7f-92a9-362daf2751bc" containerName="maas-api" containerID="cri-o://dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1" gracePeriod=30
Jul 02 23:27:14.674632 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.674583    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:14.715202 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.715177    2575 generic.go:356] "Generic (PLEG): container finished" podID="15e6cb4d-3d79-4c7f-92a9-362daf2751bc" containerID="dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1" exitCode=0
Jul 02 23:27:14.715322 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.715214    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"
Jul 02 23:27:14.715322 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.715259    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz" event={"ID":"15e6cb4d-3d79-4c7f-92a9-362daf2751bc","Type":"ContainerDied","Data":"dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1"}
Jul 02 23:27:14.715322 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.715312    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz" event={"ID":"15e6cb4d-3d79-4c7f-92a9-362daf2751bc","Type":"ContainerDied","Data":"fdb8df113136fca272643fd21db7d340faa9b93be0ad29efd4acfb1b8a6eb8fd"}
Jul 02 23:27:14.715479 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.715340    2575 scope.go:117] "RemoveContainer" containerID="dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1"
Jul 02 23:27:14.723586 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.723572    2575 scope.go:117] "RemoveContainer" containerID="dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1"
Jul 02 23:27:14.723811 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:27:14.723782    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1\": container with ID starting with dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1 not found: ID does not exist" containerID="dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1"
Jul 02 23:27:14.723944 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.723808    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1"} err="failed to get container status \"dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1\": rpc error: code = NotFound desc = could not find container \"dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1\": container with ID starting with dbe90a72204d82e4e630842822964e187ac35378789f2afb721be6bbb8f92dd1 not found: ID does not exist"
Jul 02 23:27:14.754955 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.754928    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-maas-api-tls\") pod \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") "
Jul 02 23:27:14.755082 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.754964    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvqf6\" (UniqueName: \"kubernetes.io/projected/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-kube-api-access-gvqf6\") pod \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") "
Jul 02 23:27:14.755082 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.754996    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-openshift-service-ca\") pod \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\" (UID: \"15e6cb4d-3d79-4c7f-92a9-362daf2751bc\") "
Jul 02 23:27:14.755355 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.755336    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15e6cb4d-3d79-4c7f-92a9-362daf2751bc" (UID: "15e6cb4d-3d79-4c7f-92a9-362daf2751bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:27:14.756886 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.756864    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15e6cb4d-3d79-4c7f-92a9-362daf2751bc" (UID: "15e6cb4d-3d79-4c7f-92a9-362daf2751bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:27:14.756980 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.756901    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-kube-api-access-gvqf6" (OuterVolumeSpecName: "kube-api-access-gvqf6") pod "15e6cb4d-3d79-4c7f-92a9-362daf2751bc" (UID: "15e6cb4d-3d79-4c7f-92a9-362daf2751bc"). InnerVolumeSpecName "kube-api-access-gvqf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:27:14.856524 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.856499    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvqf6\" (UniqueName: \"kubernetes.io/projected/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-kube-api-access-gvqf6\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:14.856524 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.856520    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:14.856643 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:14.856529    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15e6cb4d-3d79-4c7f-92a9-362daf2751bc-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:15.040251 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:15.040227    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"]
Jul 02 23:27:15.043938 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:15.043914    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-227deae5-786c64c964-7zwzz"]
Jul 02 23:27:15.621319 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:15.621288    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e6cb4d-3d79-4c7f-92a9-362daf2751bc" path="/var/lib/kubelet/pods/15e6cb4d-3d79-4c7f-92a9-362daf2751bc/volumes"
Jul 02 23:27:21.546448 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.546416    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"]
Jul 02 23:27:21.546823 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.546808    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e6cb4d-3d79-4c7f-92a9-362daf2751bc" containerName="maas-api"
Jul 02 23:27:21.546870 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.546825    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e6cb4d-3d79-4c7f-92a9-362daf2751bc" containerName="maas-api"
Jul 02 23:27:21.546905 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.546878    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e6cb4d-3d79-4c7f-92a9-362daf2751bc" containerName="maas-api"
Jul 02 23:27:21.551447 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.551421    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.553810 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.553784    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-39d3c2cc-serving-cert\""
Jul 02 23:27:21.561792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.561767    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"]
Jul 02 23:27:21.602367 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.602342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/546f54e2-bbe0-4621-a2b3-037a26312201-openshift-service-ca\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.602452 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.602402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdkmn\" (UniqueName: \"kubernetes.io/projected/546f54e2-bbe0-4621-a2b3-037a26312201-kube-api-access-mdkmn\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.602452 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.602434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.702898 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.702873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.703010 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.702944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/546f54e2-bbe0-4621-a2b3-037a26312201-openshift-service-ca\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.703010 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.702994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdkmn\" (UniqueName: \"kubernetes.io/projected/546f54e2-bbe0-4621-a2b3-037a26312201-kube-api-access-mdkmn\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.703289 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:27:21.703261    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-39d3c2cc-serving-cert: secret "maas-api-e2e-ait-39d3c2cc-serving-cert" not found
Jul 02 23:27:21.703387 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:27:21.703336    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls podName:546f54e2-bbe0-4621-a2b3-037a26312201 nodeName:}" failed. No retries permitted until 2026-07-02 23:27:22.203318092 +0000 UTC m=+1549.140367378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls") pod "maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r" (UID: "546f54e2-bbe0-4621-a2b3-037a26312201") : secret "maas-api-e2e-ait-39d3c2cc-serving-cert" not found
Jul 02 23:27:21.703667 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.703648    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/546f54e2-bbe0-4621-a2b3-037a26312201-openshift-service-ca\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:21.714379 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:21.714358    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdkmn\" (UniqueName: \"kubernetes.io/projected/546f54e2-bbe0-4621-a2b3-037a26312201-kube-api-access-mdkmn\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:22.207352 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:22.207321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:22.209530 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:22.209506    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls\") pod \"maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") " pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:22.463244 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:22.463164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:22.595255 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:22.595230    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"]
Jul 02 23:27:22.597081 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:27:22.597034    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546f54e2_bbe0_4621_a2b3_037a26312201.slice/crio-4dc22efa3f2b2619e7ccf590b2ade8be93785e5818af18f50d197ce7142d95c6 WatchSource:0}: Error finding container 4dc22efa3f2b2619e7ccf590b2ade8be93785e5818af18f50d197ce7142d95c6: Status 404 returned error can't find the container with id 4dc22efa3f2b2619e7ccf590b2ade8be93785e5818af18f50d197ce7142d95c6
Jul 02 23:27:22.754083 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:22.754037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r" event={"ID":"546f54e2-bbe0-4621-a2b3-037a26312201","Type":"ContainerStarted","Data":"4dc22efa3f2b2619e7ccf590b2ade8be93785e5818af18f50d197ce7142d95c6"}
Jul 02 23:27:23.759918 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:23.759885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r" event={"ID":"546f54e2-bbe0-4621-a2b3-037a26312201","Type":"ContainerStarted","Data":"f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec"}
Jul 02 23:27:23.760315 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:23.760006    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:23.784123 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:23.784005    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r" podStartSLOduration=2.456485135 podStartE2EDuration="2.783990078s" totalImagesPullingTime="327.504943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:27:23.781646317 +0000 UTC m=+1550.718695625" watchObservedRunningTime="2026-07-02 23:27:23.783990078 +0000 UTC m=+1550.721039384"
Jul 02 23:27:26.857021 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:26.856987    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"]
Jul 02 23:27:26.857497 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:26.857185    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r" podUID="546f54e2-bbe0-4621-a2b3-037a26312201" containerName="maas-api" containerID="cri-o://f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec" gracePeriod=30
Jul 02 23:27:27.097678 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.097655    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:27.146580 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.146518    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls\") pod \"546f54e2-bbe0-4621-a2b3-037a26312201\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") "
Jul 02 23:27:27.146580 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.146561    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdkmn\" (UniqueName: \"kubernetes.io/projected/546f54e2-bbe0-4621-a2b3-037a26312201-kube-api-access-mdkmn\") pod \"546f54e2-bbe0-4621-a2b3-037a26312201\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") "
Jul 02 23:27:27.146748 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.146630    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/546f54e2-bbe0-4621-a2b3-037a26312201-openshift-service-ca\") pod \"546f54e2-bbe0-4621-a2b3-037a26312201\" (UID: \"546f54e2-bbe0-4621-a2b3-037a26312201\") "
Jul 02 23:27:27.146982 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.146952    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/546f54e2-bbe0-4621-a2b3-037a26312201-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "546f54e2-bbe0-4621-a2b3-037a26312201" (UID: "546f54e2-bbe0-4621-a2b3-037a26312201"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:27:27.148442 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.148421    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "546f54e2-bbe0-4621-a2b3-037a26312201" (UID: "546f54e2-bbe0-4621-a2b3-037a26312201"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:27:27.148576 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.148554    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546f54e2-bbe0-4621-a2b3-037a26312201-kube-api-access-mdkmn" (OuterVolumeSpecName: "kube-api-access-mdkmn") pod "546f54e2-bbe0-4621-a2b3-037a26312201" (UID: "546f54e2-bbe0-4621-a2b3-037a26312201"). InnerVolumeSpecName "kube-api-access-mdkmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:27:27.247779 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.247755    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/546f54e2-bbe0-4621-a2b3-037a26312201-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:27.247779 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.247779    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/546f54e2-bbe0-4621-a2b3-037a26312201-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:27.247922 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.247793    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdkmn\" (UniqueName: \"kubernetes.io/projected/546f54e2-bbe0-4621-a2b3-037a26312201-kube-api-access-mdkmn\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:27.780405 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.780370    2575 generic.go:356] "Generic (PLEG): container finished" podID="546f54e2-bbe0-4621-a2b3-037a26312201" containerID="f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec" exitCode=0
Jul 02 23:27:27.780532 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.780418    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"
Jul 02 23:27:27.780532 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.780444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r" event={"ID":"546f54e2-bbe0-4621-a2b3-037a26312201","Type":"ContainerDied","Data":"f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec"}
Jul 02 23:27:27.780532 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.780493    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r" event={"ID":"546f54e2-bbe0-4621-a2b3-037a26312201","Type":"ContainerDied","Data":"4dc22efa3f2b2619e7ccf590b2ade8be93785e5818af18f50d197ce7142d95c6"}
Jul 02 23:27:27.780532 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.780514    2575 scope.go:117] "RemoveContainer" containerID="f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec"
Jul 02 23:27:27.789025 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.789008    2575 scope.go:117] "RemoveContainer" containerID="f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec"
Jul 02 23:27:27.789309 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:27:27.789289    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec\": container with ID starting with f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec not found: ID does not exist" containerID="f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec"
Jul 02 23:27:27.789374 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.789316    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec"} err="failed to get container status \"f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec\": rpc error: code = NotFound desc = could not find container \"f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec\": container with ID starting with f6b4811e1295ddbdae6121fe50184a59025993ef499f32bb0bd4374058eefaec not found: ID does not exist"
Jul 02 23:27:27.796421 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.796402    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"]
Jul 02 23:27:27.802105 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:27.802087    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-39d3c2cc-7f86d545c5-g9f2r"]
Jul 02 23:27:29.621344 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:29.621311    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="546f54e2-bbe0-4621-a2b3-037a26312201" path="/var/lib/kubelet/pods/546f54e2-bbe0-4621-a2b3-037a26312201/volumes"
Jul 02 23:27:39.949745 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:39.949711    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"]
Jul 02 23:27:39.950319 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:39.950304    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546f54e2-bbe0-4621-a2b3-037a26312201" containerName="maas-api"
Jul 02 23:27:39.950367 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:39.950322    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="546f54e2-bbe0-4621-a2b3-037a26312201" containerName="maas-api"
Jul 02 23:27:39.950420 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:39.950409    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="546f54e2-bbe0-4621-a2b3-037a26312201" containerName="maas-api"
Jul 02 23:27:39.953344 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:39.953324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:39.956013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:39.955993    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-50627b1c-serving-cert\""
Jul 02 23:27:39.969234 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:39.969209    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"]
Jul 02 23:27:40.044078 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.044031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p76j5\" (UniqueName: \"kubernetes.io/projected/057a26ef-66e2-4570-b647-a327392d40f9-kube-api-access-p76j5\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.044199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.044123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057a26ef-66e2-4570-b647-a327392d40f9-maas-api-tls\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.044199 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.044168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057a26ef-66e2-4570-b647-a327392d40f9-openshift-service-ca\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.145322 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.145283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p76j5\" (UniqueName: \"kubernetes.io/projected/057a26ef-66e2-4570-b647-a327392d40f9-kube-api-access-p76j5\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.145517 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.145338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057a26ef-66e2-4570-b647-a327392d40f9-maas-api-tls\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.145517 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.145381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057a26ef-66e2-4570-b647-a327392d40f9-openshift-service-ca\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.146087 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.146044    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057a26ef-66e2-4570-b647-a327392d40f9-openshift-service-ca\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.147791 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.147768    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057a26ef-66e2-4570-b647-a327392d40f9-maas-api-tls\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.160419 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.160392    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p76j5\" (UniqueName: \"kubernetes.io/projected/057a26ef-66e2-4570-b647-a327392d40f9-kube-api-access-p76j5\") pod \"maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") " pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.263788 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.263768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.421032 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.421010    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"]
Jul 02 23:27:40.422814 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:27:40.422786    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057a26ef_66e2_4570_b647_a327392d40f9.slice/crio-9e116d2be18cdd8dbebc72a32a2f92beaae0fce3da5529b6564a6e9136604034 WatchSource:0}: Error finding container 9e116d2be18cdd8dbebc72a32a2f92beaae0fce3da5529b6564a6e9136604034: Status 404 returned error can't find the container with id 9e116d2be18cdd8dbebc72a32a2f92beaae0fce3da5529b6564a6e9136604034
Jul 02 23:27:40.846985 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.846955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc" event={"ID":"057a26ef-66e2-4570-b647-a327392d40f9","Type":"ContainerStarted","Data":"d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e"}
Jul 02 23:27:40.847151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.847002    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc" event={"ID":"057a26ef-66e2-4570-b647-a327392d40f9","Type":"ContainerStarted","Data":"9e116d2be18cdd8dbebc72a32a2f92beaae0fce3da5529b6564a6e9136604034"}
Jul 02 23:27:40.847151 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.847042    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:40.864541 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:40.864499    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc" podStartSLOduration=1.568486445 podStartE2EDuration="1.86448503s" totalImagesPullingTime="295.998585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:27:40.863821108 +0000 UTC m=+1567.800870416" watchObservedRunningTime="2026-07-02 23:27:40.86448503 +0000 UTC m=+1567.801534339"
Jul 02 23:27:44.757687 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:44.757646    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"]
Jul 02 23:27:44.758141 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:44.757828    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc" podUID="057a26ef-66e2-4570-b647-a327392d40f9" containerName="maas-api" containerID="cri-o://d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e" gracePeriod=30
Jul 02 23:27:45.006296 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.006268    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:45.080310 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.080244    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p76j5\" (UniqueName: \"kubernetes.io/projected/057a26ef-66e2-4570-b647-a327392d40f9-kube-api-access-p76j5\") pod \"057a26ef-66e2-4570-b647-a327392d40f9\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") "
Jul 02 23:27:45.080310 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.080280    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057a26ef-66e2-4570-b647-a327392d40f9-maas-api-tls\") pod \"057a26ef-66e2-4570-b647-a327392d40f9\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") "
Jul 02 23:27:45.080469 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.080316    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057a26ef-66e2-4570-b647-a327392d40f9-openshift-service-ca\") pod \"057a26ef-66e2-4570-b647-a327392d40f9\" (UID: \"057a26ef-66e2-4570-b647-a327392d40f9\") "
Jul 02 23:27:45.080684 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.080660    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/057a26ef-66e2-4570-b647-a327392d40f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "057a26ef-66e2-4570-b647-a327392d40f9" (UID: "057a26ef-66e2-4570-b647-a327392d40f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:27:45.082338 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.082304    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057a26ef-66e2-4570-b647-a327392d40f9-kube-api-access-p76j5" (OuterVolumeSpecName: "kube-api-access-p76j5") pod "057a26ef-66e2-4570-b647-a327392d40f9" (UID: "057a26ef-66e2-4570-b647-a327392d40f9"). InnerVolumeSpecName "kube-api-access-p76j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:27:45.082445 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.082374    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/057a26ef-66e2-4570-b647-a327392d40f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "057a26ef-66e2-4570-b647-a327392d40f9" (UID: "057a26ef-66e2-4570-b647-a327392d40f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:27:45.181960 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.181931    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p76j5\" (UniqueName: \"kubernetes.io/projected/057a26ef-66e2-4570-b647-a327392d40f9-kube-api-access-p76j5\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:45.181960 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.181956    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/057a26ef-66e2-4570-b647-a327392d40f9-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:45.181960 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.181964    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/057a26ef-66e2-4570-b647-a327392d40f9-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:27:45.871017 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.870983    2575 generic.go:356] "Generic (PLEG): container finished" podID="057a26ef-66e2-4570-b647-a327392d40f9" containerID="d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e" exitCode=0
Jul 02 23:27:45.871419 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.871024    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"
Jul 02 23:27:45.871419 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.871043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc" event={"ID":"057a26ef-66e2-4570-b647-a327392d40f9","Type":"ContainerDied","Data":"d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e"}
Jul 02 23:27:45.871419 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.871106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc" event={"ID":"057a26ef-66e2-4570-b647-a327392d40f9","Type":"ContainerDied","Data":"9e116d2be18cdd8dbebc72a32a2f92beaae0fce3da5529b6564a6e9136604034"}
Jul 02 23:27:45.871419 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.871131    2575 scope.go:117] "RemoveContainer" containerID="d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e"
Jul 02 23:27:45.880308 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.880289    2575 scope.go:117] "RemoveContainer" containerID="d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e"
Jul 02 23:27:45.880564 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:27:45.880548    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e\": container with ID starting with d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e not found: ID does not exist" containerID="d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e"
Jul 02 23:27:45.880618 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.880581    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e"} err="failed to get container status \"d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e\": rpc error: code = NotFound desc = could not find container \"d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e\": container with ID starting with d4aec2f0480c41105ff5d8766928638004878d10b480df3ac8b8dcda2a313b3e not found: ID does not exist"
Jul 02 23:27:45.887057 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.887028    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"]
Jul 02 23:27:45.888674 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:45.888656    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-50627b1c-dbd4cc896-rzqmc"]
Jul 02 23:27:47.621666 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:27:47.621635    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="057a26ef-66e2-4570-b647-a327392d40f9" path="/var/lib/kubelet/pods/057a26ef-66e2-4570-b647-a327392d40f9/volumes"
Jul 02 23:29:27.937893 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:27.937861    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"]
Jul 02 23:29:27.938508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:27.938286    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057a26ef-66e2-4570-b647-a327392d40f9" containerName="maas-api"
Jul 02 23:29:27.938508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:27.938302    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="057a26ef-66e2-4570-b647-a327392d40f9" containerName="maas-api"
Jul 02 23:29:27.938508 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:27.938381    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="057a26ef-66e2-4570-b647-a327392d40f9" containerName="maas-api"
Jul 02 23:29:27.941600 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:27.941579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:27.943702 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:27.943674    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-3265e72b-serving-cert\""
Jul 02 23:29:27.952520 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:27.952494    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"]
Jul 02 23:29:28.048719 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.048697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.048819 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.048722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zqt4\" (UniqueName: \"kubernetes.io/projected/5e135445-a847-435a-8e12-a0370b33bccb-kube-api-access-7zqt4\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.048819 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.048754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e135445-a847-435a-8e12-a0370b33bccb-openshift-service-ca\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.150040 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.150016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.150155 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.150058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zqt4\" (UniqueName: \"kubernetes.io/projected/5e135445-a847-435a-8e12-a0370b33bccb-kube-api-access-7zqt4\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.150216 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:29:28.150166    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-3265e72b-serving-cert: secret "maas-api-e2e-mt-3265e72b-serving-cert" not found
Jul 02 23:29:28.150274 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:29:28.150236    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls podName:5e135445-a847-435a-8e12-a0370b33bccb nodeName:}" failed. No retries permitted until 2026-07-02 23:29:28.650216278 +0000 UTC m=+1675.587265579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls") pod "maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv" (UID: "5e135445-a847-435a-8e12-a0370b33bccb") : secret "maas-api-e2e-mt-3265e72b-serving-cert" not found
Jul 02 23:29:28.150274 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.150256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e135445-a847-435a-8e12-a0370b33bccb-openshift-service-ca\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.150887 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.150870    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e135445-a847-435a-8e12-a0370b33bccb-openshift-service-ca\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.158528 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.158508    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zqt4\" (UniqueName: \"kubernetes.io/projected/5e135445-a847-435a-8e12-a0370b33bccb-kube-api-access-7zqt4\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.654409 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.654379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.656763 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.656738    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls\") pod \"maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") " pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.854110 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.854085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:28.986207 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:28.986180    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"]
Jul 02 23:29:28.988144 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:29:28.988114    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e135445_a847_435a_8e12_a0370b33bccb.slice/crio-14aa833524f647d9f67ab866ebd3e0e2a16668dec1d9032e5f2ab4eabfc2ad29 WatchSource:0}: Error finding container 14aa833524f647d9f67ab866ebd3e0e2a16668dec1d9032e5f2ab4eabfc2ad29: Status 404 returned error can't find the container with id 14aa833524f647d9f67ab866ebd3e0e2a16668dec1d9032e5f2ab4eabfc2ad29
Jul 02 23:29:29.383133 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:29.383067    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv" event={"ID":"5e135445-a847-435a-8e12-a0370b33bccb","Type":"ContainerStarted","Data":"14aa833524f647d9f67ab866ebd3e0e2a16668dec1d9032e5f2ab4eabfc2ad29"}
Jul 02 23:29:30.389836 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:30.389799    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv" event={"ID":"5e135445-a847-435a-8e12-a0370b33bccb","Type":"ContainerStarted","Data":"41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff"}
Jul 02 23:29:30.390208 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:30.389868    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:30.407833 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:30.407787    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv" podStartSLOduration=3.028095173 podStartE2EDuration="3.407773191s" totalImagesPullingTime="379.678018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:29:30.405489592 +0000 UTC m=+1677.342538900" watchObservedRunningTime="2026-07-02 23:29:30.407773191 +0000 UTC m=+1677.344822525"
Jul 02 23:29:36.399100 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:36.399072    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:39.702103 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:39.702073    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"]
Jul 02 23:29:39.702544 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:39.702312    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv" podUID="5e135445-a847-435a-8e12-a0370b33bccb" containerName="maas-api" containerID="cri-o://41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff" gracePeriod=30
Jul 02 23:29:39.955456 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:39.955398    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:40.039247 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.039216    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls\") pod \"5e135445-a847-435a-8e12-a0370b33bccb\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") "
Jul 02 23:29:40.039366 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.039277    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e135445-a847-435a-8e12-a0370b33bccb-openshift-service-ca\") pod \"5e135445-a847-435a-8e12-a0370b33bccb\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") "
Jul 02 23:29:40.039412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.039376    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zqt4\" (UniqueName: \"kubernetes.io/projected/5e135445-a847-435a-8e12-a0370b33bccb-kube-api-access-7zqt4\") pod \"5e135445-a847-435a-8e12-a0370b33bccb\" (UID: \"5e135445-a847-435a-8e12-a0370b33bccb\") "
Jul 02 23:29:40.039624 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.039598    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e135445-a847-435a-8e12-a0370b33bccb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5e135445-a847-435a-8e12-a0370b33bccb" (UID: "5e135445-a847-435a-8e12-a0370b33bccb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:29:40.041430 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.041402    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5e135445-a847-435a-8e12-a0370b33bccb" (UID: "5e135445-a847-435a-8e12-a0370b33bccb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:29:40.041558 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.041469    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e135445-a847-435a-8e12-a0370b33bccb-kube-api-access-7zqt4" (OuterVolumeSpecName: "kube-api-access-7zqt4") pod "5e135445-a847-435a-8e12-a0370b33bccb" (UID: "5e135445-a847-435a-8e12-a0370b33bccb"). InnerVolumeSpecName "kube-api-access-7zqt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:29:40.140709 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.140681    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zqt4\" (UniqueName: \"kubernetes.io/projected/5e135445-a847-435a-8e12-a0370b33bccb-kube-api-access-7zqt4\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:29:40.140709 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.140706    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e135445-a847-435a-8e12-a0370b33bccb-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:29:40.140848 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.140715    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e135445-a847-435a-8e12-a0370b33bccb-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:29:40.434762 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.434725    2575 generic.go:356] "Generic (PLEG): container finished" podID="5e135445-a847-435a-8e12-a0370b33bccb" containerID="41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff" exitCode=0
Jul 02 23:29:40.434915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.434773    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"
Jul 02 23:29:40.434915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.434776    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv" event={"ID":"5e135445-a847-435a-8e12-a0370b33bccb","Type":"ContainerDied","Data":"41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff"}
Jul 02 23:29:40.434915 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.434906    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv" event={"ID":"5e135445-a847-435a-8e12-a0370b33bccb","Type":"ContainerDied","Data":"14aa833524f647d9f67ab866ebd3e0e2a16668dec1d9032e5f2ab4eabfc2ad29"}
Jul 02 23:29:40.435097 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.434946    2575 scope.go:117] "RemoveContainer" containerID="41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff"
Jul 02 23:29:40.446565 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.446548    2575 scope.go:117] "RemoveContainer" containerID="41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff"
Jul 02 23:29:40.446834 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:29:40.446817    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff\": container with ID starting with 41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff not found: ID does not exist" containerID="41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff"
Jul 02 23:29:40.446893 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.446842    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff"} err="failed to get container status \"41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff\": rpc error: code = NotFound desc = could not find container \"41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff\": container with ID starting with 41307557888b5a9d68c893c552273b2623f73f6c50f6f93bdf15784b668f8aff not found: ID does not exist"
Jul 02 23:29:40.458120 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.458097    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"]
Jul 02 23:29:40.459837 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:40.459818    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-3265e72b-6cb9449f98-sgxjv"]
Jul 02 23:29:41.621146 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:29:41.621117    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e135445-a847-435a-8e12-a0370b33bccb" path="/var/lib/kubelet/pods/5e135445-a847-435a-8e12-a0370b33bccb/volumes"
Jul 02 23:30:08.134768 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.134732    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"]
Jul 02 23:30:08.137222 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.135269    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e135445-a847-435a-8e12-a0370b33bccb" containerName="maas-api"
Jul 02 23:30:08.137222 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.135286    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e135445-a847-435a-8e12-a0370b33bccb" containerName="maas-api"
Jul 02 23:30:08.137222 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.135355    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e135445-a847-435a-8e12-a0370b33bccb" containerName="maas-api"
Jul 02 23:30:08.138192 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.138174    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.140384 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.140364    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-de78a6e8-serving-cert\""
Jul 02 23:30:08.149275 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.149253    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"]
Jul 02 23:30:08.254039 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.254013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r857k\" (UniqueName: \"kubernetes.io/projected/de8a01b2-c9d9-413b-826a-8615d1e631a4-kube-api-access-r857k\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.254158 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.254067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8a01b2-c9d9-413b-826a-8615d1e631a4-maas-api-tls\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.254158 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.254139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8a01b2-c9d9-413b-826a-8615d1e631a4-openshift-service-ca\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.355367 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.355341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8a01b2-c9d9-413b-826a-8615d1e631a4-openshift-service-ca\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.355469 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.355405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r857k\" (UniqueName: \"kubernetes.io/projected/de8a01b2-c9d9-413b-826a-8615d1e631a4-kube-api-access-r857k\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.355469 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.355428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8a01b2-c9d9-413b-826a-8615d1e631a4-maas-api-tls\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.355973 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.355954    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8a01b2-c9d9-413b-826a-8615d1e631a4-openshift-service-ca\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.357714 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.357690    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8a01b2-c9d9-413b-826a-8615d1e631a4-maas-api-tls\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.365567 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.365547    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r857k\" (UniqueName: \"kubernetes.io/projected/de8a01b2-c9d9-413b-826a-8615d1e631a4-kube-api-access-r857k\") pod \"maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") " pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.450481 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.450431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:08.579879 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:08.579856    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"]
Jul 02 23:30:08.582360 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:30:08.582330    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8a01b2_c9d9_413b_826a_8615d1e631a4.slice/crio-3d394ed5f3b0669bfdab9608cf1439c036049c9947402d713d3900345b23fcd4 WatchSource:0}: Error finding container 3d394ed5f3b0669bfdab9608cf1439c036049c9947402d713d3900345b23fcd4: Status 404 returned error can't find the container with id 3d394ed5f3b0669bfdab9608cf1439c036049c9947402d713d3900345b23fcd4
Jul 02 23:30:09.580164 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:09.580127    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k" event={"ID":"de8a01b2-c9d9-413b-826a-8615d1e631a4","Type":"ContainerStarted","Data":"20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115"}
Jul 02 23:30:09.580567 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:09.580178    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k" event={"ID":"de8a01b2-c9d9-413b-826a-8615d1e631a4","Type":"ContainerStarted","Data":"3d394ed5f3b0669bfdab9608cf1439c036049c9947402d713d3900345b23fcd4"}
Jul 02 23:30:09.580567 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:09.580204    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:09.596761 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:09.596716    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k" podStartSLOduration=1.202056425 podStartE2EDuration="1.596702152s" totalImagesPullingTime="394.645727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:30:09.594704121 +0000 UTC m=+1716.531753430" watchObservedRunningTime="2026-07-02 23:30:09.596702152 +0000 UTC m=+1716.533751459"
Jul 02 23:30:15.589698 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:15.589669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:55.821592 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:55.821549    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"]
Jul 02 23:30:55.822224 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:55.821780    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k" podUID="de8a01b2-c9d9-413b-826a-8615d1e631a4" containerName="maas-api" containerID="cri-o://20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115" gracePeriod=30
Jul 02 23:30:56.069362 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.069338    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:56.203590 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.203523    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r857k\" (UniqueName: \"kubernetes.io/projected/de8a01b2-c9d9-413b-826a-8615d1e631a4-kube-api-access-r857k\") pod \"de8a01b2-c9d9-413b-826a-8615d1e631a4\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") "
Jul 02 23:30:56.203727 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.203633    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8a01b2-c9d9-413b-826a-8615d1e631a4-maas-api-tls\") pod \"de8a01b2-c9d9-413b-826a-8615d1e631a4\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") "
Jul 02 23:30:56.203727 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.203687    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8a01b2-c9d9-413b-826a-8615d1e631a4-openshift-service-ca\") pod \"de8a01b2-c9d9-413b-826a-8615d1e631a4\" (UID: \"de8a01b2-c9d9-413b-826a-8615d1e631a4\") "
Jul 02 23:30:56.204013 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.203988    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de8a01b2-c9d9-413b-826a-8615d1e631a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de8a01b2-c9d9-413b-826a-8615d1e631a4" (UID: "de8a01b2-c9d9-413b-826a-8615d1e631a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:30:56.205477 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.205422    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8a01b2-c9d9-413b-826a-8615d1e631a4-kube-api-access-r857k" (OuterVolumeSpecName: "kube-api-access-r857k") pod "de8a01b2-c9d9-413b-826a-8615d1e631a4" (UID: "de8a01b2-c9d9-413b-826a-8615d1e631a4"). InnerVolumeSpecName "kube-api-access-r857k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:30:56.205477 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.205482    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8a01b2-c9d9-413b-826a-8615d1e631a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de8a01b2-c9d9-413b-826a-8615d1e631a4" (UID: "de8a01b2-c9d9-413b-826a-8615d1e631a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:30:56.305219 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.305191    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r857k\" (UniqueName: \"kubernetes.io/projected/de8a01b2-c9d9-413b-826a-8615d1e631a4-kube-api-access-r857k\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:30:56.305219 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.305214    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8a01b2-c9d9-413b-826a-8615d1e631a4-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:30:56.305356 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.305224    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8a01b2-c9d9-413b-826a-8615d1e631a4-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:30:56.805728 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.805697    2575 generic.go:356] "Generic (PLEG): container finished" podID="de8a01b2-c9d9-413b-826a-8615d1e631a4" containerID="20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115" exitCode=0
Jul 02 23:30:56.805905 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.805737    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"
Jul 02 23:30:56.805905 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.805788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k" event={"ID":"de8a01b2-c9d9-413b-826a-8615d1e631a4","Type":"ContainerDied","Data":"20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115"}
Jul 02 23:30:56.805905 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.805846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k" event={"ID":"de8a01b2-c9d9-413b-826a-8615d1e631a4","Type":"ContainerDied","Data":"3d394ed5f3b0669bfdab9608cf1439c036049c9947402d713d3900345b23fcd4"}
Jul 02 23:30:56.805905 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.805875    2575 scope.go:117] "RemoveContainer" containerID="20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115"
Jul 02 23:30:56.815112 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.815094    2575 scope.go:117] "RemoveContainer" containerID="20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115"
Jul 02 23:30:56.815375 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:30:56.815357    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115\": container with ID starting with 20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115 not found: ID does not exist" containerID="20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115"
Jul 02 23:30:56.815431 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.815383    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115"} err="failed to get container status \"20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115\": rpc error: code = NotFound desc = could not find container \"20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115\": container with ID starting with 20fc99b12d2c58dbadb386825ef53eddcc4334d20ed151b0095a936830f8c115 not found: ID does not exist"
Jul 02 23:30:56.828198 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.828173    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"]
Jul 02 23:30:56.831493 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:56.831475    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-de78a6e8-756578fb96-gcb8k"]
Jul 02 23:30:57.621318 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:30:57.621279    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de8a01b2-c9d9-413b-826a-8615d1e631a4" path="/var/lib/kubelet/pods/de8a01b2-c9d9-413b-826a-8615d1e631a4/volumes"
Jul 02 23:31:33.650614 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:31:33.650569    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:31:33.651128 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:31:33.650799    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:32:51.942160 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:51.941883    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"]
Jul 02 23:32:51.942711 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:51.942483    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8a01b2-c9d9-413b-826a-8615d1e631a4" containerName="maas-api"
Jul 02 23:32:51.942711 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:51.942500    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8a01b2-c9d9-413b-826a-8615d1e631a4" containerName="maas-api"
Jul 02 23:32:51.942711 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:51.942634    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="de8a01b2-c9d9-413b-826a-8615d1e631a4" containerName="maas-api"
Jul 02 23:32:51.945895 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:51.945872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:51.948358 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:51.948330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-b0517f-serving-cert\""
Jul 02 23:32:51.959084 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:51.958755    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"]
Jul 02 23:32:52.028144 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.028109    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.028257 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.028214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmv5m\" (UniqueName: \"kubernetes.io/projected/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-kube-api-access-rmv5m\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.028310 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.028262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.128630 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.128603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.128759 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.128673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmv5m\" (UniqueName: \"kubernetes.io/projected/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-kube-api-access-rmv5m\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.128759 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.128718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.128879 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:32:52.128768    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-b0517f-serving-cert: secret "maas-api-e2e-inf-a-b0517f-serving-cert" not found
Jul 02 23:32:52.128879 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:32:52.128835    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls podName:cf3bc5b2-706a-4279-be8f-1b4e55f6adee nodeName:}" failed. No retries permitted until 2026-07-02 23:32:52.628815464 +0000 UTC m=+1879.565864753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls") pod "maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" (UID: "cf3bc5b2-706a-4279-be8f-1b4e55f6adee") : secret "maas-api-e2e-inf-a-b0517f-serving-cert" not found
Jul 02 23:32:52.129370 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.129343    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.142203 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.142181    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmv5m\" (UniqueName: \"kubernetes.io/projected/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-kube-api-access-rmv5m\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.632627 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.632599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.635509 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.635474    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls\") pod \"maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") " pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.860937 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.860910    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:52.993989 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.993885    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"]
Jul 02 23:32:52.996224 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:32:52.996190    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3bc5b2_706a_4279_be8f_1b4e55f6adee.slice/crio-8d69d4bc5582cd5b5854f0cb8e2ebbf7dd05dea495ee6fc653d3b983bf5bfdd3 WatchSource:0}: Error finding container 8d69d4bc5582cd5b5854f0cb8e2ebbf7dd05dea495ee6fc653d3b983bf5bfdd3: Status 404 returned error can't find the container with id 8d69d4bc5582cd5b5854f0cb8e2ebbf7dd05dea495ee6fc653d3b983bf5bfdd3
Jul 02 23:32:52.997609 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:52.997590    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:32:53.389315 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:53.389285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" event={"ID":"cf3bc5b2-706a-4279-be8f-1b4e55f6adee","Type":"ContainerStarted","Data":"8d69d4bc5582cd5b5854f0cb8e2ebbf7dd05dea495ee6fc653d3b983bf5bfdd3"}
Jul 02 23:32:54.394999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:54.394959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" event={"ID":"cf3bc5b2-706a-4279-be8f-1b4e55f6adee","Type":"ContainerStarted","Data":"7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe"}
Jul 02 23:32:54.395461 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:54.395095    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:32:54.412695 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:32:54.412653    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" podStartSLOduration=2.857029337 podStartE2EDuration="3.412639533s" totalImagesPullingTime="555.610196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:32:54.410974393 +0000 UTC m=+1881.348023723" watchObservedRunningTime="2026-07-02 23:32:54.412639533 +0000 UTC m=+1881.349688885"
Jul 02 23:33:00.239202 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.239111    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"]
Jul 02 23:33:00.244009 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.243976    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.246747 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.246723    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-0ae6cc-serving-cert\""
Jul 02 23:33:00.253242 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.253217    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"]
Jul 02 23:33:00.298202 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.298174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8sl8\" (UniqueName: \"kubernetes.io/projected/a36eba55-992d-49fa-971a-99f8cd2275ba-kube-api-access-z8sl8\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.298321 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.298229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.298321 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.298300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36eba55-992d-49fa-971a-99f8cd2275ba-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.399476 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.399447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36eba55-992d-49fa-971a-99f8cd2275ba-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.399598 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.399499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8sl8\" (UniqueName: \"kubernetes.io/projected/a36eba55-992d-49fa-971a-99f8cd2275ba-kube-api-access-z8sl8\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.399598 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.399561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.399680 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:33:00.399667    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-0ae6cc-serving-cert: secret "maas-api-e2e-inf-b-0ae6cc-serving-cert" not found
Jul 02 23:33:00.399753 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:33:00.399742    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls podName:a36eba55-992d-49fa-971a-99f8cd2275ba nodeName:}" failed. No retries permitted until 2026-07-02 23:33:00.899718696 +0000 UTC m=+1887.836767985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls") pod "maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7" (UID: "a36eba55-992d-49fa-971a-99f8cd2275ba") : secret "maas-api-e2e-inf-b-0ae6cc-serving-cert" not found
Jul 02 23:33:00.400185 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.400168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36eba55-992d-49fa-971a-99f8cd2275ba-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.405014 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.404994    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:33:00.407950 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.407931    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8sl8\" (UniqueName: \"kubernetes.io/projected/a36eba55-992d-49fa-971a-99f8cd2275ba-kube-api-access-z8sl8\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.904221 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.904189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:00.906498 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:00.906474    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls\") pod \"maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") " pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:01.158405 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:01.158331    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:01.493882 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:01.493860    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"]
Jul 02 23:33:01.495890 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:33:01.495864    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36eba55_992d_49fa_971a_99f8cd2275ba.slice/crio-27a966232572801d654fd0da940cd8ca39c062706e0496dd11e9669c3437a986 WatchSource:0}: Error finding container 27a966232572801d654fd0da940cd8ca39c062706e0496dd11e9669c3437a986: Status 404 returned error can't find the container with id 27a966232572801d654fd0da940cd8ca39c062706e0496dd11e9669c3437a986
Jul 02 23:33:02.435196 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:02.435162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7" event={"ID":"a36eba55-992d-49fa-971a-99f8cd2275ba","Type":"ContainerStarted","Data":"b2849bb5015107375096bb4de581e9c863532021740ff3e9b608f5b642a4fce5"}
Jul 02 23:33:02.435382 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:02.435218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7" event={"ID":"a36eba55-992d-49fa-971a-99f8cd2275ba","Type":"ContainerStarted","Data":"27a966232572801d654fd0da940cd8ca39c062706e0496dd11e9669c3437a986"}
Jul 02 23:33:02.435382 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:02.435288    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:33:02.466679 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:02.466635    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7" podStartSLOduration=2.141520034 podStartE2EDuration="2.466620396s" totalImagesPullingTime="325.100362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:33:02.464131182 +0000 UTC m=+1889.401180712" watchObservedRunningTime="2026-07-02 23:33:02.466620396 +0000 UTC m=+1889.403669718"
Jul 02 23:33:08.446277 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:33:08.446250    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:34:40.268134 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.268095    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"]
Jul 02 23:34:40.268655 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.268343    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" podUID="cf3bc5b2-706a-4279-be8f-1b4e55f6adee" containerName="maas-api" containerID="cri-o://7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe" gracePeriod=30
Jul 02 23:34:40.401261 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.401229    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" podUID="cf3bc5b2-706a-4279-be8f-1b4e55f6adee" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.53:8443/health\": dial tcp 10.134.0.53:8443: connect: connection refused"
Jul 02 23:34:40.523569 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.523512    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:34:40.645579 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.645549    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmv5m\" (UniqueName: \"kubernetes.io/projected/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-kube-api-access-rmv5m\") pod \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") "
Jul 02 23:34:40.645752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.645601    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls\") pod \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") "
Jul 02 23:34:40.645752 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.645630    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-openshift-service-ca\") pod \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\" (UID: \"cf3bc5b2-706a-4279-be8f-1b4e55f6adee\") "
Jul 02 23:34:40.645988 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.645960    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf3bc5b2-706a-4279-be8f-1b4e55f6adee" (UID: "cf3bc5b2-706a-4279-be8f-1b4e55f6adee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:34:40.647585 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.647562    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-kube-api-access-rmv5m" (OuterVolumeSpecName: "kube-api-access-rmv5m") pod "cf3bc5b2-706a-4279-be8f-1b4e55f6adee" (UID: "cf3bc5b2-706a-4279-be8f-1b4e55f6adee"). InnerVolumeSpecName "kube-api-access-rmv5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:34:40.647585 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.647575    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf3bc5b2-706a-4279-be8f-1b4e55f6adee" (UID: "cf3bc5b2-706a-4279-be8f-1b4e55f6adee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:34:40.746897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.746874    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmv5m\" (UniqueName: \"kubernetes.io/projected/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-kube-api-access-rmv5m\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:34:40.746897 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.746895    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:34:40.747028 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.746904    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf3bc5b2-706a-4279-be8f-1b4e55f6adee-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:34:40.896974 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.896918    2575 generic.go:356] "Generic (PLEG): container finished" podID="cf3bc5b2-706a-4279-be8f-1b4e55f6adee" containerID="7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe" exitCode=0
Jul 02 23:34:40.896974 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.896963    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"
Jul 02 23:34:40.896974 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.896968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" event={"ID":"cf3bc5b2-706a-4279-be8f-1b4e55f6adee","Type":"ContainerDied","Data":"7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe"}
Jul 02 23:34:40.897147 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.897008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz" event={"ID":"cf3bc5b2-706a-4279-be8f-1b4e55f6adee","Type":"ContainerDied","Data":"8d69d4bc5582cd5b5854f0cb8e2ebbf7dd05dea495ee6fc653d3b983bf5bfdd3"}
Jul 02 23:34:40.897147 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.897031    2575 scope.go:117] "RemoveContainer" containerID="7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe"
Jul 02 23:34:40.905844 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.905824    2575 scope.go:117] "RemoveContainer" containerID="7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe"
Jul 02 23:34:40.906101 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:34:40.906083    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe\": container with ID starting with 7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe not found: ID does not exist" containerID="7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe"
Jul 02 23:34:40.906163 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.906110    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe"} err="failed to get container status \"7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe\": rpc error: code = NotFound desc = could not find container \"7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe\": container with ID starting with 7c270783add4e7c6212168ca8400a1d0861e6c5c77ff35f1df1a859731d50fbe not found: ID does not exist"
Jul 02 23:34:40.916948 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.916921    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"]
Jul 02 23:34:40.920938 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:40.920915    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b0517f-786ffd5f7-2b8pz"]
Jul 02 23:34:41.620799 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:34:41.620771    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf3bc5b2-706a-4279-be8f-1b4e55f6adee" path="/var/lib/kubelet/pods/cf3bc5b2-706a-4279-be8f-1b4e55f6adee/volumes"
Jul 02 23:35:22.941428 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:22.941388    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"]
Jul 02 23:35:22.944176 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:22.941613    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7" podUID="a36eba55-992d-49fa-971a-99f8cd2275ba" containerName="maas-api" containerID="cri-o://b2849bb5015107375096bb4de581e9c863532021740ff3e9b608f5b642a4fce5" gracePeriod=30
Jul 02 23:35:23.111309 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.111278    2575 generic.go:356] "Generic (PLEG): container finished" podID="a36eba55-992d-49fa-971a-99f8cd2275ba" containerID="b2849bb5015107375096bb4de581e9c863532021740ff3e9b608f5b642a4fce5" exitCode=0
Jul 02 23:35:23.111451 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.111320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7" event={"ID":"a36eba55-992d-49fa-971a-99f8cd2275ba","Type":"ContainerDied","Data":"b2849bb5015107375096bb4de581e9c863532021740ff3e9b608f5b642a4fce5"}
Jul 02 23:35:23.193690 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.193635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:35:23.271015 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.270990    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8sl8\" (UniqueName: \"kubernetes.io/projected/a36eba55-992d-49fa-971a-99f8cd2275ba-kube-api-access-z8sl8\") pod \"a36eba55-992d-49fa-971a-99f8cd2275ba\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") "
Jul 02 23:35:23.271189 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.271044    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls\") pod \"a36eba55-992d-49fa-971a-99f8cd2275ba\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") "
Jul 02 23:35:23.271189 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.271087    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36eba55-992d-49fa-971a-99f8cd2275ba-openshift-service-ca\") pod \"a36eba55-992d-49fa-971a-99f8cd2275ba\" (UID: \"a36eba55-992d-49fa-971a-99f8cd2275ba\") "
Jul 02 23:35:23.271533 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.271510    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36eba55-992d-49fa-971a-99f8cd2275ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a36eba55-992d-49fa-971a-99f8cd2275ba" (UID: "a36eba55-992d-49fa-971a-99f8cd2275ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:23.272978 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.272960    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36eba55-992d-49fa-971a-99f8cd2275ba-kube-api-access-z8sl8" (OuterVolumeSpecName: "kube-api-access-z8sl8") pod "a36eba55-992d-49fa-971a-99f8cd2275ba" (UID: "a36eba55-992d-49fa-971a-99f8cd2275ba"). InnerVolumeSpecName "kube-api-access-z8sl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:23.273042 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.273031    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a36eba55-992d-49fa-971a-99f8cd2275ba" (UID: "a36eba55-992d-49fa-971a-99f8cd2275ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:23.372192 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.372168    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36eba55-992d-49fa-971a-99f8cd2275ba-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:35:23.372192 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.372189    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36eba55-992d-49fa-971a-99f8cd2275ba-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:35:23.372312 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:23.372198    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8sl8\" (UniqueName: \"kubernetes.io/projected/a36eba55-992d-49fa-971a-99f8cd2275ba-kube-api-access-z8sl8\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:35:24.116372 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:24.116346    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"
Jul 02 23:35:24.116727 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:24.116346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7" event={"ID":"a36eba55-992d-49fa-971a-99f8cd2275ba","Type":"ContainerDied","Data":"27a966232572801d654fd0da940cd8ca39c062706e0496dd11e9669c3437a986"}
Jul 02 23:35:24.116727 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:24.116475    2575 scope.go:117] "RemoveContainer" containerID="b2849bb5015107375096bb4de581e9c863532021740ff3e9b608f5b642a4fce5"
Jul 02 23:35:24.131765 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:24.131741    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"]
Jul 02 23:35:24.135807 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:24.135784    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ae6cc-cfd67d9-kvmf7"]
Jul 02 23:35:25.621582 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:25.621555    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36eba55-992d-49fa-971a-99f8cd2275ba" path="/var/lib/kubelet/pods/a36eba55-992d-49fa-971a-99f8cd2275ba/volumes"
Jul 02 23:35:32.780736 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.780685    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"]
Jul 02 23:35:32.781283 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.781262    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf3bc5b2-706a-4279-be8f-1b4e55f6adee" containerName="maas-api"
Jul 02 23:35:32.781338 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.781288    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf3bc5b2-706a-4279-be8f-1b4e55f6adee" containerName="maas-api"
Jul 02 23:35:32.781380 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.781340    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36eba55-992d-49fa-971a-99f8cd2275ba" containerName="maas-api"
Jul 02 23:35:32.781380 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.781349    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36eba55-992d-49fa-971a-99f8cd2275ba" containerName="maas-api"
Jul 02 23:35:32.781459 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.781448    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36eba55-992d-49fa-971a-99f8cd2275ba" containerName="maas-api"
Jul 02 23:35:32.781492 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.781465    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf3bc5b2-706a-4279-be8f-1b4e55f6adee" containerName="maas-api"
Jul 02 23:35:32.786195 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.786161    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.788728 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.788704    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-b797b8-serving-cert\""
Jul 02 23:35:32.794099 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.794073    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"]
Jul 02 23:35:32.843006 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.842985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5babb19-4a30-420a-b3b5-52f33d220836-openshift-service-ca\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.843148 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.843022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5babb19-4a30-420a-b3b5-52f33d220836-maas-api-tls\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.843148 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.843072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tggml\" (UniqueName: \"kubernetes.io/projected/e5babb19-4a30-420a-b3b5-52f33d220836-kube-api-access-tggml\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.944136 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.944114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5babb19-4a30-420a-b3b5-52f33d220836-maas-api-tls\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.944239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.944160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tggml\" (UniqueName: \"kubernetes.io/projected/e5babb19-4a30-420a-b3b5-52f33d220836-kube-api-access-tggml\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.944239 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.944228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5babb19-4a30-420a-b3b5-52f33d220836-openshift-service-ca\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.944845 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.944824    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5babb19-4a30-420a-b3b5-52f33d220836-openshift-service-ca\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.946366 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.946341    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5babb19-4a30-420a-b3b5-52f33d220836-maas-api-tls\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:32.954237 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:32.954219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tggml\" (UniqueName: \"kubernetes.io/projected/e5babb19-4a30-420a-b3b5-52f33d220836-kube-api-access-tggml\") pod \"maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") " pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:33.100521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:33.100455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:33.238709 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:33.238681    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"]
Jul 02 23:35:33.241105 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:35:33.241026    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5babb19_4a30_420a_b3b5_52f33d220836.slice/crio-6b45c09f405da660cf7fca3cf59d97509659f5c1951cfffb6bb70c59f57aad41 WatchSource:0}: Error finding container 6b45c09f405da660cf7fca3cf59d97509659f5c1951cfffb6bb70c59f57aad41: Status 404 returned error can't find the container with id 6b45c09f405da660cf7fca3cf59d97509659f5c1951cfffb6bb70c59f57aad41
Jul 02 23:35:34.166457 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:34.166424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c" event={"ID":"e5babb19-4a30-420a-b3b5-52f33d220836","Type":"ContainerStarted","Data":"9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae"}
Jul 02 23:35:34.166792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:34.166472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c" event={"ID":"e5babb19-4a30-420a-b3b5-52f33d220836","Type":"ContainerStarted","Data":"6b45c09f405da660cf7fca3cf59d97509659f5c1951cfffb6bb70c59f57aad41"}
Jul 02 23:35:34.166792 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:34.166543    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:34.183003 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:34.182960    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c" podStartSLOduration=1.748089138 podStartE2EDuration="2.182947795s" totalImagesPullingTime="434.858657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:34.1816254 +0000 UTC m=+2041.118674706" watchObservedRunningTime="2026-07-02 23:35:34.182947795 +0000 UTC m=+2041.119997102"
Jul 02 23:35:40.177155 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:40.177122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:40.918963 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:40.918932    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"]
Jul 02 23:35:40.922253 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:40.922225    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:40.924636 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:40.924607    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-782a03-serving-cert\""
Jul 02 23:35:40.934106 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:40.934079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"]
Jul 02 23:35:41.002404 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.002367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.002404 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.002406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrvw\" (UniqueName: \"kubernetes.io/projected/242967cf-13ed-4c9f-9970-f61f28b46dcb-kube-api-access-ddrvw\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.002585 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.002519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242967cf-13ed-4c9f-9970-f61f28b46dcb-openshift-service-ca\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.103598 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.103574    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242967cf-13ed-4c9f-9970-f61f28b46dcb-openshift-service-ca\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.103738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.103612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.103738 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.103629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrvw\" (UniqueName: \"kubernetes.io/projected/242967cf-13ed-4c9f-9970-f61f28b46dcb-kube-api-access-ddrvw\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.103738 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:35:41.103689    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-782a03-serving-cert: secret "maas-api-e2e-api-b-782a03-serving-cert" not found
Jul 02 23:35:41.103926 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:35:41.103743    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls podName:242967cf-13ed-4c9f-9970-f61f28b46dcb nodeName:}" failed. No retries permitted until 2026-07-02 23:35:41.603728047 +0000 UTC m=+2048.540777332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls") pod "maas-api-e2e-api-b-782a03-59599444f7-ffvvv" (UID: "242967cf-13ed-4c9f-9970-f61f28b46dcb") : secret "maas-api-e2e-api-b-782a03-serving-cert" not found
Jul 02 23:35:41.104283 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.104261    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242967cf-13ed-4c9f-9970-f61f28b46dcb-openshift-service-ca\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.112350 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.112329    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrvw\" (UniqueName: \"kubernetes.io/projected/242967cf-13ed-4c9f-9970-f61f28b46dcb-kube-api-access-ddrvw\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.607657 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.607623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.610016 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.609993    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls\") pod \"maas-api-e2e-api-b-782a03-59599444f7-ffvvv\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") " pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.837293 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.837263    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:41.971709 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:41.971686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"]
Jul 02 23:35:41.974118 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:35:41.974084    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242967cf_13ed_4c9f_9970_f61f28b46dcb.slice/crio-8ddba271a5cf97fa94f83649f4487767c6900a8e6afca2cd9ef9ac407c2d1291 WatchSource:0}: Error finding container 8ddba271a5cf97fa94f83649f4487767c6900a8e6afca2cd9ef9ac407c2d1291: Status 404 returned error can't find the container with id 8ddba271a5cf97fa94f83649f4487767c6900a8e6afca2cd9ef9ac407c2d1291
Jul 02 23:35:42.204365 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:42.204290    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv" event={"ID":"242967cf-13ed-4c9f-9970-f61f28b46dcb","Type":"ContainerStarted","Data":"8ddba271a5cf97fa94f83649f4487767c6900a8e6afca2cd9ef9ac407c2d1291"}
Jul 02 23:35:43.216325 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:43.216286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv" event={"ID":"242967cf-13ed-4c9f-9970-f61f28b46dcb","Type":"ContainerStarted","Data":"80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd"}
Jul 02 23:35:43.216717 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:43.216425    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:43.232713 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:43.232669    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv" podStartSLOduration=2.945555331 podStartE2EDuration="3.232657421s" totalImagesPullingTime="287.10209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:43.230938843 +0000 UTC m=+2050.167988149" watchObservedRunningTime="2026-07-02 23:35:43.232657421 +0000 UTC m=+2050.169706729"
Jul 02 23:35:49.226298 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:49.226270    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:35:53.837637 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:53.837596    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"]
Jul 02 23:35:53.838139 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:53.837827    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c" podUID="e5babb19-4a30-420a-b3b5-52f33d220836" containerName="maas-api" containerID="cri-o://9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae" gracePeriod=30
Jul 02 23:35:54.091436 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.091380    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:54.199269 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.199245    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5babb19-4a30-420a-b3b5-52f33d220836-openshift-service-ca\") pod \"e5babb19-4a30-420a-b3b5-52f33d220836\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") "
Jul 02 23:35:54.199398 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.199316    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tggml\" (UniqueName: \"kubernetes.io/projected/e5babb19-4a30-420a-b3b5-52f33d220836-kube-api-access-tggml\") pod \"e5babb19-4a30-420a-b3b5-52f33d220836\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") "
Jul 02 23:35:54.199398 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.199337    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5babb19-4a30-420a-b3b5-52f33d220836-maas-api-tls\") pod \"e5babb19-4a30-420a-b3b5-52f33d220836\" (UID: \"e5babb19-4a30-420a-b3b5-52f33d220836\") "
Jul 02 23:35:54.199635 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.199608    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5babb19-4a30-420a-b3b5-52f33d220836-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e5babb19-4a30-420a-b3b5-52f33d220836" (UID: "e5babb19-4a30-420a-b3b5-52f33d220836"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:54.201357 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.201333    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5babb19-4a30-420a-b3b5-52f33d220836-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e5babb19-4a30-420a-b3b5-52f33d220836" (UID: "e5babb19-4a30-420a-b3b5-52f33d220836"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:54.201441 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.201338    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5babb19-4a30-420a-b3b5-52f33d220836-kube-api-access-tggml" (OuterVolumeSpecName: "kube-api-access-tggml") pod "e5babb19-4a30-420a-b3b5-52f33d220836" (UID: "e5babb19-4a30-420a-b3b5-52f33d220836"). InnerVolumeSpecName "kube-api-access-tggml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:54.271789 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.271756    2575 generic.go:356] "Generic (PLEG): container finished" podID="e5babb19-4a30-420a-b3b5-52f33d220836" containerID="9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae" exitCode=0
Jul 02 23:35:54.271966 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.271796    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"
Jul 02 23:35:54.271966 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.271839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c" event={"ID":"e5babb19-4a30-420a-b3b5-52f33d220836","Type":"ContainerDied","Data":"9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae"}
Jul 02 23:35:54.271966 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.271901    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c" event={"ID":"e5babb19-4a30-420a-b3b5-52f33d220836","Type":"ContainerDied","Data":"6b45c09f405da660cf7fca3cf59d97509659f5c1951cfffb6bb70c59f57aad41"}
Jul 02 23:35:54.271966 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.271934    2575 scope.go:117] "RemoveContainer" containerID="9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae"
Jul 02 23:35:54.280653 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.280636    2575 scope.go:117] "RemoveContainer" containerID="9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae"
Jul 02 23:35:54.280911 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:35:54.280894    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae\": container with ID starting with 9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae not found: ID does not exist" containerID="9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae"
Jul 02 23:35:54.280980 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.280920    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae"} err="failed to get container status \"9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae\": rpc error: code = NotFound desc = could not find container \"9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae\": container with ID starting with 9417abe61a26a3c176e8e662d2849206e01646aa9434685cedaf0d29026b15ae not found: ID does not exist"
Jul 02 23:35:54.292278 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.292260    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"]
Jul 02 23:35:54.298865 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.298845    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-b797b8-557c6f455d-2zp5c"]
Jul 02 23:35:54.300218 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.300200    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5babb19-4a30-420a-b3b5-52f33d220836-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:35:54.300272 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.300223    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tggml\" (UniqueName: \"kubernetes.io/projected/e5babb19-4a30-420a-b3b5-52f33d220836-kube-api-access-tggml\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:35:54.300272 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:54.300234    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5babb19-4a30-420a-b3b5-52f33d220836-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:35:55.620910 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:35:55.620878    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5babb19-4a30-420a-b3b5-52f33d220836" path="/var/lib/kubelet/pods/e5babb19-4a30-420a-b3b5-52f33d220836/volumes"
Jul 02 23:36:00.714364 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:00.714273    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"]
Jul 02 23:36:00.714767 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:00.714497    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv" podUID="242967cf-13ed-4c9f-9970-f61f28b46dcb" containerName="maas-api" containerID="cri-o://80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd" gracePeriod=30
Jul 02 23:36:00.969992 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:00.969936    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:36:01.051117 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.051092    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242967cf-13ed-4c9f-9970-f61f28b46dcb-openshift-service-ca\") pod \"242967cf-13ed-4c9f-9970-f61f28b46dcb\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") "
Jul 02 23:36:01.051260 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.051130    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls\") pod \"242967cf-13ed-4c9f-9970-f61f28b46dcb\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") "
Jul 02 23:36:01.051260 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.051158    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddrvw\" (UniqueName: \"kubernetes.io/projected/242967cf-13ed-4c9f-9970-f61f28b46dcb-kube-api-access-ddrvw\") pod \"242967cf-13ed-4c9f-9970-f61f28b46dcb\" (UID: \"242967cf-13ed-4c9f-9970-f61f28b46dcb\") "
Jul 02 23:36:01.051498 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.051471    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242967cf-13ed-4c9f-9970-f61f28b46dcb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "242967cf-13ed-4c9f-9970-f61f28b46dcb" (UID: "242967cf-13ed-4c9f-9970-f61f28b46dcb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:36:01.053194 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.053166    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "242967cf-13ed-4c9f-9970-f61f28b46dcb" (UID: "242967cf-13ed-4c9f-9970-f61f28b46dcb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:36:01.053273 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.053219    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242967cf-13ed-4c9f-9970-f61f28b46dcb-kube-api-access-ddrvw" (OuterVolumeSpecName: "kube-api-access-ddrvw") pod "242967cf-13ed-4c9f-9970-f61f28b46dcb" (UID: "242967cf-13ed-4c9f-9970-f61f28b46dcb"). InnerVolumeSpecName "kube-api-access-ddrvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:36:01.152362 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.152341    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242967cf-13ed-4c9f-9970-f61f28b46dcb-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:36:01.152450 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.152363    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242967cf-13ed-4c9f-9970-f61f28b46dcb-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:36:01.152450 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.152375    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddrvw\" (UniqueName: \"kubernetes.io/projected/242967cf-13ed-4c9f-9970-f61f28b46dcb-kube-api-access-ddrvw\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:36:01.307302 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.307277    2575 generic.go:356] "Generic (PLEG): container finished" podID="242967cf-13ed-4c9f-9970-f61f28b46dcb" containerID="80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd" exitCode=0
Jul 02 23:36:01.307437 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.307335    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"
Jul 02 23:36:01.307437 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.307361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv" event={"ID":"242967cf-13ed-4c9f-9970-f61f28b46dcb","Type":"ContainerDied","Data":"80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd"}
Jul 02 23:36:01.307437 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.307422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv" event={"ID":"242967cf-13ed-4c9f-9970-f61f28b46dcb","Type":"ContainerDied","Data":"8ddba271a5cf97fa94f83649f4487767c6900a8e6afca2cd9ef9ac407c2d1291"}
Jul 02 23:36:01.307599 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.307451    2575 scope.go:117] "RemoveContainer" containerID="80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd"
Jul 02 23:36:01.315451 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.315438    2575 scope.go:117] "RemoveContainer" containerID="80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd"
Jul 02 23:36:01.315673 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:36:01.315654    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd\": container with ID starting with 80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd not found: ID does not exist" containerID="80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd"
Jul 02 23:36:01.315794 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.315681    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd"} err="failed to get container status \"80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd\": rpc error: code = NotFound desc = could not find container \"80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd\": container with ID starting with 80272c17b0d24bbf3fb4de5bb7f1ed5b0d514577d5dd929860824415bf7534fd not found: ID does not exist"
Jul 02 23:36:01.339106 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.339078    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"]
Jul 02 23:36:01.342616 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.342594    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-782a03-59599444f7-ffvvv"]
Jul 02 23:36:01.621080 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:01.620990    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242967cf-13ed-4c9f-9970-f61f28b46dcb" path="/var/lib/kubelet/pods/242967cf-13ed-4c9f-9970-f61f28b46dcb/volumes"
Jul 02 23:36:09.992961 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.992922    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"]
Jul 02 23:36:09.993479 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.993463    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5babb19-4a30-420a-b3b5-52f33d220836" containerName="maas-api"
Jul 02 23:36:09.993521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.993482    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5babb19-4a30-420a-b3b5-52f33d220836" containerName="maas-api"
Jul 02 23:36:09.993521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.993493    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242967cf-13ed-4c9f-9970-f61f28b46dcb" containerName="maas-api"
Jul 02 23:36:09.993521 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.993501    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="242967cf-13ed-4c9f-9970-f61f28b46dcb" containerName="maas-api"
Jul 02 23:36:09.993621 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.993610    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5babb19-4a30-420a-b3b5-52f33d220836" containerName="maas-api"
Jul 02 23:36:09.993654 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.993627    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="242967cf-13ed-4c9f-9970-f61f28b46dcb" containerName="maas-api"
Jul 02 23:36:09.996910 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.996894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:09.999470 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:09.999450    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-9352c3-serving-cert\""
Jul 02 23:36:10.005684 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.005652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"]
Jul 02 23:36:10.120604 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.120582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44mc7\" (UniqueName: \"kubernetes.io/projected/e47e1de3-dc16-4062-b676-8c052d307ab1-kube-api-access-44mc7\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.120703 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.120627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47e1de3-dc16-4062-b676-8c052d307ab1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.120703 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.120682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e47e1de3-dc16-4062-b676-8c052d307ab1-maas-api-tls\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.221763 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.221733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e47e1de3-dc16-4062-b676-8c052d307ab1-maas-api-tls\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.221879 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.221820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44mc7\" (UniqueName: \"kubernetes.io/projected/e47e1de3-dc16-4062-b676-8c052d307ab1-kube-api-access-44mc7\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.221879 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.221863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47e1de3-dc16-4062-b676-8c052d307ab1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.222442 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.222420    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47e1de3-dc16-4062-b676-8c052d307ab1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.224114 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.224097    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e47e1de3-dc16-4062-b676-8c052d307ab1-maas-api-tls\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.230369 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.230346    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44mc7\" (UniqueName: \"kubernetes.io/projected/e47e1de3-dc16-4062-b676-8c052d307ab1-kube-api-access-44mc7\") pod \"maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") " pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.308676 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.308657    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:10.446101 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:10.446074    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"]
Jul 02 23:36:10.448641 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:36:10.448615    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47e1de3_dc16_4062_b676_8c052d307ab1.slice/crio-26a5207229bb673ce1b6fa3672a7348c551f22f89fa711928ea5a31e830ae93e WatchSource:0}: Error finding container 26a5207229bb673ce1b6fa3672a7348c551f22f89fa711928ea5a31e830ae93e: Status 404 returned error can't find the container with id 26a5207229bb673ce1b6fa3672a7348c551f22f89fa711928ea5a31e830ae93e
Jul 02 23:36:11.358018 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:11.357980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f" event={"ID":"e47e1de3-dc16-4062-b676-8c052d307ab1","Type":"ContainerStarted","Data":"2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c"}
Jul 02 23:36:11.358466 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:11.358041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f" event={"ID":"e47e1de3-dc16-4062-b676-8c052d307ab1","Type":"ContainerStarted","Data":"26a5207229bb673ce1b6fa3672a7348c551f22f89fa711928ea5a31e830ae93e"}
Jul 02 23:36:11.358466 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:11.358092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:11.384653 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:11.384610    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f" podStartSLOduration=2.087896316 podStartE2EDuration="2.38459701s" totalImagesPullingTime="296.700694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:36:11.383586477 +0000 UTC m=+2078.320635784" watchObservedRunningTime="2026-07-02 23:36:11.38459701 +0000 UTC m=+2078.321646318"
Jul 02 23:36:17.368653 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:17.368623    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:36:18.163964 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.163933    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"]
Jul 02 23:36:18.167810 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.167789    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.170001 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.169977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-83f2de-serving-cert\""
Jul 02 23:36:18.179084 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.179041    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"]
Jul 02 23:36:18.285319 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.285294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.285446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.285339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td7t4\" (UniqueName: \"kubernetes.io/projected/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-kube-api-access-td7t4\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.285446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.285398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.386153 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.386113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td7t4\" (UniqueName: \"kubernetes.io/projected/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-kube-api-access-td7t4\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.386463 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.386158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.386463 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.386222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.386463 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:36:18.386315    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-83f2de-serving-cert: secret "maas-api-e2e-shared-b-83f2de-serving-cert" not found
Jul 02 23:36:18.386463 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:36:18.386370    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls podName:f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b nodeName:}" failed. No retries permitted until 2026-07-02 23:36:18.886353259 +0000 UTC m=+2085.823402548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls") pod "maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6" (UID: "f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b") : secret "maas-api-e2e-shared-b-83f2de-serving-cert" not found
Jul 02 23:36:18.386832 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.386813    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.394289 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.394271    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td7t4\" (UniqueName: \"kubernetes.io/projected/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-kube-api-access-td7t4\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.890107 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.890073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:18.892476 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:18.892449    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls\") pod \"maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") " pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:19.082001 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:19.081973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:19.418851 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:19.418805    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"]
Jul 02 23:36:19.421170 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:36:19.421145    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ed0a6a_d5df_46f6_8dc7_52e6d30bcb6b.slice/crio-8c9267156fa4f8165a942b6a0278021c8f11f3d2df3011936e3f9afe038be6f3 WatchSource:0}: Error finding container 8c9267156fa4f8165a942b6a0278021c8f11f3d2df3011936e3f9afe038be6f3: Status 404 returned error can't find the container with id 8c9267156fa4f8165a942b6a0278021c8f11f3d2df3011936e3f9afe038be6f3
Jul 02 23:36:20.402686 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:20.402653    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6" event={"ID":"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b","Type":"ContainerStarted","Data":"51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22"}
Jul 02 23:36:20.402838 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:20.402729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6" event={"ID":"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b","Type":"ContainerStarted","Data":"8c9267156fa4f8165a942b6a0278021c8f11f3d2df3011936e3f9afe038be6f3"}
Jul 02 23:36:20.402838 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:20.402774    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:20.418937 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:20.418896    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6" podStartSLOduration=1.9542537150000001 podStartE2EDuration="2.418882485s" totalImagesPullingTime="464.62877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:36:20.417775733 +0000 UTC m=+2087.354825041" watchObservedRunningTime="2026-07-02 23:36:20.418882485 +0000 UTC m=+2087.355931792"
Jul 02 23:36:26.411962 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:26.411931    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:36:33.682174 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:33.682147    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:36:33.683637 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:36:33.683617    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:41:33.717845 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:41:33.717817    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:41:33.718275 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:41:33.717824    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4bx2l_328eb2bc-7a95-4e95-a06f-bce9fe8630fc/ovn-acl-logging/0.log"
Jul 02 23:42:13.136988 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.136803    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"]
Jul 02 23:42:13.137685 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.137625    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f" podUID="e47e1de3-dc16-4062-b676-8c052d307ab1" containerName="maas-api" containerID="cri-o://2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c" gracePeriod=30
Jul 02 23:42:13.392551 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.392494    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:42:13.515563 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.515534    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44mc7\" (UniqueName: \"kubernetes.io/projected/e47e1de3-dc16-4062-b676-8c052d307ab1-kube-api-access-44mc7\") pod \"e47e1de3-dc16-4062-b676-8c052d307ab1\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") "
Jul 02 23:42:13.515693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.515571    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47e1de3-dc16-4062-b676-8c052d307ab1-openshift-service-ca\") pod \"e47e1de3-dc16-4062-b676-8c052d307ab1\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") "
Jul 02 23:42:13.515693 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.515646    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e47e1de3-dc16-4062-b676-8c052d307ab1-maas-api-tls\") pod \"e47e1de3-dc16-4062-b676-8c052d307ab1\" (UID: \"e47e1de3-dc16-4062-b676-8c052d307ab1\") "
Jul 02 23:42:13.515948 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.515916    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e47e1de3-dc16-4062-b676-8c052d307ab1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e47e1de3-dc16-4062-b676-8c052d307ab1" (UID: "e47e1de3-dc16-4062-b676-8c052d307ab1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:42:13.517587 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.517561    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e47e1de3-dc16-4062-b676-8c052d307ab1-kube-api-access-44mc7" (OuterVolumeSpecName: "kube-api-access-44mc7") pod "e47e1de3-dc16-4062-b676-8c052d307ab1" (UID: "e47e1de3-dc16-4062-b676-8c052d307ab1"). InnerVolumeSpecName "kube-api-access-44mc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:42:13.517681 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.517628    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e47e1de3-dc16-4062-b676-8c052d307ab1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e47e1de3-dc16-4062-b676-8c052d307ab1" (UID: "e47e1de3-dc16-4062-b676-8c052d307ab1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:42:13.616364 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.616336    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44mc7\" (UniqueName: \"kubernetes.io/projected/e47e1de3-dc16-4062-b676-8c052d307ab1-kube-api-access-44mc7\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:42:13.616364 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.616360    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e47e1de3-dc16-4062-b676-8c052d307ab1-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:42:13.616364 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:13.616370    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e47e1de3-dc16-4062-b676-8c052d307ab1-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:42:14.072407 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.072378    2575 generic.go:356] "Generic (PLEG): container finished" podID="e47e1de3-dc16-4062-b676-8c052d307ab1" containerID="2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c" exitCode=0
Jul 02 23:42:14.072589 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.072440    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"
Jul 02 23:42:14.072589 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.072467    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f" event={"ID":"e47e1de3-dc16-4062-b676-8c052d307ab1","Type":"ContainerDied","Data":"2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c"}
Jul 02 23:42:14.072589 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.072535    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f" event={"ID":"e47e1de3-dc16-4062-b676-8c052d307ab1","Type":"ContainerDied","Data":"26a5207229bb673ce1b6fa3672a7348c551f22f89fa711928ea5a31e830ae93e"}
Jul 02 23:42:14.072589 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.072564    2575 scope.go:117] "RemoveContainer" containerID="2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c"
Jul 02 23:42:14.080825 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.080810    2575 scope.go:117] "RemoveContainer" containerID="2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c"
Jul 02 23:42:14.081043 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:42:14.081026    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c\": container with ID starting with 2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c not found: ID does not exist" containerID="2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c"
Jul 02 23:42:14.081183 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.081065    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c"} err="failed to get container status \"2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c\": rpc error: code = NotFound desc = could not find container \"2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c\": container with ID starting with 2b16dc462afd6b4697e82d230f78862c93e3c9d14249f4d85e077f885494ac8c not found: ID does not exist"
Jul 02 23:42:14.087412 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.087392    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"]
Jul 02 23:42:14.091141 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:14.091121    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9352c3-7f76f598dc-7dk6f"]
Jul 02 23:42:15.621113 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:15.621081    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e47e1de3-dc16-4062-b676-8c052d307ab1" path="/var/lib/kubelet/pods/e47e1de3-dc16-4062-b676-8c052d307ab1/volumes"
Jul 02 23:42:39.492514 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.492483    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"]
Jul 02 23:42:39.492914 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.492687    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6" podUID="f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" containerName="maas-api" containerID="cri-o://51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22" gracePeriod=30
Jul 02 23:42:39.743457 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.743398    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:42:39.909504 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.909479    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td7t4\" (UniqueName: \"kubernetes.io/projected/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-kube-api-access-td7t4\") pod \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") "
Jul 02 23:42:39.909629 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.909517    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls\") pod \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") "
Jul 02 23:42:39.909629 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.909570    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-openshift-service-ca\") pod \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\" (UID: \"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b\") "
Jul 02 23:42:39.909973 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.909940    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" (UID: "f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:42:39.911406 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.911383    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" (UID: "f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:42:39.911488 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:39.911407    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-kube-api-access-td7t4" (OuterVolumeSpecName: "kube-api-access-td7t4") pod "f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" (UID: "f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b"). InnerVolumeSpecName "kube-api-access-td7t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:42:40.010476 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.010456    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td7t4\" (UniqueName: \"kubernetes.io/projected/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-kube-api-access-td7t4\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:42:40.010476 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.010477    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-maas-api-tls\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:42:40.010595 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.010485    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b-openshift-service-ca\") on node \"ip-10-0-142-239.ec2.internal\" DevicePath \"\""
Jul 02 23:42:40.197317 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.197292    2575 generic.go:356] "Generic (PLEG): container finished" podID="f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" containerID="51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22" exitCode=0
Jul 02 23:42:40.197413 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.197329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6" event={"ID":"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b","Type":"ContainerDied","Data":"51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22"}
Jul 02 23:42:40.197413 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.197340    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"
Jul 02 23:42:40.197413 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.197367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6" event={"ID":"f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b","Type":"ContainerDied","Data":"8c9267156fa4f8165a942b6a0278021c8f11f3d2df3011936e3f9afe038be6f3"}
Jul 02 23:42:40.197413 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.197388    2575 scope.go:117] "RemoveContainer" containerID="51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22"
Jul 02 23:42:40.206442 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.206407    2575 scope.go:117] "RemoveContainer" containerID="51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22"
Jul 02 23:42:40.206680 ip-10-0-142-239 kubenswrapper[2575]: E0702 23:42:40.206655    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22\": container with ID starting with 51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22 not found: ID does not exist" containerID="51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22"
Jul 02 23:42:40.206765 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.206686    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22"} err="failed to get container status \"51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22\": rpc error: code = NotFound desc = could not find container \"51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22\": container with ID starting with 51281f5049abdaec38da056a57b82ecba3712ad8d4a37f7b012d3dacb2c04e22 not found: ID does not exist"
Jul 02 23:42:40.222157 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.222132    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"]
Jul 02 23:42:40.225614 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:40.225592    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-83f2de-5cdfc4c575-whgk6"]
Jul 02 23:42:41.621024 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:41.620981    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" path="/var/lib/kubelet/pods/f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b/volumes"
Jul 02 23:42:50.631801 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:50.631771    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-t2xcs_9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a/manager/0.log"
Jul 02 23:42:50.745446 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:50.745415    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6cq4b_6375ea3d-7681-47f8-a405-3f6920eced12/manager/0.log"
Jul 02 23:42:50.871220 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:50.871190    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-847b8884f6-9288t_ed7d4785-7f6d-4526-910d-18fe1a902f8f/maas-api/0.log"
Jul 02 23:42:51.323648 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:51.323614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q7xjc_0934ce68-7e2b-4e91-adbe-5486cc3c8d58/server/0.log"
Jul 02 23:42:51.546709 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:51.546675    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-6srp8_3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7/manager/0.log"
Jul 02 23:42:51.552607 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:51.552585    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-6srp8_3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7/copy-manifests/0.log"
Jul 02 23:42:51.901933 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:51.901905    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c8tsc_931e54f9-c51a-4bf8-a61a-5b24cc23856c/postgres/0.log"
Jul 02 23:42:53.250773 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:53.250741    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6ft77_6ec9b09c-a223-4d78-a3e7-4390345292ef/manager/0.log"
Jul 02 23:42:53.365732 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:53.365706    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g4jgj_a0fc777e-5996-498d-ab57-cfa42e031282/manager/0.log"
Jul 02 23:42:53.476223 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:53.476200    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dptb2_918e8f40-37ac-44b1-ac42-89acea9ce2cb/kuadrant-console-plugin/0.log"
Jul 02 23:42:53.590757 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:53.590735    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-btwcf_dafd16ca-7eda-49cb-8c67-990da6a7bd0b/registry-server/0.log"
Jul 02 23:42:53.709358 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:53.709330    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mnbf7_6d9b8167-f473-4aba-8584-3ffb227ad9d0/manager/0.log"
Jul 02 23:42:53.941706 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:53.941638    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5rmf4_912f80e0-c862-4977-a4f1-4a83160a1a9e/manager/0.log"
Jul 02 23:42:54.509113 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:54.509081    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99946bbb8-m9zfj_c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84/kube-auth-proxy/0.log"
Jul 02 23:42:54.963724 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:54.963662    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-chhpf_573a8541-1d41-4c55-a0fe-0bd249785cae/payload-processing/0.log"
Jul 02 23:42:55.408705 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:55.408682    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lgmfb_b4bd8169-66bc-4d72-a705-3e7e5df85479/main/0.log"
Jul 02 23:42:55.834171 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:42:55.834147    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-d87hx_70e21bc1-cb68-45d7-984d-31eb4c4b523f/main/0.log"
Jul 02 23:43:03.052620 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:03.052585    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-79qqj_94d267d5-49fe-42da-a581-f2e74ea9c18b/global-pull-secret-syncer/0.log"
Jul 02 23:43:03.248262 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:03.248223    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sz7lt_fd28ad52-cc89-42b1-9d5f-211dc3061bd1/konnectivity-agent/0.log"
Jul 02 23:43:03.310505 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:03.310447    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-239.ec2.internal_4171bb48f6e62864b15f6dcc9fa0fe2a/haproxy/0.log"
Jul 02 23:43:08.392032 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:08.392000    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6ft77_6ec9b09c-a223-4d78-a3e7-4390345292ef/manager/0.log"
Jul 02 23:43:08.414930 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:08.414890    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g4jgj_a0fc777e-5996-498d-ab57-cfa42e031282/manager/0.log"
Jul 02 23:43:08.440184 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:08.440165    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dptb2_918e8f40-37ac-44b1-ac42-89acea9ce2cb/kuadrant-console-plugin/0.log"
Jul 02 23:43:08.475254 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:08.475232    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-btwcf_dafd16ca-7eda-49cb-8c67-990da6a7bd0b/registry-server/0.log"
Jul 02 23:43:08.594127 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:08.594100    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mnbf7_6d9b8167-f473-4aba-8584-3ffb227ad9d0/manager/0.log"
Jul 02 23:43:08.676499 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:08.676446    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5rmf4_912f80e0-c862-4977-a4f1-4a83160a1a9e/manager/0.log"
Jul 02 23:43:10.801706 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:10.801679    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pg2j6_ad084328-c6d5-4bd5-9152-19f55a612c4c/node-exporter/0.log"
Jul 02 23:43:10.821193 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:10.821167    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pg2j6_ad084328-c6d5-4bd5-9152-19f55a612c4c/kube-rbac-proxy/0.log"
Jul 02 23:43:10.843660 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:10.843641    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pg2j6_ad084328-c6d5-4bd5-9152-19f55a612c4c/init-textfile/0.log"
Jul 02 23:43:11.306405 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:11.306385    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5975468578-49vgq_05da4a93-70a6-4c2f-bb83-694f48a5f5dc/thanos-query/0.log"
Jul 02 23:43:11.324886 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:11.324867    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5975468578-49vgq_05da4a93-70a6-4c2f-bb83-694f48a5f5dc/kube-rbac-proxy-web/0.log"
Jul 02 23:43:11.343166 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:11.343145    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5975468578-49vgq_05da4a93-70a6-4c2f-bb83-694f48a5f5dc/kube-rbac-proxy/0.log"
Jul 02 23:43:11.360981 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:11.360965    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5975468578-49vgq_05da4a93-70a6-4c2f-bb83-694f48a5f5dc/prom-label-proxy/0.log"
Jul 02 23:43:11.381661 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:11.381635    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5975468578-49vgq_05da4a93-70a6-4c2f-bb83-694f48a5f5dc/kube-rbac-proxy-rules/0.log"
Jul 02 23:43:11.400258 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:11.400232    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5975468578-49vgq_05da4a93-70a6-4c2f-bb83-694f48a5f5dc/kube-rbac-proxy-metrics/0.log"
Jul 02 23:43:13.139492 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.139452    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"]
Jul 02 23:43:13.139898 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.139845    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" containerName="maas-api"
Jul 02 23:43:13.139898 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.139858    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" containerName="maas-api"
Jul 02 23:43:13.139898 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.139881    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e47e1de3-dc16-4062-b676-8c052d307ab1" containerName="maas-api"
Jul 02 23:43:13.139898 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.139887    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e47e1de3-dc16-4062-b676-8c052d307ab1" containerName="maas-api"
Jul 02 23:43:13.140148 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.139962    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e47e1de3-dc16-4062-b676-8c052d307ab1" containerName="maas-api"
Jul 02 23:43:13.140148 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.139970    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ed0a6a-d5df-46f6-8dc7-52e6d30bcb6b" containerName="maas-api"
Jul 02 23:43:13.143386 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.143357    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.145800 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.145771    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dblpz\"/\"kube-root-ca.crt\""
Jul 02 23:43:13.145954 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.145806    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dblpz\"/\"default-dockercfg-27qc6\""
Jul 02 23:43:13.146546 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.146531    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dblpz\"/\"openshift-service-ca.crt\""
Jul 02 23:43:13.150819 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.150795    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"]
Jul 02 23:43:13.254195 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.254166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-sys\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.254328 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.254215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-proc\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.254328 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.254283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjfrc\" (UniqueName: \"kubernetes.io/projected/473fc768-7ed5-4df6-871d-a42bb6538660-kube-api-access-mjfrc\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.254433 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.254332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-podres\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.254433 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.254379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-lib-modules\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355512 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-proc\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355625 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjfrc\" (UniqueName: \"kubernetes.io/projected/473fc768-7ed5-4df6-871d-a42bb6538660-kube-api-access-mjfrc\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355625 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-podres\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355625 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-lib-modules\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355625 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-sys\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355625 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355609    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-proc\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355857 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355677    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-sys\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355857 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355770    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-lib-modules\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.355857 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.355772    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/473fc768-7ed5-4df6-871d-a42bb6538660-podres\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.363210 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.363181    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjfrc\" (UniqueName: \"kubernetes.io/projected/473fc768-7ed5-4df6-871d-a42bb6538660-kube-api-access-mjfrc\") pod \"perf-node-gather-daemonset-zkpm5\" (UID: \"473fc768-7ed5-4df6-871d-a42bb6538660\") " pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.455730 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.455670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:13.586035 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.585967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"]
Jul 02 23:43:13.588279 ip-10-0-142-239 kubenswrapper[2575]: W0702 23:43:13.588250    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod473fc768_7ed5_4df6_871d_a42bb6538660.slice/crio-1a5aa4bf165ba1ea534de1bbc6ddfe92ac0788d0cb3d45d05106c6eee1cc3da5 WatchSource:0}: Error finding container 1a5aa4bf165ba1ea534de1bbc6ddfe92ac0788d0cb3d45d05106c6eee1cc3da5: Status 404 returned error can't find the container with id 1a5aa4bf165ba1ea534de1bbc6ddfe92ac0788d0cb3d45d05106c6eee1cc3da5
Jul 02 23:43:13.726595 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:13.726540    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f5bcddbc8-dfmrd_e4981a20-7d1d-4ebb-8d3c-27f55ebe64f8/console/0.log"
Jul 02 23:43:14.370910 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:14.370870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5" event={"ID":"473fc768-7ed5-4df6-871d-a42bb6538660","Type":"ContainerStarted","Data":"5e2336afee706be2c8dd2dcfc745746b4509e6ad847f4543626e439882adf30b"}
Jul 02 23:43:14.371326 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:14.370942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5" event={"ID":"473fc768-7ed5-4df6-871d-a42bb6538660","Type":"ContainerStarted","Data":"1a5aa4bf165ba1ea534de1bbc6ddfe92ac0788d0cb3d45d05106c6eee1cc3da5"}
Jul 02 23:43:14.371326 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:14.371074    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:14.385924 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:14.385869    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5" podStartSLOduration=1.385854099 podStartE2EDuration="1.385854099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:43:14.385174134 +0000 UTC m=+2501.322223462" watchObservedRunningTime="2026-07-02 23:43:14.385854099 +0000 UTC m=+2501.322903407"
Jul 02 23:43:15.317820 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:15.317794    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ncm48_9197928e-2c0c-4048-899e-42458ba4f15f/dns/0.log"
Jul 02 23:43:15.336183 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:15.336132    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ncm48_9197928e-2c0c-4048-899e-42458ba4f15f/kube-rbac-proxy/0.log"
Jul 02 23:43:15.400169 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:15.400149    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2xwww_32405914-3a78-48e6-bbcc-04c37c5afecd/dns-node-resolver/0.log"
Jul 02 23:43:16.030332 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:16.030299    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vxmqs_7c2e7f2c-5a35-4e82-a2a6-edda721b7dcf/node-ca/0.log"
Jul 02 23:43:17.048301 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:17.048274    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99946bbb8-m9zfj_c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84/kube-auth-proxy/0.log"
Jul 02 23:43:17.213452 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:17.213429    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-chhpf_573a8541-1d41-4c55-a0fe-0bd249785cae/payload-processing/0.log"
Jul 02 23:43:17.927034 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:17.927006    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbrzn_af9820d9-4a63-4154-be88-d7e6b0b8f97e/serve-healthcheck-canary/0.log"
Jul 02 23:43:18.442852 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:18.442816    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbkrr_60464393-f98e-4d2d-8456-69abcde0af08/kube-rbac-proxy/0.log"
Jul 02 23:43:18.460001 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:18.459983    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbkrr_60464393-f98e-4d2d-8456-69abcde0af08/exporter/0.log"
Jul 02 23:43:18.478295 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:18.478276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbkrr_60464393-f98e-4d2d-8456-69abcde0af08/extractor/0.log"
Jul 02 23:43:20.385243 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:20.385217    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dblpz/perf-node-gather-daemonset-zkpm5"
Jul 02 23:43:20.547278 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:20.547253    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-t2xcs_9d4b6ce8-f4f9-4322-a5c5-be3dd3e8e44a/manager/0.log"
Jul 02 23:43:20.671551 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:20.671486    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6cq4b_6375ea3d-7681-47f8-a405-3f6920eced12/manager/0.log"
Jul 02 23:43:20.703111 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:20.703070    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-847b8884f6-9288t_ed7d4785-7f6d-4526-910d-18fe1a902f8f/maas-api/0.log"
Jul 02 23:43:20.854397 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:20.854382    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q7xjc_0934ce68-7e2b-4e91-adbe-5486cc3c8d58/server/0.log"
Jul 02 23:43:20.951353 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:20.951286    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-6srp8_3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7/manager/0.log"
Jul 02 23:43:20.970258 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:20.970238    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-676b9dcdc-6srp8_3a29a2fa-74c2-4b11-95ed-ecd5683a5ea7/copy-manifests/0.log"
Jul 02 23:43:21.126336 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:21.126316    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c8tsc_931e54f9-c51a-4bf8-a61a-5b24cc23856c/postgres/0.log"
Jul 02 23:43:22.589370 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:22.589295    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6mgn8_adbcd450-8787-4f40-8246-361512dadfe6/openshift-lws-operator/0.log"
Jul 02 23:43:23.597893 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:23.597863    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99946bbb8-m9zfj_c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84/kube-auth-proxy/0.log"
Jul 02 23:43:23.707995 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:23.707937    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-chhpf_573a8541-1d41-4c55-a0fe-0bd249785cae/payload-processing/0.log"
Jul 02 23:43:25.028430 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:25.028391    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99946bbb8-m9zfj_c6bfb0fb-b7d9-45d9-b8a1-7fb1a6005e84/kube-auth-proxy/0.log"
Jul 02 23:43:25.150726 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:25.150701    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-chhpf_573a8541-1d41-4c55-a0fe-0bd249785cae/payload-processing/0.log"
Jul 02 23:43:27.560999 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:27.560925    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dtrx7_464e7b60-b431-4fd2-924d-a7dd5f932226/migrator/0.log"
Jul 02 23:43:27.579096 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:27.579069    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dtrx7_464e7b60-b431-4fd2-924d-a7dd5f932226/graceful-termination/0.log"
Jul 02 23:43:28.922876 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:28.922850    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4hjr_e3609761-4f85-439e-8e39-7dc1faf96080/kube-multus-additional-cni-plugins/0.log"
Jul 02 23:43:28.942282 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:28.942248    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4hjr_e3609761-4f85-439e-8e39-7dc1faf96080/egress-router-binary-copy/0.log"
Jul 02 23:43:28.959928 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:28.959906    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4hjr_e3609761-4f85-439e-8e39-7dc1faf96080/cni-plugins/0.log"
Jul 02 23:43:28.977955 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:28.977932    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4hjr_e3609761-4f85-439e-8e39-7dc1faf96080/bond-cni-plugin/0.log"
Jul 02 23:43:28.995632 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:28.995614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4hjr_e3609761-4f85-439e-8e39-7dc1faf96080/routeoverride-cni/0.log"
Jul 02 23:43:29.012734 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:29.012718    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4hjr_e3609761-4f85-439e-8e39-7dc1faf96080/whereabouts-cni-bincopy/0.log"
Jul 02 23:43:29.029922 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:29.029903    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4hjr_e3609761-4f85-439e-8e39-7dc1faf96080/whereabouts-cni/0.log"
Jul 02 23:43:29.240283 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:29.240232    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j6mrv_4b0d4b43-4df7-41f4-87aa-706c96829d6b/kube-multus/0.log"
Jul 02 23:43:29.359522 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:29.359504    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vx6gc_2fe605be-a403-46ec-8e29-89278da41672/network-metrics-daemon/0.log"
Jul 02 23:43:29.376402 ip-10-0-142-239 kubenswrapper[2575]: I0702 23:43:29.376388    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vx6gc_2fe605be-a403-46ec-8e29-89278da41672/kube-rbac-proxy/0.log"