Jul 10 18:58:29.648993 ip-10-0-139-108 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 18:58:30.079315 ip-10-0-139-108 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:58:30.079315 ip-10-0-139-108 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 18:58:30.079315 ip-10-0-139-108 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:58:30.079315 ip-10-0-139-108 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 18:58:30.079315 ip-10-0-139-108 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:58:30.080410 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.080328    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 18:58:30.085314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085299    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:30.085314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085313    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085317    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085321    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085325    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085329    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085332    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085335    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085338    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085341    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085344    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085347    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085350    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085352    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085355    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085357    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085360    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085363    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085365    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085368    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085371    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:30.085380 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085373    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085376    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085378    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085388    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085392    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085396    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085400    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085403    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085406    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085409    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085412    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085415    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085418    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085421    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085424    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085427    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085429    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085432    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085434    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:30.085874 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085437    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085440    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085442    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085444    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085447    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085449    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085452    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085454    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085457    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085459    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085462    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085464    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085468    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085470    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085473    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085477    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085480    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085482    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085484    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:30.086339 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085487    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085489    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085492    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085494    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085497    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085499    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085503    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085506    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085509    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085513    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085517    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085520    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085522    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085525    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085528    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085530    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085533    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085536    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085538    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:30.086833 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085541    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085544    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085546    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085549    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085551    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085553    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085556    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085558    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085561    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085564    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085567    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085569    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085572    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085574    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085577    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085580    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085582    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085585    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085587    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085590    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:30.087273 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.085592    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086284    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086291    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086295    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086297    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086300    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086303    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086306    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086308    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086311    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086315    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086319    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086322    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086325    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086328    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086330    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086333    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086335    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086338    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086342    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:30.087785 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086345    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086348    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086351    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086354    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086356    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086361    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086364    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086367    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086370    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086373    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086375    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086378    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086380    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086383    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086385    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086389    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086392    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086395    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086397    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:30.088314 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086400    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086402    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086406    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086409    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086417    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086420    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086423    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086425    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086428    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086430    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086433    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086435    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086438    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086441    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086444    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086446    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086449    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086451    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086454    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:30.088811 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086458    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086461    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086463    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086466    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086469    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086471    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086474    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086476    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086479    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086481    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086484    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086486    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086489    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086492    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086494    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086496    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086499    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086501    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086504    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086507    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:30.089279 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086509    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086512    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086514    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086517    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086519    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086523    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086525    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086528    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086531    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086533    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086536    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086539    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086541    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086544    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086547    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086549    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086552    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086554    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086557    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086559    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:30.089759 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086562    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086564    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086966    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086972    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086975    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086978    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086981    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086985    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086988    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086991    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086994    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.086997    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087000    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087002    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087005    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087008    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087010    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087013    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087016    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087018    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:30.090250 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087021    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087024    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087026    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087029    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087031    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087035    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087037    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087040    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087042    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087045    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087047    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087050    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087052    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087055    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087058    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087060    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087063    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087065    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087068    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087070    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:30.090732 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087073    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087075    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087078    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087081    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087083    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087086    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087088    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087091    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087093    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087096    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087099    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087101    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087104    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087106    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087109    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087112    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087114    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087117    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087119    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087122    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:30.091216 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087124    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087127    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087129    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087133    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087135    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087138    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087141    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087143    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087146    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087148    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087151    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087154    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087156    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087160    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087164    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087168    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087171    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087174    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087177    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:30.091673 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087179    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087182    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087185    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087188    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087190    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087193    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087195    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087200    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087204    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087207    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087210    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087212    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087215    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087217    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087220    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087223    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087225    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087228    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087230    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:30.092139 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087233    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087235    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087238    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087301    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087307    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087313    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087319    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087324    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087328    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087334    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087340    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087346    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087351    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087355    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087359    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087362    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087365    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087367    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087370    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087373    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087376    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087381    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087383    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 18:58:30.092576 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087386    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087389    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087392    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087396    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087399    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087401    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087405    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087407    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087410    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087413    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087416    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087419    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087422    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087426    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087429    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087431    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087434    2556 flags.go:64] FLAG: --enable-server="true"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087437    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087441    2556 flags.go:64] FLAG: --event-burst="100"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087444    2556 flags.go:64] FLAG: --event-qps="50"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087447    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087451    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087454    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087457    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 18:58:30.093116 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087460    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087463    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087466    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087469    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087471    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087474    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087477    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087480    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087483    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087486    2556 flags.go:64] FLAG: --feature-gates=""
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087490    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087492    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087495    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087498    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087501    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087504    2556 flags.go:64] FLAG: --help="false"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087507    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087510    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087516    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087519    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087522    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087525    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087528    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 18:58:30.093669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087531    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087534    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087537    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087540    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087543    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087545    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087548    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087555    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087558    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087561    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087564    2556 flags.go:64] FLAG: --lock-file=""
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087567    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087569    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087572    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087577    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087583    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087586    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087589    2556 flags.go:64] FLAG: --logging-format="text"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087591    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087595    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087597    2556 flags.go:64] FLAG: --manifest-url=""
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087600    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087604    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087607    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087611    2556 flags.go:64] FLAG: --max-pods="110"
Jul 10 18:58:30.094342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087614    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087617    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087621    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087624    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087627    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087630    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087632    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087638    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087641    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087644    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087647    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087650    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087655    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087658    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087661    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087669    2556 flags.go:64] FLAG: --port="10250"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087672    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087675    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00d4d861cb8bb8a2b"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087678    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087681    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087684    2556 flags.go:64] FLAG: --register-node="true"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087687    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087691    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087694    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 10 18:58:30.094957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087697    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087700    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087704    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087719    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087722    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087725    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087728    2556 flags.go:64] FLAG: --runonce="false"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087731    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087734    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087737    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087743    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087748    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087751    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087754    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087756    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087760    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087763    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087766    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087768    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087771    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087774    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087777    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087782    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087785    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087793    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 18:58:30.095522 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087798    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087801    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087803    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087820    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087824    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087830    2556 flags.go:64] FLAG: --v="2"
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087835    2556 flags.go:64] FLAG: --version="false"
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087842    2556 flags.go:64] FLAG: --vmodule=""
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087846    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.087849    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087960    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087964    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087967    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087969    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087972    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087975    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087977    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087980    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087984    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087986    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087989    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087992    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:30.096130 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087994    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087997    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.087999    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088002    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088005    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088008    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088010    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088013    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088015    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088018    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088021    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088023    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088026    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088028    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088031    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088035    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088037    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088040    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088042    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088045    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:30.096645 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088048    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088050    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088053    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088055    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088058    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088060    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088064    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088067    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088071    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088073    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088076    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088078    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088081    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088084    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088086    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088089    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088091    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088094    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088096    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088099    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:30.097133 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088101    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088104    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088107    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088110    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088112    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088115    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088117    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088122    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088124    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088127    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088130    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088132    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088134    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088137    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088140    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088143    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088145    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088147    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088150    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088152    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:30.097641 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088157    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088159    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088162    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088165    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088167    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088170    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088173    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088175    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088178    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088180    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088183    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088185    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088188    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088192    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088195    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088198    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088202    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088206    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088209    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:30.098210 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088214    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088217    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088220    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088222    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088225    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088228    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088230    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.088233    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.088238    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.095427    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.095443    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.095462    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.095475    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095528    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:30.098649 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095533    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095537    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095540    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095543    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095546    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095548    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095551    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095554    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095557    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095559    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095562    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095564    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095567    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095570    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095572    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095575    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095578    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095580    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095584    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095588    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:30.099024 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095591    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095594    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095596    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095600    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095602    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095605    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095608    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095611    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095614    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095617    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095620    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095622    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095625    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095627    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095630    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095632    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095635    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095637    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095640    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095643    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:30.099490 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095645    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095648    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095652    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095655    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095658    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095661    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095664    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095666    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095669    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095672    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095674    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095677    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095679    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095682    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095684    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095687    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095689    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095692    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095694    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:30.099976 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095697    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095700    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095703    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095706    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095724    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095728    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095733    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095737    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095740    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095743    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095746    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095748    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095751    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095753    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095756    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095758    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095761    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095763    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095766    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:30.100445 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095768    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095771    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095773    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095776    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095778    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095781    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095784    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095786    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095790    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095794    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095797    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095800    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095803    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095805    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095808    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095810    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095814    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095816    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095819    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:30.100901 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095821    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.095826    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095934    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095939    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095942    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095945    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095948    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095950    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095953    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095956    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095958    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095961    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095963    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095966    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095969    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:30.101355 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095971    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095974    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095976    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095979    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095981    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095984    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095987    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095989    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095992    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095995    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.095997    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096000    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096003    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096005    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096008    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096012    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096016    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096019    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096023    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:30.101784 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096026    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096029    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096032    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096035    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096038    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096041    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096044    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096046    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096049    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096051    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096054    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096057    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096059    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096062    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096064    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096067    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096070    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096073    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096075    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:30.102242 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096078    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096081    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096084    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096088    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096090    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096093    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096095    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096098    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096101    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096103    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096106    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096108    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096111    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096114    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096116    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096119    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096121    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096124    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096126    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:30.102693 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096129    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096131    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096134    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096136    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096139    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096142    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096144    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096147    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096149    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096152    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096155    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096157    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096160    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096162    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096165    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096167    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096169    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096172    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096174    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096177    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:30.103179 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096179    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096182    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096184    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096186    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096189    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096192    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096195    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096197    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:30.096200    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.096204    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.096303    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.098518    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.100151    2556 server.go:1019] "Starting client certificate rotation"
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.100254    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:58:30.103643 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.100309    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:58:30.103989 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.102998    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:58:30.105149 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.105128    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:58:30.114981 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.114963    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 10 18:58:30.117115 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.117099    2556 log.go:25] "Validated CRI v1 image API"
Jul 10 18:58:30.118033 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.118016    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 18:58:30.122517 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.122491    2556 fs.go:135] Filesystem UUIDs: map[537e482f-381a-4684-a908-ff4e9253ef60:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b344a3c5-9a10-456b-901e-8af1f6d26f37:/dev/nvme0n1p4]
Jul 10 18:58:30.122609 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.122515    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 18:58:30.128590 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.128484    2556 manager.go:216] Machine: {Timestamp:2026-07-10 18:58:30.127990955 +0000 UTC m=+0.359952009 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099674 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ec134443ccda8a3719f7fa0bf1e9 SystemUUID:ec28ec13-4443-ccda-8a37-19f7fa0bf1e9 BootID:5ce7856f-9b73-4fa6-84ce-7a5e9c42a0a5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:17:6d:9d:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:17:6d:9d:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:f3:ae:0b:ab:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 18:58:30.128590 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.128581    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 18:58:30.128733 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.128649    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 18:58:30.130688 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.130666    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 18:58:30.130825 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.130690    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 18:58:30.131569 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.131559    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 18:58:30.131603 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.131570    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 18:58:30.131603 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.131578    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:58:30.132321 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.132311    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:58:30.132664 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.132650    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:58:30.133988 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.133976    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 18:58:30.137337 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137325    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:58:30.137465 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137455    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 18:58:30.137505 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137487    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 18:58:30.137505 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137499    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 18:58:30.137559 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137514    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 18:58:30.137559 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137523    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 10 18:58:30.137559 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137534    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 18:58:30.137895 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137877    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:58:30.138004 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.137900    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:58:30.140283 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.140258    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 18:58:30.142532 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142518    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 18:58:30.142606 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142548    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 18:58:30.142731 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142703    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 18:58:30.142768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142742    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 18:58:30.142768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142750    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 18:58:30.142768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142755    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 18:58:30.142768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142764    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 18:58:30.142768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.142769    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 18:58:30.143408 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.143393    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 18:58:30.143462 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.143410    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 18:58:30.143462 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.143423    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 18:58:30.143462 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.143431    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 18:58:30.143462 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.143444    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 18:58:30.143462 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.143456    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 18:58:30.144341 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.144330    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 18:58:30.144405 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.144343    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 18:58:30.147770 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.147753    2556 server.go:1268] "Started kubelet"
Jul 10 18:58:30.147845 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.147822    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 18:58:30.147972 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.147917    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 18:58:30.148019 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.147995    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 18:58:30.152603 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.152582    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 18:58:30.152869 ip-10-0-139-108 systemd[1]: Started Kubernetes Kubelet.
Jul 10 18:58:30.152967 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.152901    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 18:58:30.154536 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.154510    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 18:58:30.154743 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.154703    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 18:58:30.155198 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.155177    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 18:58:30.155368 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.155345    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 18:58:30.159370 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.158254    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-108.ec2.internal.18c102b678b2f977  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-108.ec2.internal,UID:ip-10-0-139-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-108.ec2.internal,},FirstTimestamp:2026-07-10 18:58:30.147725687 +0000 UTC m=+0.379686721,LastTimestamp:2026-07-10 18:58:30.147725687 +0000 UTC m=+0.379686721,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-108.ec2.internal,}"
Jul 10 18:58:30.161572 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.161555    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tjwrz"
Jul 10 18:58:30.162118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162096    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 18:58:30.162118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162114    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 18:58:30.162266 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.162211    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:30.162797 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162780    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 18:58:30.162797 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162783    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 18:58:30.162902 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162806    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 18:58:30.162943 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162923    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 18:58:30.162943 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162929    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 18:58:30.163025 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162971    2556 factory.go:55] Registering systemd factory
Jul 10 18:58:30.163025 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.162986    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 10 18:58:30.163216 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.163187    2556 factory.go:153] Registering CRI-O factory
Jul 10 18:58:30.163216 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.163204    2556 factory.go:223] Registration of the crio container factory successfully
Jul 10 18:58:30.163346 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.163256    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 18:58:30.163346 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.163281    2556 factory.go:103] Registering Raw factory
Jul 10 18:58:30.163346 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.163296    2556 manager.go:1196] Started watching for new ooms in manager
Jul 10 18:58:30.163654 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.163642    2556 manager.go:349] Starting recovery of all containers
Jul 10 18:58:30.165887 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.165863    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 18:58:30.165982 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.165961    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 18:58:30.168462 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.168438    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tjwrz"
Jul 10 18:58:30.173592 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.173573    2556 manager.go:354] Recovery completed
Jul 10 18:58:30.178304 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.178292    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:30.180165 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.180149    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:30.180235 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.180183    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:30.180235 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.180197    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:30.180773 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.180756    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 18:58:30.180773 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.180771    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 18:58:30.180881 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.180788    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:58:30.180881 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.180785    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:30.181566 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.181552    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:30.181619 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.181575    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:30.181619 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.181584    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:30.181986 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.181976    2556 policy_none.go:49] "None policy: Start"
Jul 10 18:58:30.182018 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.181991    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 18:58:30.182018 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.182001    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 18:58:30.183031 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.183020    2556 policy_none.go:47] "Start"
Jul 10 18:58:30.263262 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.263110    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:30.275418 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.275402    2556 manager.go:337] "Starting Device Plugin manager"
Jul 10 18:58:30.275517 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.275435    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 18:58:30.275517 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.275446    2556 server.go:87] "Starting device plugin registration server"
Jul 10 18:58:30.275764 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.275750    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 18:58:30.275834 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.275765    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 18:58:30.275882 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.275861    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 18:58:30.276000 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.275954    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 18:58:30.276000 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.275969    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 18:58:30.276643 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.276622    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 18:58:30.276751 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.276683    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:30.301688 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.301652    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 18:58:30.303011 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.302989    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 18:58:30.303102 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.303027    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 18:58:30.303102 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.303050    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 18:58:30.303102 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.303084    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 18:58:30.305787 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.305765    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:30.374188 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.374109    2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-108.ec2.internal\" not found" node="ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.376206 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.376190    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:30.378004 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.377988    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:30.378087 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.378023    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:30.378087 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.378036    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:30.378087 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.378060    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.391538 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.391520    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.391592 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.391542    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-108.ec2.internal\": node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:30.404102 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.404080    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal"]
Jul 10 18:58:30.404173 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.404134    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:30.405589 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.405575    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:30.405654 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.405600    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:30.405654 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.405609    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:30.407675 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.407664    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:30.407811 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.407797    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.407868 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.407834    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:30.408338 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.408323    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:30.408412 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.408374    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:30.408412 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.408398    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:30.408412 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.408408    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:30.408530 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.408378    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:30.408530 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.408470    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:30.410080 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.410065    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.410165 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.410091    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:30.410855 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.410839    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:30.410919 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.410870    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:30.410919 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.410888    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:30.414453 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.414435    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:30.429334 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.429311    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-108.ec2.internal\" not found" node="ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.433665 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.433650    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-108.ec2.internal\" not found" node="ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.464656 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.464640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/358e0de60fbd33a58841a6c3c2eebdab-config\") pod \"kube-apiserver-proxy-ip-10-0-139-108.ec2.internal\" (UID: \"358e0de60fbd33a58841a6c3c2eebdab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.464768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.464662    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdeb9bd1fe2602d49fd99ae67800a425-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal\" (UID: \"bdeb9bd1fe2602d49fd99ae67800a425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.464768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.464680    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdeb9bd1fe2602d49fd99ae67800a425-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal\" (UID: \"bdeb9bd1fe2602d49fd99ae67800a425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.515031 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:30.515008    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:30.564838 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.564819    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdeb9bd1fe2602d49fd99ae67800a425-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal\" (UID: \"bdeb9bd1fe2602d49fd99ae67800a425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.564941 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.564850    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdeb9bd1fe2602d49fd99ae67800a425-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal\" (UID: \"bdeb9bd1fe2602d49fd99ae67800a425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.564941 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.564872    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/358e0de60fbd33a58841a6c3c2eebdab-config\") pod \"kube-apiserver-proxy-ip-10-0-139-108.ec2.internal\" (UID: \"358e0de60fbd33a58841a6c3c2eebdab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.564941 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.564926    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdeb9bd1fe2602d49fd99ae67800a425-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal\" (UID: \"bdeb9bd1fe2602d49fd99ae67800a425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.564941 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.564931    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdeb9bd1fe2602d49fd99ae67800a425-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal\" (UID: \"bdeb9bd1fe2602d49fd99ae67800a425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:30.565077 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:30.564961    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/358e0de60fbd33a58841a6c3c2eebdab-config\") pod \"kube-apiserver-proxy-ip-10-0-139-108.ec2.internal\" (UID: \"358e0de60fbd33a58841a6c3c2eebdab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:31.658973 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:31.658950    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:31.759581 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:31.759517    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:31.774693 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:31.774673    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:31.780621 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:31.780606    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:31.860620 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:31.860591    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:31.961049 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:31.961022    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:32.027957 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.027894    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:32.061931 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.061880    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-108.ec2.internal\" not found"
Jul 10 18:58:32.062262 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.062247    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:32.106477 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.106451    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:32.118653 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.118627    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:58:32.120473 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.120458    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal"
Jul 10 18:58:32.129569 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.129545    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:58:32.142682 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.142662    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 18:58:32.142797 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.142774    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:58:32.142849 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.142775    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:58:32.142849 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.142772    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:58:32.181910 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.181885    2556 apiserver.go:52] "Watching apiserver"
Jul 10 18:58:32.197532 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.197514    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 18:58:32.198406 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.198385    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-n2qtk","openshift-network-operator/iptables-alerter-wxfnp","openshift-ovn-kubernetes/ovnkube-node-82rhc","kube-system/global-pull-secret-syncer-4c9q6","kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7","openshift-cluster-node-tuning-operator/tuned-8g2sn","openshift-dns/node-resolver-p7ct2","openshift-image-registry/node-ca-7nq82","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal","openshift-multus/multus-additional-cni-plugins-8zsks","kube-system/konnectivity-agent-svcd9","openshift-multus/multus-4lj9x","openshift-multus/network-metrics-daemon-rpd9k"]
Jul 10 18:58:32.199864 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.199845    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.201260 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.201243    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.202600 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.202392    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:58:32.202600 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.202403    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 18:58:32.202600 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.202463    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4hndr\""
Jul 10 18:58:32.202953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.202936    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.203524 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.203505    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 18:58:32.203760 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.203743    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 18:58:32.203794 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.203767    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 18:58:32.203827 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.203792    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 18:58:32.204068 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.204054    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 18:58:32.204479 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.204459    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv4ln\""
Jul 10 18:58:32.205666 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.205645    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 18:58:32.205823 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.205806    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 18:58:32.206085 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.205939    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 18:58:32.206085 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.205942    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tlv89\""
Jul 10 18:58:32.206085 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.206027    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 18:58:32.206321 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.206084    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 18:58:32.206321 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.206256    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 18:58:32.206321 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.206259    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 18:58:32.206644 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.206629    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.206737 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.206706    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:32.207987 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.207955    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:32.208107 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.208005    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:32.209222 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.209207    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.210608 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.210593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.211302 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211281    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-env-overrides\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211399 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211318    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45c81fd8-1c96-44ab-aa35-a80dab1f8204-dbus\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.211399 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211344    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-var-lib-kubelet\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.211399 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-system-cni-dir\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.211567 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211418    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjs2\" (UniqueName: \"kubernetes.io/projected/606d00f3-e55d-4979-bc2b-f44c8f106afb-kube-api-access-7hjs2\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.211567 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211454    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 18:58:32.211567 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-var-lib-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211567 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45c81fd8-1c96-44ab-aa35-a80dab1f8204-kubelet-config\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.211567 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211506    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 18:58:32.211567 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.211567 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211548    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-sys\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211523    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8g9sm\""
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211633    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-systemd\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211672    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-etc-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211724    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211763    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-ovn\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211791    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g687\" (UniqueName: \"kubernetes.io/projected/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-kube-api-access-2g687\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211812    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-kubernetes\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211835    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-run-netns\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211856    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211882    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-modprobe-d\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.211912 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-systemd\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211921    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-host\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211939    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5d5c\" (UniqueName: \"kubernetes.io/projected/2f7ff8fe-4a3a-410b-855b-5881d34000df-kube-api-access-x5d5c\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211953    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-cnibin\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211967    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-systemd-units\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.211983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212004    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovnkube-script-lib\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysconfig\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212057    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysctl-d\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212074    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-lib-modules\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212119    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-cni-bin\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-cni-netd\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212211    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-run\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.212581 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-tuned\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212275    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f7ff8fe-4a3a-410b-855b-5881d34000df-tmp\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212296    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-os-release\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212327    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-kubelet\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-slash\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysctl-conf\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212437    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-node-log\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-log-socket\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovnkube-config\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.212923    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.213010    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.213023    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 18:58:32.213421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.213419    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.214275 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.213633    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lkv45\""
Jul 10 18:58:32.214275 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.214220    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jtl22\""
Jul 10 18:58:32.214275 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.214220    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 18:58:32.214819 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.214800    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.215458 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.215435    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:58:32.215816 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.215801    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 18:58:32.215890 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.215826    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 18:58:32.215890 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.215835    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gjr6d\""
Jul 10 18:58:32.216364 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.216347    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:32.216451 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.216396    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:32.216763 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.216749    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 18:58:32.216962 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.216948    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 18:58:32.217045 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.216968    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g4kz7\""
Jul 10 18:58:32.217045 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.216931    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:53:31 +0000 UTC" deadline="2027-12-17 21:05:54.977285151 +0000 UTC"
Jul 10 18:58:32.217045 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.217030    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12602h7m22.760258104s"
Jul 10 18:58:32.217503 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.217486    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:58:32.217590 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.217574    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.219749 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.219732    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-csww5\""
Jul 10 18:58:32.219836 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.219773    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 18:58:32.219900 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.219885    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 18:58:32.245938 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.245913    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2rkmh"
Jul 10 18:58:32.255338 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.255319    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2rkmh"
Jul 10 18:58:32.307375 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.307352    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 18:58:32.312826 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-k8s-cni-cncf-io\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312828    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-sys-fs\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312851    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-modprobe-d\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-host\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312912    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-cnibin\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312946    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312934    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-host\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312977    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-modprobe-d\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.312993 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.312984    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-cnibin\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313006    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-cni-binary-copy\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-cni-multus\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313053    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9c519d6-a78e-4d7b-9834-cd1b40370815-hosts-file\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-lib-modules\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313102    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-cni-bin\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-cnibin\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313184    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79899833-0ee6-4e04-99c7-af8f6c83ec56-iptables-alerter-script\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c519d6-a78e-4d7b-9834-cd1b40370815-tmp-dir\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313223    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-cni-bin\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313230    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-tuned\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313252    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-os-release\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313275    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313184    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-lib-modules\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.313380 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-node-log\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-env-overrides\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313398    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-kubelet\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-daemon-config\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg8bq\" (UniqueName: \"kubernetes.io/projected/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-kube-api-access-fg8bq\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57lmr\" (UniqueName: \"kubernetes.io/projected/79899833-0ee6-4e04-99c7-af8f6c83ec56-kube-api-access-57lmr\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313610    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313618    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-var-lib-kubelet\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjs2\" (UniqueName: \"kubernetes.io/projected/606d00f3-e55d-4979-bc2b-f44c8f106afb-kube-api-access-7hjs2\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45c81fd8-1c96-44ab-aa35-a80dab1f8204-kubelet-config\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313731    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe60dcc8-96b5-4a96-b372-b05910831a32-serviceca\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313759    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-sys\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313786    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-etc-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-registration-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313863    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-env-overrides\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313872    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-node-log\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ncq\" (UniqueName: \"kubernetes.io/projected/f9c519d6-a78e-4d7b-9834-cd1b40370815-kube-api-access-g9ncq\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.316237 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8lhc\" (UniqueName: \"kubernetes.io/projected/fe60dcc8-96b5-4a96-b372-b05910831a32-kube-api-access-w8lhc\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313918    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45c81fd8-1c96-44ab-aa35-a80dab1f8204-kubelet-config\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313942    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-sys\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.313991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314020    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-ovn\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314052    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-etc-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314089    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-etc-kubernetes\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314133    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-var-lib-kubelet\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-kubernetes\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-run-netns\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.314219    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358e0de60fbd33a58841a6c3c2eebdab.slice/crio-635f2d02d707ca2a03c637637bf929b11920fed18446f0374486d72d3849d97b WatchSource:0}: Error finding container 635f2d02d707ca2a03c637637bf929b11920fed18446f0374486d72d3849d97b: Status 404 returned error can't find the container with id 635f2d02d707ca2a03c637637bf929b11920fed18446f0374486d72d3849d97b
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314254    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314284    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-netns\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314224    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-ovn\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314350    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-kubernetes\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317070 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314359    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-run-netns\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314399    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-systemd\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314422    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314432    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5d5c\" (UniqueName: \"kubernetes.io/projected/2f7ff8fe-4a3a-410b-855b-5881d34000df-kube-api-access-x5d5c\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314482    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-systemd-units\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314494    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-systemd\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314507    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovnkube-script-lib\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.314548    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdeb9bd1fe2602d49fd99ae67800a425.slice/crio-56de198cff0e878b5a7cdca828696f7c373a940cb687c7f9ddf7b27ff6181c64 WatchSource:0}: Error finding container 56de198cff0e878b5a7cdca828696f7c373a940cb687c7f9ddf7b27ff6181c64: Status 404 returned error can't find the container with id 56de198cff0e878b5a7cdca828696f7c373a940cb687c7f9ddf7b27ff6181c64
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314565    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe60dcc8-96b5-4a96-b372-b05910831a32-host\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-systemd-units\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314598    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-socket-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314630    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysconfig\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysctl-d\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314733    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysconfig\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314765    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314788    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysctl-d\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.317893 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314921    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-cni-netd\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.314986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-cni-bin\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315011    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79899833-0ee6-4e04-99c7-af8f6c83ec56-host-slash\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315059    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-run\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315057    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-cni-netd\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315081    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f7ff8fe-4a3a-410b-855b-5881d34000df-tmp\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-os-release\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315125    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-kubelet\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315166    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-slash\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315180    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-run\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-log-socket\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315228    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-device-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315252    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysctl-conf\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315276    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315282    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-os-release\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.318742 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovnkube-config\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315339    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-slash\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315339    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45c81fd8-1c96-44ab-aa35-a80dab1f8204-dbus\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315370    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315374    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/047d827d-c983-4c5d-b1bf-51457743fa01-agent-certs\") pod \"konnectivity-agent-svcd9\" (UID: \"047d827d-c983-4c5d-b1bf-51457743fa01\") " pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315428    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5cr4\" (UniqueName: \"kubernetes.io/projected/482b3d59-262b-4377-8f20-ca47dfb790fa-kube-api-access-h5cr4\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315443    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45c81fd8-1c96-44ab-aa35-a80dab1f8204-dbus\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315456    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-cni-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-sysctl-conf\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315487    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-system-cni-dir\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315229    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-host-kubelet\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-var-lib-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315562    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315571    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/606d00f3-e55d-4979-bc2b-f44c8f106afb-system-cni-dir\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/047d827d-c983-4c5d-b1bf-51457743fa01-konnectivity-ca\") pod \"konnectivity-agent-svcd9\" (UID: \"047d827d-c983-4c5d-b1bf-51457743fa01\") " pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-conf-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315658    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-multus-certs\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.319679 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-systemd\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315734    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-system-cni-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315733    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovnkube-script-lib\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315789    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-var-lib-openvswitch\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-socket-dir-parent\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315830    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-hostroot\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.315865    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315895    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315905    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xklbd\" (UniqueName: \"kubernetes.io/projected/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-kube-api-access-xklbd\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.315933    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g687\" (UniqueName: \"kubernetes.io/projected/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-kube-api-access-2g687\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.315995    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret podName:45c81fd8-1c96-44ab-aa35-a80dab1f8204 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:32.815960614 +0000 UTC m=+2.004485787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret") pod "global-pull-secret-syncer-4c9q6" (UID: "45c81fd8-1c96-44ab-aa35-a80dab1f8204") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.316047    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovnkube-config\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.316120    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-log-socket\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.316134    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-run-systemd\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.316260    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/606d00f3-e55d-4979-bc2b-f44c8f106afb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.317094    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f7ff8fe-4a3a-410b-855b-5881d34000df-etc-tuned\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.320493 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.317347    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.321677 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.317997    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f7ff8fe-4a3a-410b-855b-5881d34000df-tmp\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.321677 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.320895    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:58:32.322660 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.322642    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjs2\" (UniqueName: \"kubernetes.io/projected/606d00f3-e55d-4979-bc2b-f44c8f106afb-kube-api-access-7hjs2\") pod \"multus-additional-cni-plugins-8zsks\" (UID: \"606d00f3-e55d-4979-bc2b-f44c8f106afb\") " pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.322844 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.322811    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5d5c\" (UniqueName: \"kubernetes.io/projected/2f7ff8fe-4a3a-410b-855b-5881d34000df-kube-api-access-x5d5c\") pod \"tuned-8g2sn\" (UID: \"2f7ff8fe-4a3a-410b-855b-5881d34000df\") " pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.324940 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.324920    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g687\" (UniqueName: \"kubernetes.io/projected/acc95c06-47ea-4b66-abc4-a0dbf6882b8a-kube-api-access-2g687\") pod \"ovnkube-node-82rhc\" (UID: \"acc95c06-47ea-4b66-abc4-a0dbf6882b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.350114 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.350078    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal" event={"ID":"358e0de60fbd33a58841a6c3c2eebdab","Type":"ContainerStarted","Data":"635f2d02d707ca2a03c637637bf929b11920fed18446f0374486d72d3849d97b"}
Jul 10 18:58:32.351106 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.351086    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal" event={"ID":"bdeb9bd1fe2602d49fd99ae67800a425","Type":"ContainerStarted","Data":"56de198cff0e878b5a7cdca828696f7c373a940cb687c7f9ddf7b27ff6181c64"}
Jul 10 18:58:32.416404 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416379    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-kubelet\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.416404 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-daemon-config\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.416536 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416420    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg8bq\" (UniqueName: \"kubernetes.io/projected/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-kube-api-access-fg8bq\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.416536 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416435    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57lmr\" (UniqueName: \"kubernetes.io/projected/79899833-0ee6-4e04-99c7-af8f6c83ec56-kube-api-access-57lmr\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.416536 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416451    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe60dcc8-96b5-4a96-b372-b05910831a32-serviceca\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.416536 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-kubelet\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416549    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-registration-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416577    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ncq\" (UniqueName: \"kubernetes.io/projected/f9c519d6-a78e-4d7b-9834-cd1b40370815-kube-api-access-g9ncq\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8lhc\" (UniqueName: \"kubernetes.io/projected/fe60dcc8-96b5-4a96-b372-b05910831a32-kube-api-access-w8lhc\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416630    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-etc-kubernetes\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416638    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-registration-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416682    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-netns\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.416717 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416689    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-etc-kubernetes\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416737    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe60dcc8-96b5-4a96-b372-b05910831a32-host\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-socket-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416769    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-netns\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416789    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-cni-bin\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416813    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79899833-0ee6-4e04-99c7-af8f6c83ec56-host-slash\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416854    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416837    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416895    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79899833-0ee6-4e04-99c7-af8f6c83ec56-host-slash\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416815    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe60dcc8-96b5-4a96-b372-b05910831a32-host\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416895    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-cni-bin\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416905    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-device-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416941    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/047d827d-c983-4c5d-b1bf-51457743fa01-agent-certs\") pod \"konnectivity-agent-svcd9\" (UID: \"047d827d-c983-4c5d-b1bf-51457743fa01\") " pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416941    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-socket-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416965    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cr4\" (UniqueName: \"kubernetes.io/projected/482b3d59-262b-4377-8f20-ca47dfb790fa-kube-api-access-h5cr4\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416957    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-daemon-config\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.416989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-cni-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417118 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417015    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417026    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/047d827d-c983-4c5d-b1bf-51457743fa01-konnectivity-ca\") pod \"konnectivity-agent-svcd9\" (UID: \"047d827d-c983-4c5d-b1bf-51457743fa01\") " pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417022    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-device-dir\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-conf-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417085    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-conf-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417080    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe60dcc8-96b5-4a96-b372-b05910831a32-serviceca\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-multus-certs\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417137    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-cni-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417166    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-multus-certs\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-system-cni-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-socket-dir-parent\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-hostroot\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417255    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xklbd\" (UniqueName: \"kubernetes.io/projected/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-kube-api-access-xklbd\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-system-cni-dir\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-k8s-cni-cncf-io\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-multus-socket-dir-parent\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417299    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-hostroot\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417316    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-run-k8s-cni-cncf-io\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.417953 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417320    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-sys-fs\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-cni-binary-copy\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417360    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/482b3d59-262b-4377-8f20-ca47dfb790fa-sys-fs\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-cni-multus\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9c519d6-a78e-4d7b-9834-cd1b40370815-hosts-file\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-cnibin\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79899833-0ee6-4e04-99c7-af8f6c83ec56-iptables-alerter-script\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417497    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9c519d6-a78e-4d7b-9834-cd1b40370815-hosts-file\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417501    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c519d6-a78e-4d7b-9834-cd1b40370815-tmp-dir\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417534    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-os-release\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-cnibin\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417578    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417600    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-host-var-lib-cni-multus\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417617    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/047d827d-c983-4c5d-b1bf-51457743fa01-konnectivity-ca\") pod \"konnectivity-agent-svcd9\" (UID: \"047d827d-c983-4c5d-b1bf-51457743fa01\") " pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417691    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-os-release\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.417750    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417760    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9c519d6-a78e-4d7b-9834-cd1b40370815-tmp-dir\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.417799    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:32.917783099 +0000 UTC m=+2.106308249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:32.418541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.417944    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-cni-binary-copy\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.419043 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.418089    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79899833-0ee6-4e04-99c7-af8f6c83ec56-iptables-alerter-script\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.419212 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.419196    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/047d827d-c983-4c5d-b1bf-51457743fa01-agent-certs\") pod \"konnectivity-agent-svcd9\" (UID: \"047d827d-c983-4c5d-b1bf-51457743fa01\") " pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.424832 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.424813    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57lmr\" (UniqueName: \"kubernetes.io/projected/79899833-0ee6-4e04-99c7-af8f6c83ec56-kube-api-access-57lmr\") pod \"iptables-alerter-wxfnp\" (UID: \"79899833-0ee6-4e04-99c7-af8f6c83ec56\") " pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.426380 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.426362    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:32.426472 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.426385    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:32.426472 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.426399    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z2wd9 for pod openshift-network-diagnostics/network-check-target-n2qtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:32.426587 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.426493    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9 podName:6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:32.92645854 +0000 UTC m=+2.114983694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z2wd9" (UniqueName: "kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9") pod "network-check-target-n2qtk" (UID: "6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:32.426851 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.426832    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5cr4\" (UniqueName: \"kubernetes.io/projected/482b3d59-262b-4377-8f20-ca47dfb790fa-kube-api-access-h5cr4\") pod \"aws-ebs-csi-driver-node-fmlj7\" (UID: \"482b3d59-262b-4377-8f20-ca47dfb790fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.427712 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.427691    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xklbd\" (UniqueName: \"kubernetes.io/projected/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-kube-api-access-xklbd\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:32.428703 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.428681    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg8bq\" (UniqueName: \"kubernetes.io/projected/c6bde8d6-e61f-4203-b4ea-051a2c6e3976-kube-api-access-fg8bq\") pod \"multus-4lj9x\" (UID: \"c6bde8d6-e61f-4203-b4ea-051a2c6e3976\") " pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.428769 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.428740    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8lhc\" (UniqueName: \"kubernetes.io/projected/fe60dcc8-96b5-4a96-b372-b05910831a32-kube-api-access-w8lhc\") pod \"node-ca-7nq82\" (UID: \"fe60dcc8-96b5-4a96-b372-b05910831a32\") " pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.429793 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.429777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ncq\" (UniqueName: \"kubernetes.io/projected/f9c519d6-a78e-4d7b-9834-cd1b40370815-kube-api-access-g9ncq\") pod \"node-resolver-p7ct2\" (UID: \"f9c519d6-a78e-4d7b-9834-cd1b40370815\") " pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.526694 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.526666    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8g2sn"
Jul 10 18:58:32.535172 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.535110    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7ff8fe_4a3a_410b_855b_5881d34000df.slice/crio-b07fe19c015e2bf13e8d37982538168daba971fa491f35ac817bdf0f76a6f5ff WatchSource:0}: Error finding container b07fe19c015e2bf13e8d37982538168daba971fa491f35ac817bdf0f76a6f5ff: Status 404 returned error can't find the container with id b07fe19c015e2bf13e8d37982538168daba971fa491f35ac817bdf0f76a6f5ff
Jul 10 18:58:32.544100 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.544081    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zsks"
Jul 10 18:58:32.550521 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.550501    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606d00f3_e55d_4979_bc2b_f44c8f106afb.slice/crio-7728d93cff4bb3ba30018c8e91708747b59bf4511880637ca76dc795bf87b8e6 WatchSource:0}: Error finding container 7728d93cff4bb3ba30018c8e91708747b59bf4511880637ca76dc795bf87b8e6: Status 404 returned error can't find the container with id 7728d93cff4bb3ba30018c8e91708747b59bf4511880637ca76dc795bf87b8e6
Jul 10 18:58:32.554513 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.554498    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:32.558644 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.558624    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7"
Jul 10 18:58:32.562687 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.562654    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc95c06_47ea_4b66_abc4_a0dbf6882b8a.slice/crio-fa19183051f39a82d8246a8991312085aa4c2c1e4d3faa9a300d6ad675cee345 WatchSource:0}: Error finding container fa19183051f39a82d8246a8991312085aa4c2c1e4d3faa9a300d6ad675cee345: Status 404 returned error can't find the container with id fa19183051f39a82d8246a8991312085aa4c2c1e4d3faa9a300d6ad675cee345
Jul 10 18:58:32.567770 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.567748    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482b3d59_262b_4377_8f20_ca47dfb790fa.slice/crio-bbab8482cd28289d72e731052a24582167d0a21e32069d64506c6e1c45ac2af0 WatchSource:0}: Error finding container bbab8482cd28289d72e731052a24582167d0a21e32069d64506c6e1c45ac2af0: Status 404 returned error can't find the container with id bbab8482cd28289d72e731052a24582167d0a21e32069d64506c6e1c45ac2af0
Jul 10 18:58:32.597929 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.597909    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nq82"
Jul 10 18:58:32.606394 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.606374    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe60dcc8_96b5_4a96_b372_b05910831a32.slice/crio-319b566033b3cb233f4833dcddc22a7ad7af729fb585b2b6cee13295e0243140 WatchSource:0}: Error finding container 319b566033b3cb233f4833dcddc22a7ad7af729fb585b2b6cee13295e0243140: Status 404 returned error can't find the container with id 319b566033b3cb233f4833dcddc22a7ad7af729fb585b2b6cee13295e0243140
Jul 10 18:58:32.631611 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.631589    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4lj9x"
Jul 10 18:58:32.637630 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.637616    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wxfnp"
Jul 10 18:58:32.638728 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.638703    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bde8d6_e61f_4203_b4ea_051a2c6e3976.slice/crio-dc7fee7eb5598cb123d56b7d1aa24bc347bfb3fc0cc7f15d12384e40c23d9492 WatchSource:0}: Error finding container dc7fee7eb5598cb123d56b7d1aa24bc347bfb3fc0cc7f15d12384e40c23d9492: Status 404 returned error can't find the container with id dc7fee7eb5598cb123d56b7d1aa24bc347bfb3fc0cc7f15d12384e40c23d9492
Jul 10 18:58:32.643457 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.643437    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p7ct2"
Jul 10 18:58:32.644120 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.644099    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79899833_0ee6_4e04_99c7_af8f6c83ec56.slice/crio-d2efcd025c6448143e30d4c196379b173e2c690e323e7809718e520122f81afb WatchSource:0}: Error finding container d2efcd025c6448143e30d4c196379b173e2c690e323e7809718e520122f81afb: Status 404 returned error can't find the container with id d2efcd025c6448143e30d4c196379b173e2c690e323e7809718e520122f81afb
Jul 10 18:58:32.650374 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.650359    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:32.653223 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.653199    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c519d6_a78e_4d7b_9834_cd1b40370815.slice/crio-902aeb53a4750d497cc0630f31c95e52c51baa0dbfc4b593f43a65268fa548cf WatchSource:0}: Error finding container 902aeb53a4750d497cc0630f31c95e52c51baa0dbfc4b593f43a65268fa548cf: Status 404 returned error can't find the container with id 902aeb53a4750d497cc0630f31c95e52c51baa0dbfc4b593f43a65268fa548cf
Jul 10 18:58:32.657541 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:58:32.657523    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047d827d_c983_4c5d_b1bf_51457743fa01.slice/crio-0766bed10296eba3c52030360967c7ef068d59d6961e86f71de8e1848ea4cf94 WatchSource:0}: Error finding container 0766bed10296eba3c52030360967c7ef068d59d6961e86f71de8e1848ea4cf94: Status 404 returned error can't find the container with id 0766bed10296eba3c52030360967c7ef068d59d6961e86f71de8e1848ea4cf94
Jul 10 18:58:32.678908 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.678889    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:32.820747 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.820653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:32.820890 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.820836    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:32.820948 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.820901    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret podName:45c81fd8-1c96-44ab-aa35-a80dab1f8204 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:33.820886041 +0000 UTC m=+3.009411194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret") pod "global-pull-secret-syncer-4c9q6" (UID: "45c81fd8-1c96-44ab-aa35-a80dab1f8204") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:32.921161 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:32.921108    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:32.921326 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.921308    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:32.921388 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:32.921378    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:33.921362672 +0000 UTC m=+3.109887821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:33.022805 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.022165    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:33.022805 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.022360    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:33.022805 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.022382    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:33.022805 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.022395    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z2wd9 for pod openshift-network-diagnostics/network-check-target-n2qtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:33.022805 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.022455    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9 podName:6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:34.022437695 +0000 UTC m=+3.210962858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2wd9" (UniqueName: "kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9") pod "network-check-target-n2qtk" (UID: "6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:33.258210 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.258007    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:53:32 +0000 UTC" deadline="2028-01-15 22:52:06.524149533 +0000 UTC"
Jul 10 18:58:33.258210 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.258095    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13299h53m33.266059123s"
Jul 10 18:58:33.350074 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.349585    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:33.350074 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.349720    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:33.379425 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.379253    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nq82" event={"ID":"fe60dcc8-96b5-4a96-b372-b05910831a32","Type":"ContainerStarted","Data":"319b566033b3cb233f4833dcddc22a7ad7af729fb585b2b6cee13295e0243140"}
Jul 10 18:58:33.391776 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.391625    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7" event={"ID":"482b3d59-262b-4377-8f20-ca47dfb790fa","Type":"ContainerStarted","Data":"bbab8482cd28289d72e731052a24582167d0a21e32069d64506c6e1c45ac2af0"}
Jul 10 18:58:33.420837 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.420684    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8g2sn" event={"ID":"2f7ff8fe-4a3a-410b-855b-5881d34000df","Type":"ContainerStarted","Data":"b07fe19c015e2bf13e8d37982538168daba971fa491f35ac817bdf0f76a6f5ff"}
Jul 10 18:58:33.442613 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.442449    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svcd9" event={"ID":"047d827d-c983-4c5d-b1bf-51457743fa01","Type":"ContainerStarted","Data":"0766bed10296eba3c52030360967c7ef068d59d6961e86f71de8e1848ea4cf94"}
Jul 10 18:58:33.457183 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.457130    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4lj9x" event={"ID":"c6bde8d6-e61f-4203-b4ea-051a2c6e3976","Type":"ContainerStarted","Data":"dc7fee7eb5598cb123d56b7d1aa24bc347bfb3fc0cc7f15d12384e40c23d9492"}
Jul 10 18:58:33.481492 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.481454    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"fa19183051f39a82d8246a8991312085aa4c2c1e4d3faa9a300d6ad675cee345"}
Jul 10 18:58:33.499739 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.499705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerStarted","Data":"7728d93cff4bb3ba30018c8e91708747b59bf4511880637ca76dc795bf87b8e6"}
Jul 10 18:58:33.521591 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.521512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p7ct2" event={"ID":"f9c519d6-a78e-4d7b-9834-cd1b40370815","Type":"ContainerStarted","Data":"902aeb53a4750d497cc0630f31c95e52c51baa0dbfc4b593f43a65268fa548cf"}
Jul 10 18:58:33.541033 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.540999    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wxfnp" event={"ID":"79899833-0ee6-4e04-99c7-af8f6c83ec56","Type":"ContainerStarted","Data":"d2efcd025c6448143e30d4c196379b173e2c690e323e7809718e520122f81afb"}
Jul 10 18:58:33.614988 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.614956    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:33.829816 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.829439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:33.829816 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.829611    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:33.829816 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.829677    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret podName:45c81fd8-1c96-44ab-aa35-a80dab1f8204 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:35.829658086 +0000 UTC m=+5.018183282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret") pod "global-pull-secret-syncer-4c9q6" (UID: "45c81fd8-1c96-44ab-aa35-a80dab1f8204") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:33.930541 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:33.930506    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:33.930718 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.930650    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:33.930718 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:33.930711    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:35.93069372 +0000 UTC m=+5.119218874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:34.032511 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:34.031735    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:34.032511 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:34.031951    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:34.032511 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:34.031974    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:34.032511 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:34.031986    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z2wd9 for pod openshift-network-diagnostics/network-check-target-n2qtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:34.032511 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:34.032082    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9 podName:6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:36.032062436 +0000 UTC m=+5.220587600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2wd9" (UniqueName: "kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9") pod "network-check-target-n2qtk" (UID: "6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:34.259203 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:34.259108    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:53:32 +0000 UTC" deadline="2028-03-12 09:43:03.53250739 +0000 UTC"
Jul 10 18:58:34.259203 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:34.259162    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14654h44m29.273351384s"
Jul 10 18:58:34.347532 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:34.347498    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:34.347727 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:34.347651    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:34.348056 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:34.348038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:34.348174 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:34.348131    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:34.621574 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:34.621472    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:34.887361 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:34.887055    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:35.347244 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:35.347165    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:35.347691 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:35.347287    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:35.847973 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:35.847932    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:35.848132 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:35.848118    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:35.848229 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:35.848204    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret podName:45c81fd8-1c96-44ab-aa35-a80dab1f8204 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:39.848184448 +0000 UTC m=+9.036709601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret") pod "global-pull-secret-syncer-4c9q6" (UID: "45c81fd8-1c96-44ab-aa35-a80dab1f8204") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:35.948401 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:35.948346    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:35.948569 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:35.948486    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:35.948569 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:35.948554    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:39.9485339 +0000 UTC m=+9.137059052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:36.049535 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:36.049472    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:36.049808 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:36.049700    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:36.049808 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:36.049724    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:36.049808 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:36.049736    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z2wd9 for pod openshift-network-diagnostics/network-check-target-n2qtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:36.049808 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:36.049796    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9 podName:6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:40.049779472 +0000 UTC m=+9.238304645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2wd9" (UniqueName: "kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9") pod "network-check-target-n2qtk" (UID: "6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:36.347538 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:36.347369    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:36.347538 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:36.347372    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:36.347538 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:36.347504    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:36.348086 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:36.347582    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:37.346872 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:37.346802    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:37.347109 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:37.347079    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:38.347142 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:38.347099    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:38.347736 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:38.347099    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:38.347736 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:38.347246    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:38.347736 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:38.347371    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:39.350961 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:39.350917    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:39.351420 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:39.351052    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:39.883228 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:39.883185    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:39.885444 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:39.883853    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:39.885444 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:39.883947    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret podName:45c81fd8-1c96-44ab-aa35-a80dab1f8204 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:47.883925722 +0000 UTC m=+17.072450888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret") pod "global-pull-secret-syncer-4c9q6" (UID: "45c81fd8-1c96-44ab-aa35-a80dab1f8204") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:39.984607 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:39.984569    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:39.984796 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:39.984772    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:39.984870 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:39.984859    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:47.984836051 +0000 UTC m=+17.173361212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:40.085466 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:40.085129    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:40.085466 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:40.085365    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:40.085466 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:40.085387    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:40.085466 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:40.085399    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z2wd9 for pod openshift-network-diagnostics/network-check-target-n2qtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:40.085466 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:40.085462    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9 podName:6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:48.08544468 +0000 UTC m=+17.273969842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2wd9" (UniqueName: "kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9") pod "network-check-target-n2qtk" (UID: "6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:40.347463 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:40.347088    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:40.347463 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:40.347218    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:40.347463 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:40.347299    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:40.347463 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:40.347380    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:41.349005 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:41.348576    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:41.349005 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:41.348694    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:42.347125 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:42.347087    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:42.347316 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:42.347243    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:42.347316 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:42.347257    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:42.347448 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:42.347385    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:43.350095 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:43.349906    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:43.350543 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:43.350194    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:44.347468 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:44.347424    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:44.347671 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:44.347421    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:44.347671 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:44.347577    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:44.347671 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:44.347648    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:45.349832 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:45.349803    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:45.350280 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:45.349928    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:46.347220 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:46.347187    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:46.347374 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:46.347320    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:46.347448 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:46.347384    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:46.347544 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:46.347509    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:47.349703 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:47.349675    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:47.350116 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:47.349794    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:47.944770 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:47.944735    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:47.944982 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:47.944856    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:47.944982 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:47.944935    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret podName:45c81fd8-1c96-44ab-aa35-a80dab1f8204 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:03.944914406 +0000 UTC m=+33.133439610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret") pod "global-pull-secret-syncer-4c9q6" (UID: "45c81fd8-1c96-44ab-aa35-a80dab1f8204") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:48.045892 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:48.045859    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:48.046039 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.045992    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:48.046087 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.046068    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:04.046050511 +0000 UTC m=+33.234575663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:48.147271 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:48.147228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:48.147435 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.147359    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:48.147435 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.147382    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:48.147435 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.147393    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z2wd9 for pod openshift-network-diagnostics/network-check-target-n2qtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:48.147570 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.147444    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9 podName:6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:04.147428201 +0000 UTC m=+33.335953351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2wd9" (UniqueName: "kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9") pod "network-check-target-n2qtk" (UID: "6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:48.347733 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:48.347652    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:48.347733 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:48.347695    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:48.347935 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.347808    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:48.347935 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:48.347916    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:49.349448 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:49.349418    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:49.349920 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:49.349526    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:50.347680 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:50.347643    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:50.347868 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:50.347793    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:50.347868 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:50.347839    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:50.347985 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:50.347951    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:51.347552 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:51.347519    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:51.347988 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:51.347625    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:52.347133 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.347106    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:52.347283 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.347115    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:52.347283 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:52.347253    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:52.347433 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:52.347404    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:52.605952 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.605906    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8g2sn" event={"ID":"2f7ff8fe-4a3a-410b-855b-5881d34000df","Type":"ContainerStarted","Data":"220ac6a8f877f56b7370366edd0d926b36a2beaf659102467d813e19fad38461"}
Jul 10 18:58:52.609763 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.609714    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4lj9x" event={"ID":"c6bde8d6-e61f-4203-b4ea-051a2c6e3976","Type":"ContainerStarted","Data":"d1a26550f2b5d390ea61018d6b9afe66919312daba26bc477aeda85ef79efde2"}
Jul 10 18:58:52.619954 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.619093    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 18:58:52.620644 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.620298    2556 generic.go:356] "Generic (PLEG): container finished" podID="acc95c06-47ea-4b66-abc4-a0dbf6882b8a" containerID="473fda9f063dce19550422a810aff79be3e167a048aa6af6f309b3b74572c2dd" exitCode=1
Jul 10 18:58:52.620644 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.620392    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"81465aa2c496dd9ff770c2ec9abff18fba54192bec8f01ba3684602b3b77f82d"}
Jul 10 18:58:52.620644 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.620473    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerDied","Data":"473fda9f063dce19550422a810aff79be3e167a048aa6af6f309b3b74572c2dd"}
Jul 10 18:58:52.620644 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.620525    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"fcbb7f75f353d5a28d704cd22a2af2d7cd5d2ab3cfb6315bf2d18a1812baffcb"}
Jul 10 18:58:52.627516 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.627208    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal" event={"ID":"358e0de60fbd33a58841a6c3c2eebdab","Type":"ContainerStarted","Data":"ac4241ab4c618f4eff26727bc91cf22fc7b9f5616a7049447640d9a27e6f996b"}
Jul 10 18:58:52.635369 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.635327    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8g2sn" podStartSLOduration=2.169188042 podStartE2EDuration="21.635313712s" totalImagesPullingTime="19.46612567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:52.63397852 +0000 UTC m=+21.822503702" watchObservedRunningTime="2026-07-10 18:58:52.635313712 +0000 UTC m=+21.823838883"
Jul 10 18:58:52.657241 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.657202    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4lj9x" podStartSLOduration=2.236709158 podStartE2EDuration="21.657186637s" totalImagesPullingTime="19.420477479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:52.656858956 +0000 UTC m=+21.845384129" watchObservedRunningTime="2026-07-10 18:58:52.657186637 +0000 UTC m=+21.845711808"
Jul 10 18:58:52.677699 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:52.677651    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-108.ec2.internal" podStartSLOduration=20.677633998 podStartE2EDuration="20.677633998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:52.677121031 +0000 UTC m=+21.865646204" watchObservedRunningTime="2026-07-10 18:58:52.677633998 +0000 UTC m=+21.866159171"
Jul 10 18:58:53.347408 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.346992    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:53.347564 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:53.347470    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:53.633341 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.633242    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 18:58:53.634129 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.633662    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"b3eb3b8e13befd46df7c7084c793b7b05629b675c8107d98ed1ed72e62a0564b"}
Jul 10 18:58:53.634129 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.633736    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"521836d40abda8f2ce7173e1aedb80b36d9688f128794c26b726b5afbb54ea14"}
Jul 10 18:58:53.634129 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.633784    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"0cefe92ebe10f259ded04a07a59e067d1adb947a92cf23badc4c3a20f5888ec5"}
Jul 10 18:58:53.635421 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.635393    2556 generic.go:356] "Generic (PLEG): container finished" podID="606d00f3-e55d-4979-bc2b-f44c8f106afb" containerID="b67aaee15859e822c450c1b7de559b71bca7fd961adb8c76feeee50948241f30" exitCode=0
Jul 10 18:58:53.635552 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.635426    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerDied","Data":"b67aaee15859e822c450c1b7de559b71bca7fd961adb8c76feeee50948241f30"}
Jul 10 18:58:53.637130 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.637105    2556 generic.go:356] "Generic (PLEG): container finished" podID="bdeb9bd1fe2602d49fd99ae67800a425" containerID="d0f20c996bbbd5b13509849504246f1aa61b8fbc5d959aafd2ff1e14d2274e7a" exitCode=0
Jul 10 18:58:53.637247 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.637206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal" event={"ID":"bdeb9bd1fe2602d49fd99ae67800a425","Type":"ContainerDied","Data":"d0f20c996bbbd5b13509849504246f1aa61b8fbc5d959aafd2ff1e14d2274e7a"}
Jul 10 18:58:53.638948 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.638924    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p7ct2" event={"ID":"f9c519d6-a78e-4d7b-9834-cd1b40370815","Type":"ContainerStarted","Data":"d61cce12718488876be9748a16fbb2e38889ef2c286b8effc81c808ab3c939f7"}
Jul 10 18:58:53.640466 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.640446    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wxfnp" event={"ID":"79899833-0ee6-4e04-99c7-af8f6c83ec56","Type":"ContainerStarted","Data":"42810da4ac4dd6c179891fe8e64e5c7c33027e11b3da3f1defcbf54a9dd9ce7b"}
Jul 10 18:58:53.641929 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.641901    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nq82" event={"ID":"fe60dcc8-96b5-4a96-b372-b05910831a32","Type":"ContainerStarted","Data":"4f25e263c473f23d44458615815cb1c0d3c6937fa76fdd7fe79c05d7c8769f79"}
Jul 10 18:58:53.643678 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.643650    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7" event={"ID":"482b3d59-262b-4377-8f20-ca47dfb790fa","Type":"ContainerStarted","Data":"308289e74cebda80dceccd041e9f6efcb5727e6a1b31dffd5e06a36ffa2cdd4f"}
Jul 10 18:58:53.644998 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.644976    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svcd9" event={"ID":"047d827d-c983-4c5d-b1bf-51457743fa01","Type":"ContainerStarted","Data":"acb1d191747d9dd0e072d9a7a46e92500fd48a7766cbc9957c357130a47c2f2c"}
Jul 10 18:58:53.709706 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.709654    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7nq82" podStartSLOduration=3.313879664 podStartE2EDuration="22.709638715s" totalImagesPullingTime="19.395759051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:53.709077366 +0000 UTC m=+22.897602540" watchObservedRunningTime="2026-07-10 18:58:53.709638715 +0000 UTC m=+22.898163886"
Jul 10 18:58:53.727830 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.727786    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wxfnp" podStartSLOduration=3.343002568 podStartE2EDuration="22.727772459s" totalImagesPullingTime="19.384769891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:53.726913106 +0000 UTC m=+22.915438278" watchObservedRunningTime="2026-07-10 18:58:53.727772459 +0000 UTC m=+22.916297630"
Jul 10 18:58:53.745437 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.745397    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p7ct2" podStartSLOduration=3.35695447 podStartE2EDuration="22.745388655s" totalImagesPullingTime="19.388434185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:53.745337727 +0000 UTC m=+22.933862899" watchObservedRunningTime="2026-07-10 18:58:53.745388655 +0000 UTC m=+22.933913827"
Jul 10 18:58:53.763965 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:53.763929    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-svcd9" podStartSLOduration=3.419417307 podStartE2EDuration="22.763916565s" totalImagesPullingTime="19.344499258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:53.763669613 +0000 UTC m=+22.952194786" watchObservedRunningTime="2026-07-10 18:58:53.763916565 +0000 UTC m=+22.952441768"
Jul 10 18:58:54.159305 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.159282    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 18:58:54.331129 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.330974    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:58:54.159301985Z","UUID":"249bf797-eb6c-49df-b19a-f422c104585e","Handler":null,"Name":"","Endpoint":""}
Jul 10 18:58:54.332627 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.332607    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 18:58:54.332738 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.332642    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 18:58:54.347342 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.347301    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:54.347529 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.347302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:54.347529 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:54.347419    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:54.347644 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:54.347527    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:54.649979 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.649894    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal" event={"ID":"bdeb9bd1fe2602d49fd99ae67800a425","Type":"ContainerStarted","Data":"2637e2e135487145d10fa6904a008c1392f382cc31ca37f1f4bfad1309c688d3"}
Jul 10 18:58:54.651909 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.651878    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7" event={"ID":"482b3d59-262b-4377-8f20-ca47dfb790fa","Type":"ContainerStarted","Data":"cc96b3227f38ee2e5fecb108c0f8d577e2be55a8bf9520c83dfda9173ea5d0d2"}
Jul 10 18:58:54.669324 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:54.669275    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-108.ec2.internal" podStartSLOduration=22.669256652 podStartE2EDuration="22.669256652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:54.668924622 +0000 UTC m=+23.857449795" watchObservedRunningTime="2026-07-10 18:58:54.669256652 +0000 UTC m=+23.857781826"
Jul 10 18:58:55.346763 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:55.346726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:55.346908 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:55.346867    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:55.658122 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:55.657860    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 18:58:55.658885 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:55.658644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"2567ee9bdbf7444d0afcdab0736e3fb9a6845e883468c86d52dba672210205b9"}
Jul 10 18:58:55.661526 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:55.661499    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7" event={"ID":"482b3d59-262b-4377-8f20-ca47dfb790fa","Type":"ContainerStarted","Data":"586847d7a3604c0a18719177277034b9f6be8b78876d019101ceaa4d1548280b"}
Jul 10 18:58:56.346848 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:56.346816    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:56.346848 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:56.346850    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:56.347140 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:56.346947    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:56.347140 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:56.347088    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:56.692291 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:56.692196    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fmlj7" podStartSLOduration=3.637028585 podStartE2EDuration="25.692174669s" totalImagesPullingTime="22.055146084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:56.6921309 +0000 UTC m=+25.880656071" watchObservedRunningTime="2026-07-10 18:58:56.692174669 +0000 UTC m=+25.880699821"
Jul 10 18:58:56.860835 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:56.860796    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:56.861464 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:56.861444    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:57.347134 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:57.347105    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:57.347328 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:57.347281    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:57.666614 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:57.666508    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:57.667017 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:57.667001    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-svcd9"
Jul 10 18:58:58.347241 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.346979    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:58:58.347241 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.347015    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:58:58.347850 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:58.347240    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:58:58.347850 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:58.347322    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:58:58.670937 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.670866    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 18:58:58.671238 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.671216    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"c0363e566948cc9e62b4e76308ce3b5cae2d1ea4dd50f0902dd91967d3ba9eba"}
Jul 10 18:58:58.671538 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.671518    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:58.671663 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.671648    2556 scope.go:117] "RemoveContainer" containerID="473fda9f063dce19550422a810aff79be3e167a048aa6af6f309b3b74572c2dd"
Jul 10 18:58:58.673294 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.673269    2556 generic.go:356] "Generic (PLEG): container finished" podID="606d00f3-e55d-4979-bc2b-f44c8f106afb" containerID="7ea399de7f4b34795a79620b94470c58bb80ffe334c37d475ca16bf598dd5f73" exitCode=0
Jul 10 18:58:58.673402 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.673366    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerDied","Data":"7ea399de7f4b34795a79620b94470c58bb80ffe334c37d475ca16bf598dd5f73"}
Jul 10 18:58:58.687430 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:58.687410    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:59.346830 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:59.346799    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:58:59.347054 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:58:59.346938    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:58:59.678475 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:59.678407    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 18:58:59.678950 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:59.678735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" event={"ID":"acc95c06-47ea-4b66-abc4-a0dbf6882b8a","Type":"ContainerStarted","Data":"f050adbd2a28aafd371b93b3f2a6f831230e0324b2c5d1e1e6e6ac1b3722be69"}
Jul 10 18:58:59.678950 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:59.678917    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:59.679054 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:59.678954    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:59.694480 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:59.694449    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:58:59.708940 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:58:59.708899    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc" podStartSLOduration=9.00643986 podStartE2EDuration="28.708885769s" totalImagesPullingTime="19.702445909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:59.707373887 +0000 UTC m=+28.895899060" watchObservedRunningTime="2026-07-10 18:58:59.708885769 +0000 UTC m=+28.897410940"
Jul 10 18:59:00.346809 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.346659    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:00.346937 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.346705    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:59:00.346978 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:00.346876    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:59:00.347020 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:00.346978    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:59:00.460796 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.460767    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2qtk"]
Jul 10 18:59:00.463210 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.463185    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rpd9k"]
Jul 10 18:59:00.477996 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.477976    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4c9q6"]
Jul 10 18:59:00.478098 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.478051    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:00.478187 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:00.478130    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:59:00.682413 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.682332    2556 generic.go:356] "Generic (PLEG): container finished" podID="606d00f3-e55d-4979-bc2b-f44c8f106afb" containerID="58f3e330001a1c2a506cbaa66cddb1099993746cb9d71871b45a8cc6067a0689" exitCode=0
Jul 10 18:59:00.682413 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.682397    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:00.682877 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.682426    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerDied","Data":"58f3e330001a1c2a506cbaa66cddb1099993746cb9d71871b45a8cc6067a0689"}
Jul 10 18:59:00.682877 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:00.682481    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:59:00.682877 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:00.682598    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:59:00.682877 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:00.682747    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:59:02.346925 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:02.346891    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:02.347675 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:02.346994    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:59:02.347675 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:02.347006    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:59:02.347675 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:02.347023    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:02.347675 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:02.347093    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:59:02.347675 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:02.347185    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:59:02.689356 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:02.689323    2556 generic.go:356] "Generic (PLEG): container finished" podID="606d00f3-e55d-4979-bc2b-f44c8f106afb" containerID="7eabcadf628942ddef348095f4cf5307445aadd1fc76083c3ab5bdc98578ce18" exitCode=0
Jul 10 18:59:02.689495 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:02.689365    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerDied","Data":"7eabcadf628942ddef348095f4cf5307445aadd1fc76083c3ab5bdc98578ce18"}
Jul 10 18:59:03.975027 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:03.974988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:03.975499 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:03.975142    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:59:03.975499 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:03.975237    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret podName:45c81fd8-1c96-44ab-aa35-a80dab1f8204 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:35.975214764 +0000 UTC m=+65.163739934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret") pod "global-pull-secret-syncer-4c9q6" (UID: "45c81fd8-1c96-44ab-aa35-a80dab1f8204") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:59:04.075685 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:04.075652    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:59:04.075857 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.075829    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:59:04.075924 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.075912    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:36.075890506 +0000 UTC m=+65.264415656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:59:04.176005 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:04.175975    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:04.176196 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.176139    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:59:04.176196 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.176172    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:59:04.176196 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.176185    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z2wd9 for pod openshift-network-diagnostics/network-check-target-n2qtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:59:04.176322 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.176249    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9 podName:6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:36.17623101 +0000 UTC m=+65.364756168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2wd9" (UniqueName: "kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9") pod "network-check-target-n2qtk" (UID: "6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:59:04.347298 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:04.347266    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:04.347298 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:04.347285    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:04.347524 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:04.347276    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:59:04.347524 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.347384    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2qtk" podUID="6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7"
Jul 10 18:59:04.347524 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.347502    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpd9k" podUID="44400a71-5f0b-4b41-bf90-96e9b1dc91b9"
Jul 10 18:59:04.347683 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:04.347591    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4c9q6" podUID="45c81fd8-1c96-44ab-aa35-a80dab1f8204"
Jul 10 18:59:06.049077 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.049048    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-108.ec2.internal" event="NodeReady"
Jul 10 18:59:06.049480 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.049207    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 18:59:06.095291 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.095258    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-58nj5"]
Jul 10 18:59:06.123571 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.123546    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rnmln"]
Jul 10 18:59:06.123733 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.123669    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.126016 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.125985    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6z54\""
Jul 10 18:59:06.126016 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.126015    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 18:59:06.126337 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.126125    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 18:59:06.135592 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.135571    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-58nj5"]
Jul 10 18:59:06.135685 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.135626    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rnmln"]
Jul 10 18:59:06.135735 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.135708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.138337 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.138311    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 18:59:06.138436 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.138394    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 18:59:06.138502 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.138435    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 18:59:06.138706 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.138692    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5z57c\""
Jul 10 18:59:06.291017 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.290981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d7dfd2e-b2d1-4b38-994c-87b058662e65-cert\") pod \"ingress-canary-rnmln\" (UID: \"8d7dfd2e-b2d1-4b38-994c-87b058662e65\") " pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.291219 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.291048    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2lps\" (UniqueName: \"kubernetes.io/projected/8d7dfd2e-b2d1-4b38-994c-87b058662e65-kube-api-access-p2lps\") pod \"ingress-canary-rnmln\" (UID: \"8d7dfd2e-b2d1-4b38-994c-87b058662e65\") " pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.291219 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.291183    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.291316 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.291225    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1108ee5d-2e79-40e4-97fb-01d41bb43583-config-volume\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.291316 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.291248    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1108ee5d-2e79-40e4-97fb-01d41bb43583-tmp-dir\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.291316 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.291285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkr8p\" (UniqueName: \"kubernetes.io/projected/1108ee5d-2e79-40e4-97fb-01d41bb43583-kube-api-access-qkr8p\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.347004 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.346976    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:59:06.347004 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.346991    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:06.347245 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.346997    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:06.349708 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.349675    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:59:06.349956 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.349898    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:59:06.349956 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.349938    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:59:06.350115 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.349992    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mzc76\""
Jul 10 18:59:06.350115 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.350006    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwgdk\""
Jul 10 18:59:06.350115 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.350039    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:59:06.392584 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.392557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.392685 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.392591    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1108ee5d-2e79-40e4-97fb-01d41bb43583-config-volume\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.392685 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.392611    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1108ee5d-2e79-40e4-97fb-01d41bb43583-tmp-dir\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.392685 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.392640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkr8p\" (UniqueName: \"kubernetes.io/projected/1108ee5d-2e79-40e4-97fb-01d41bb43583-kube-api-access-qkr8p\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.392811 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.392692    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d7dfd2e-b2d1-4b38-994c-87b058662e65-cert\") pod \"ingress-canary-rnmln\" (UID: \"8d7dfd2e-b2d1-4b38-994c-87b058662e65\") " pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.392811 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.392740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2lps\" (UniqueName: \"kubernetes.io/projected/8d7dfd2e-b2d1-4b38-994c-87b058662e65-kube-api-access-p2lps\") pod \"ingress-canary-rnmln\" (UID: \"8d7dfd2e-b2d1-4b38-994c-87b058662e65\") " pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.392811 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:06.392751    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:06.392941 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:06.392829    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls podName:1108ee5d-2e79-40e4-97fb-01d41bb43583 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:06.892806476 +0000 UTC m=+36.081331642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls") pod "dns-default-58nj5" (UID: "1108ee5d-2e79-40e4-97fb-01d41bb43583") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:06.393095 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.393079    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1108ee5d-2e79-40e4-97fb-01d41bb43583-tmp-dir\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.393361 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.393330    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1108ee5d-2e79-40e4-97fb-01d41bb43583-config-volume\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.397563 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.397545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d7dfd2e-b2d1-4b38-994c-87b058662e65-cert\") pod \"ingress-canary-rnmln\" (UID: \"8d7dfd2e-b2d1-4b38-994c-87b058662e65\") " pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.402554 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.402528    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkr8p\" (UniqueName: \"kubernetes.io/projected/1108ee5d-2e79-40e4-97fb-01d41bb43583-kube-api-access-qkr8p\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.402822 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.402806    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2lps\" (UniqueName: \"kubernetes.io/projected/8d7dfd2e-b2d1-4b38-994c-87b058662e65-kube-api-access-p2lps\") pod \"ingress-canary-rnmln\" (UID: \"8d7dfd2e-b2d1-4b38-994c-87b058662e65\") " pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.445835 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.445802    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rnmln"
Jul 10 18:59:06.897091 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.897059    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:06.897256 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:06.897234    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:06.897320 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:06.897310    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls podName:1108ee5d-2e79-40e4-97fb-01d41bb43583 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:07.897294886 +0000 UTC m=+37.085820037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls") pod "dns-default-58nj5" (UID: "1108ee5d-2e79-40e4-97fb-01d41bb43583") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:06.917702 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:06.917676    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rnmln"]
Jul 10 18:59:06.931070 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:59:06.931038    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7dfd2e_b2d1_4b38_994c_87b058662e65.slice/crio-a7a9f7eeab010c24ab3db6fb344c40f34373a0819c3e0cd521957feeba589de8 WatchSource:0}: Error finding container a7a9f7eeab010c24ab3db6fb344c40f34373a0819c3e0cd521957feeba589de8: Status 404 returned error can't find the container with id a7a9f7eeab010c24ab3db6fb344c40f34373a0819c3e0cd521957feeba589de8
Jul 10 18:59:07.702304 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:07.702266    2556 generic.go:356] "Generic (PLEG): container finished" podID="606d00f3-e55d-4979-bc2b-f44c8f106afb" containerID="53175129f6798d9f216317b8b61f5f38e0e9709d9aa1c1a55e429e9826e5e2e1" exitCode=0
Jul 10 18:59:07.702735 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:07.702342    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerDied","Data":"53175129f6798d9f216317b8b61f5f38e0e9709d9aa1c1a55e429e9826e5e2e1"}
Jul 10 18:59:07.703498 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:07.703470    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rnmln" event={"ID":"8d7dfd2e-b2d1-4b38-994c-87b058662e65","Type":"ContainerStarted","Data":"a7a9f7eeab010c24ab3db6fb344c40f34373a0819c3e0cd521957feeba589de8"}
Jul 10 18:59:07.902404 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:07.902358    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:07.902560 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:07.902521    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:07.902636 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:07.902579    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls podName:1108ee5d-2e79-40e4-97fb-01d41bb43583 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:09.902561646 +0000 UTC m=+39.091086797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls") pod "dns-default-58nj5" (UID: "1108ee5d-2e79-40e4-97fb-01d41bb43583") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:08.710251 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:08.710013    2556 generic.go:356] "Generic (PLEG): container finished" podID="606d00f3-e55d-4979-bc2b-f44c8f106afb" containerID="23971b7c2c218e361dd7076b3bbce1fd1edb220d650593cc44b8ece3e07de528" exitCode=0
Jul 10 18:59:08.710251 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:08.710083    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerDied","Data":"23971b7c2c218e361dd7076b3bbce1fd1edb220d650593cc44b8ece3e07de528"}
Jul 10 18:59:09.715199 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:09.715170    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zsks" event={"ID":"606d00f3-e55d-4979-bc2b-f44c8f106afb","Type":"ContainerStarted","Data":"7f09dc0ee57759732f4ba4e772dd430fda720ed78da278168609e619164b11c3"}
Jul 10 18:59:09.744558 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:09.744506    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8zsks" podStartSLOduration=8.204604026 podStartE2EDuration="38.744490409s" totalImagesPullingTime="30.539886383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:09.743493994 +0000 UTC m=+38.932019165" watchObservedRunningTime="2026-07-10 18:59:09.744490409 +0000 UTC m=+38.933015581"
Jul 10 18:59:09.920428 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:09.920389    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:09.920577 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:09.920537    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:09.920659 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:09.920594    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls podName:1108ee5d-2e79-40e4-97fb-01d41bb43583 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:13.920579679 +0000 UTC m=+43.109104832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls") pod "dns-default-58nj5" (UID: "1108ee5d-2e79-40e4-97fb-01d41bb43583") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:10.719137 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:10.719099    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rnmln" event={"ID":"8d7dfd2e-b2d1-4b38-994c-87b058662e65","Type":"ContainerStarted","Data":"8de7d7ce4eb4cd35e4bed98aaea0ebeb9bbfa264153c97e8e0410bf7648d4218"}
Jul 10 18:59:10.737399 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:10.737360    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rnmln" podStartSLOduration=2.000598403 podStartE2EDuration="4.737344305s" totalImagesPullingTime="2.736745902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:10.736288632 +0000 UTC m=+39.924813804" watchObservedRunningTime="2026-07-10 18:59:10.737344305 +0000 UTC m=+39.925869477"
Jul 10 18:59:13.946951 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:13.946911    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:13.947342 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:13.947061    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:13.947342 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:13.947139    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls podName:1108ee5d-2e79-40e4-97fb-01d41bb43583 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:21.947120216 +0000 UTC m=+51.135645386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls") pod "dns-default-58nj5" (UID: "1108ee5d-2e79-40e4-97fb-01d41bb43583") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:21.997561 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:21.997528    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:21.997995 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:21.997637    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:21.997995 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:21.997689    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls podName:1108ee5d-2e79-40e4-97fb-01d41bb43583 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:37.997674813 +0000 UTC m=+67.186199964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls") pod "dns-default-58nj5" (UID: "1108ee5d-2e79-40e4-97fb-01d41bb43583") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:31.695112 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:31.695087    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82rhc"
Jul 10 18:59:35.990274 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:35.990233    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:35.993330 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:35.993310    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:59:36.003809 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.003780    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45c81fd8-1c96-44ab-aa35-a80dab1f8204-original-pull-secret\") pod \"global-pull-secret-syncer-4c9q6\" (UID: \"45c81fd8-1c96-44ab-aa35-a80dab1f8204\") " pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:36.064992 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.064964    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4c9q6"
Jul 10 18:59:36.091289 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.091265    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 18:59:36.094165 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.094132    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:59:36.101489 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:36.101471    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 18:59:36.101542 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:36.101535    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs podName:44400a71-5f0b-4b41-bf90-96e9b1dc91b9 nodeName:}" failed. No retries permitted until 2026-07-10 19:00:40.101514482 +0000 UTC m=+129.290039633 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs") pod "network-metrics-daemon-rpd9k" (UID: "44400a71-5f0b-4b41-bf90-96e9b1dc91b9") : secret "metrics-daemon-secret" not found
Jul 10 18:59:36.188938 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.188899    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4c9q6"]
Jul 10 18:59:36.192349 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.192327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:36.193221 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:59:36.193192    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c81fd8_1c96_44ab_aa35_a80dab1f8204.slice/crio-506a3e2a47da82de42f190dc43e7f8bf3ca807ddf550828d320d6ee0ced641ae WatchSource:0}: Error finding container 506a3e2a47da82de42f190dc43e7f8bf3ca807ddf550828d320d6ee0ced641ae: Status 404 returned error can't find the container with id 506a3e2a47da82de42f190dc43e7f8bf3ca807ddf550828d320d6ee0ced641ae
Jul 10 18:59:36.195072 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.195049    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:59:36.205674 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.205650    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:59:36.216067 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.216047    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2wd9\" (UniqueName: \"kubernetes.io/projected/6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7-kube-api-access-z2wd9\") pod \"network-check-target-n2qtk\" (UID: \"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7\") " pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:36.373321 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.373249    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwgdk\""
Jul 10 18:59:36.380739 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.380718    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:36.502134 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.502103    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2qtk"]
Jul 10 18:59:36.505937 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:59:36.505912    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbbdcfd_7a5e_458d_844a_a0ab1d031fd7.slice/crio-7be42213674b080c24265deefd4aff56e25be1bfd5c5904e9bf101ef1464c9f5 WatchSource:0}: Error finding container 7be42213674b080c24265deefd4aff56e25be1bfd5c5904e9bf101ef1464c9f5: Status 404 returned error can't find the container with id 7be42213674b080c24265deefd4aff56e25be1bfd5c5904e9bf101ef1464c9f5
Jul 10 18:59:36.779076 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.779036    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2qtk" event={"ID":"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7","Type":"ContainerStarted","Data":"7be42213674b080c24265deefd4aff56e25be1bfd5c5904e9bf101ef1464c9f5"}
Jul 10 18:59:36.780250 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:36.780215    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4c9q6" event={"ID":"45c81fd8-1c96-44ab-aa35-a80dab1f8204","Type":"ContainerStarted","Data":"506a3e2a47da82de42f190dc43e7f8bf3ca807ddf550828d320d6ee0ced641ae"}
Jul 10 18:59:38.007686 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.007634    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 18:59:38.008181 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.007829    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:38.008181 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.007920    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls podName:1108ee5d-2e79-40e4-97fb-01d41bb43583 nodeName:}" failed. No retries permitted until 2026-07-10 19:00:10.007892823 +0000 UTC m=+99.196417997 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls") pod "dns-default-58nj5" (UID: "1108ee5d-2e79-40e4-97fb-01d41bb43583") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:38.287866 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.287777    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"]
Jul 10 18:59:38.289894 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.289864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.295353 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.295328    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 10 18:59:38.295502 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.295339    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 18:59:38.295502 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.295413    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 18:59:38.296499 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.296436    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vd8vg\""
Jul 10 18:59:38.301226 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.301036    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 10 18:59:38.311798 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.311776    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"]
Jul 10 18:59:38.376313 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.376280    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"]
Jul 10 18:59:38.379633 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.379609    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-xpb8v"]
Jul 10 18:59:38.379819 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.379742    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"
Jul 10 18:59:38.381996 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.381852    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.383287 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.383265    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z8kdt\""
Jul 10 18:59:38.384410 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.384388    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:59:38.385450 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.385134    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 10 18:59:38.385450 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.385326    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 10 18:59:38.385787 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.385766    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 10 18:59:38.386126 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.386110    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mvtjq\""
Jul 10 18:59:38.392784 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.392762    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 10 18:59:38.398546 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.398525    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xpb8v"]
Jul 10 18:59:38.409114 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.409075    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"]
Jul 10 18:59:38.410931 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.410908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e04c462f-1228-4a9c-8edc-c35416fe21ac-trusted-ca\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.411037 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.410956    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqkh\" (UniqueName: \"kubernetes.io/projected/88a7162c-a592-4c37-9931-ec618930e900-kube-api-access-dnqkh\") pod \"network-check-source-869dcfcdcd-kpxf9\" (UID: \"88a7162c-a592-4c37-9931-ec618930e900\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"
Jul 10 18:59:38.411097 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.411072    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt47h\" (UniqueName: \"kubernetes.io/projected/e04c462f-1228-4a9c-8edc-c35416fe21ac-kube-api-access-qt47h\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.411205 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.411188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ljc\" (UniqueName: \"kubernetes.io/projected/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-kube-api-access-k8ljc\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.411316 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.411261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e04c462f-1228-4a9c-8edc-c35416fe21ac-config\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.411316 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.411298    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e04c462f-1228-4a9c-8edc-c35416fe21ac-serving-cert\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.411433 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.411375    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.411483 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.411448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.468683 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.468595    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"]
Jul 10 18:59:38.470963 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.470938    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b9b4c684b-bdbrh"]
Jul 10 18:59:38.471109 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.471069    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:38.472971 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.472953    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.474778 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.474704    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 10 18:59:38.475209 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.475186    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:59:38.475536 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.475507    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 10 18:59:38.476123 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.476102    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 18:59:38.476562 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.476247    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d494m\""
Jul 10 18:59:38.476562 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.476430    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k2vvm\""
Jul 10 18:59:38.476562 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.476445    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 18:59:38.476562 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.476477    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 18:59:38.490018 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.488753    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 18:59:38.504574 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.504469    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b9b4c684b-bdbrh"]
Jul 10 18:59:38.505591 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.505561    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"]
Jul 10 18:59:38.512444 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512419    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e04c462f-1228-4a9c-8edc-c35416fe21ac-serving-cert\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.512550 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.512618 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512601    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.512678 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512655    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e04c462f-1228-4a9c-8edc-c35416fe21ac-trusted-ca\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.512730 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512698    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57jht\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-kube-api-access-57jht\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.512778 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512729    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqkh\" (UniqueName: \"kubernetes.io/projected/88a7162c-a592-4c37-9931-ec618930e900-kube-api-access-dnqkh\") pod \"network-check-source-869dcfcdcd-kpxf9\" (UID: \"88a7162c-a592-4c37-9931-ec618930e900\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"
Jul 10 18:59:38.512778 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.512733    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:38.512778 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt47h\" (UniqueName: \"kubernetes.io/projected/e04c462f-1228-4a9c-8edc-c35416fe21ac-kube-api-access-qt47h\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.512919 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:38.512919 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.512808    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls podName:a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:39.012785992 +0000 UTC m=+68.201311150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bj4sf" (UID: "a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33") : secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:38.512919 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512874    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18b1c477-4134-49b4-a2ac-db3d5e259733-ca-trust-extracted\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.512919 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-installation-pull-secrets\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.513126 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.512959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-image-registry-private-configuration\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.513126 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzq5t\" (UniqueName: \"kubernetes.io/projected/2815d477-f631-4fea-99e5-62d033472328-kube-api-access-dzq5t\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:38.513126 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-bound-sa-token\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.513126 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.513126 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-trusted-ca\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.513302 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-certificates\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.513302 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ljc\" (UniqueName: \"kubernetes.io/projected/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-kube-api-access-k8ljc\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.513302 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e04c462f-1228-4a9c-8edc-c35416fe21ac-config\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.513391 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513372    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.513727 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513704    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e04c462f-1228-4a9c-8edc-c35416fe21ac-trusted-ca\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.513924 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.513892    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e04c462f-1228-4a9c-8edc-c35416fe21ac-config\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.516161 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.516127    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e04c462f-1228-4a9c-8edc-c35416fe21ac-serving-cert\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.539955 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.539871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ljc\" (UniqueName: \"kubernetes.io/projected/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-kube-api-access-k8ljc\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:38.539955 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.539943    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt47h\" (UniqueName: \"kubernetes.io/projected/e04c462f-1228-4a9c-8edc-c35416fe21ac-kube-api-access-qt47h\") pod \"console-operator-7866497494-xpb8v\" (UID: \"e04c462f-1228-4a9c-8edc-c35416fe21ac\") " pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:38.540431 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.540410    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqkh\" (UniqueName: \"kubernetes.io/projected/88a7162c-a592-4c37-9931-ec618930e900-kube-api-access-dnqkh\") pod \"network-check-source-869dcfcdcd-kpxf9\" (UID: \"88a7162c-a592-4c37-9931-ec618930e900\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"
Jul 10 18:59:38.614313 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614281    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzq5t\" (UniqueName: \"kubernetes.io/projected/2815d477-f631-4fea-99e5-62d033472328-kube-api-access-dzq5t\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:38.614313 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-bound-sa-token\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614548 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614548 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614361    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-trusted-ca\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614548 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614394    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-certificates\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614548 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614486    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57jht\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-kube-api-access-57jht\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614548 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:38.614548 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614544    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18b1c477-4134-49b4-a2ac-db3d5e259733-ca-trust-extracted\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614860 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.614511    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:38.614860 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614574    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-installation-pull-secrets\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614860 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.614583    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:38.614860 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.614607    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-image-registry-private-configuration\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.614860 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.614585    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b9b4c684b-bdbrh: secret "image-registry-tls" not found
Jul 10 18:59:38.614860 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.614667    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls podName:2815d477-f631-4fea-99e5-62d033472328 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:39.114639393 +0000 UTC m=+68.303164562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls") pod "cluster-samples-operator-65db858894-fjhw6" (UID: "2815d477-f631-4fea-99e5-62d033472328") : secret "samples-operator-tls" not found
Jul 10 18:59:38.614860 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:38.614699    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls podName:18b1c477-4134-49b4-a2ac-db3d5e259733 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:39.114681438 +0000 UTC m=+68.303206592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls") pod "image-registry-b9b4c684b-bdbrh" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733") : secret "image-registry-tls" not found
Jul 10 18:59:38.615284 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.615066    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18b1c477-4134-49b4-a2ac-db3d5e259733-ca-trust-extracted\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.615284 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.615259    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-certificates\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.615568 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.615542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-trusted-ca\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.617328 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.617308    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-installation-pull-secrets\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.617554 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.617533    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-image-registry-private-configuration\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.626879 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.626855    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57jht\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-kube-api-access-57jht\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.627002 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.626986    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-bound-sa-token\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:38.629049 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.629026    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzq5t\" (UniqueName: \"kubernetes.io/projected/2815d477-f631-4fea-99e5-62d033472328-kube-api-access-dzq5t\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:38.692497 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.692474    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"
Jul 10 18:59:38.700276 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:38.700255    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:39.017822 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:39.017777    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:39.018240 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:39.017965    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:39.018240 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:39.018056    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls podName:a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:40.018038361 +0000 UTC m=+69.206563511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bj4sf" (UID: "a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33") : secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:39.118575 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:39.118530    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:39.118756 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:39.118612    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:39.118756 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:39.118698    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:39.118756 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:39.118739    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:39.118756 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:39.118753    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b9b4c684b-bdbrh: secret "image-registry-tls" not found
Jul 10 18:59:39.118945 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:39.118788    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls podName:2815d477-f631-4fea-99e5-62d033472328 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:40.118767562 +0000 UTC m=+69.307292733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls") pod "cluster-samples-operator-65db858894-fjhw6" (UID: "2815d477-f631-4fea-99e5-62d033472328") : secret "samples-operator-tls" not found
Jul 10 18:59:39.118945 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:39.118810    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls podName:18b1c477-4134-49b4-a2ac-db3d5e259733 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:40.118798169 +0000 UTC m=+69.307323325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls") pod "image-registry-b9b4c684b-bdbrh" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733") : secret "image-registry-tls" not found
Jul 10 18:59:40.027238 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:40.027200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:40.027668 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:40.027393    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:40.027668 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:40.027475    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls podName:a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:42.027453699 +0000 UTC m=+71.215978863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bj4sf" (UID: "a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33") : secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:40.128119 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:40.128064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:40.128324 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:40.128137    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:40.128324 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:40.128248    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:40.128324 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:40.128262    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:40.128324 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:40.128282    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b9b4c684b-bdbrh: secret "image-registry-tls" not found
Jul 10 18:59:40.128494 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:40.128330    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls podName:2815d477-f631-4fea-99e5-62d033472328 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:42.128307671 +0000 UTC m=+71.316832821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls") pod "cluster-samples-operator-65db858894-fjhw6" (UID: "2815d477-f631-4fea-99e5-62d033472328") : secret "samples-operator-tls" not found
Jul 10 18:59:40.128494 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:40.128350    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls podName:18b1c477-4134-49b4-a2ac-db3d5e259733 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:42.128340561 +0000 UTC m=+71.316865718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls") pod "image-registry-b9b4c684b-bdbrh" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733") : secret "image-registry-tls" not found
Jul 10 18:59:41.359857 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.359830    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9"]
Jul 10 18:59:41.363351 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:59:41.363329    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a7162c_a592_4c37_9931_ec618930e900.slice/crio-c10602597ca7028e082adf4946b794f1ca5ca62fafaaeb253fc7ea1901339fb5 WatchSource:0}: Error finding container c10602597ca7028e082adf4946b794f1ca5ca62fafaaeb253fc7ea1901339fb5: Status 404 returned error can't find the container with id c10602597ca7028e082adf4946b794f1ca5ca62fafaaeb253fc7ea1901339fb5
Jul 10 18:59:41.373340 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.373317    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xpb8v"]
Jul 10 18:59:41.376291 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:59:41.376272    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04c462f_1228_4a9c_8edc_c35416fe21ac.slice/crio-4b6ef75e7bfc38088f6b3fa82e3fef5836d643412990d909daf2fc653513adbb WatchSource:0}: Error finding container 4b6ef75e7bfc38088f6b3fa82e3fef5836d643412990d909daf2fc653513adbb: Status 404 returned error can't find the container with id 4b6ef75e7bfc38088f6b3fa82e3fef5836d643412990d909daf2fc653513adbb
Jul 10 18:59:41.797079 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.797038    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2qtk" event={"ID":"6dbbdcfd-7a5e-458d-844a-a0ab1d031fd7","Type":"ContainerStarted","Data":"ae7ef035c3d2d81e6fcbc506c6ceb7a45d8ca64571adbd71b03b9c939f5076f3"}
Jul 10 18:59:41.797273 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.797142    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 18:59:41.798720 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.798694    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4c9q6" event={"ID":"45c81fd8-1c96-44ab-aa35-a80dab1f8204","Type":"ContainerStarted","Data":"982a145bc6092fd5d2c2b6d2dd0facd3e9b17e8504c53c368e856a14eed05161"}
Jul 10 18:59:41.800425 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.800388    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9" event={"ID":"88a7162c-a592-4c37-9931-ec618930e900","Type":"ContainerStarted","Data":"5937b8ce620398e552bf92de1dff65eb0308ec92c16264afdaeab932390e1775"}
Jul 10 18:59:41.800553 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.800443    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9" event={"ID":"88a7162c-a592-4c37-9931-ec618930e900","Type":"ContainerStarted","Data":"c10602597ca7028e082adf4946b794f1ca5ca62fafaaeb253fc7ea1901339fb5"}
Jul 10 18:59:41.801669 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.801647    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xpb8v" event={"ID":"e04c462f-1228-4a9c-8edc-c35416fe21ac","Type":"ContainerStarted","Data":"4b6ef75e7bfc38088f6b3fa82e3fef5836d643412990d909daf2fc653513adbb"}
Jul 10 18:59:41.818084 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.818038    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n2qtk" podStartSLOduration=66.101294412 podStartE2EDuration="1m10.818020014s" totalImagesPullingTime="4.716725602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:41.816822024 +0000 UTC m=+71.005347200" watchObservedRunningTime="2026-07-10 18:59:41.818020014 +0000 UTC m=+71.006545190"
Jul 10 18:59:41.833771 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.833727    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4c9q6" podStartSLOduration=65.79308667 podStartE2EDuration="1m10.833718712s" totalImagesPullingTime="5.040632042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:41.832642181 +0000 UTC m=+71.021167372" watchObservedRunningTime="2026-07-10 18:59:41.833718712 +0000 UTC m=+71.022243883"
Jul 10 18:59:41.851550 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:41.851510    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kpxf9" podStartSLOduration=3.8514957389999998 podStartE2EDuration="3.851495739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:41.850811626 +0000 UTC m=+71.039336800" watchObservedRunningTime="2026-07-10 18:59:41.851495739 +0000 UTC m=+71.040020960"
Jul 10 18:59:42.042885 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:42.042842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:42.043040 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:42.043004    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:42.043095 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:42.043082    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls podName:a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:46.043063884 +0000 UTC m=+75.231589057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bj4sf" (UID: "a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33") : secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:42.144097 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:42.143954    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:42.144097 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:42.144034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:42.144097 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:42.144088    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:42.144389 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:42.144159    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:42.144389 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:42.144181    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b9b4c684b-bdbrh: secret "image-registry-tls" not found
Jul 10 18:59:42.144389 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:42.144187    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls podName:2815d477-f631-4fea-99e5-62d033472328 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:46.144166336 +0000 UTC m=+75.332691500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls") pod "cluster-samples-operator-65db858894-fjhw6" (UID: "2815d477-f631-4fea-99e5-62d033472328") : secret "samples-operator-tls" not found
Jul 10 18:59:42.144389 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:42.144233    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls podName:18b1c477-4134-49b4-a2ac-db3d5e259733 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:46.144218953 +0000 UTC m=+75.332744105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls") pod "image-registry-b9b4c684b-bdbrh" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733") : secret "image-registry-tls" not found
Jul 10 18:59:43.810322 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:43.810295    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/0.log"
Jul 10 18:59:43.810732 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:43.810334    2556 generic.go:356] "Generic (PLEG): container finished" podID="e04c462f-1228-4a9c-8edc-c35416fe21ac" containerID="035c755f4b0b986610a3c56f3b07b98e73e63999b42449d907c3d28b98e861c9" exitCode=255
Jul 10 18:59:43.810732 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:43.810369    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xpb8v" event={"ID":"e04c462f-1228-4a9c-8edc-c35416fe21ac","Type":"ContainerDied","Data":"035c755f4b0b986610a3c56f3b07b98e73e63999b42449d907c3d28b98e861c9"}
Jul 10 18:59:43.810732 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:43.810578    2556 scope.go:117] "RemoveContainer" containerID="035c755f4b0b986610a3c56f3b07b98e73e63999b42449d907c3d28b98e861c9"
Jul 10 18:59:44.130181 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.130095    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4cwjl"]
Jul 10 18:59:44.132029 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.132015    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.135499 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.135476    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 18:59:44.135787 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.135771    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 18:59:44.135842 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.135819    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8f6gd\""
Jul 10 18:59:44.136594 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.136582    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 18:59:44.136641 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.136612    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 18:59:44.147502 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.147482    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cwjl"]
Jul 10 18:59:44.263391 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.263344    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.263391 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.263390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.263601 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.263418    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c0a257f-857a-4714-a05f-f93b900059d6-data-volume\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.263601 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.263506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c0a257f-857a-4714-a05f-f93b900059d6-crio-socket\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.263601 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.263552    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlmrq\" (UniqueName: \"kubernetes.io/projected/0c0a257f-857a-4714-a05f-f93b900059d6-kube-api-access-jlmrq\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.364174 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.364098    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlmrq\" (UniqueName: \"kubernetes.io/projected/0c0a257f-857a-4714-a05f-f93b900059d6-kube-api-access-jlmrq\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.364325 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.364222    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.364325 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.364250    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.364325 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.364285    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c0a257f-857a-4714-a05f-f93b900059d6-data-volume\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.364491 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.364349    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:44.364491 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.364359    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c0a257f-857a-4714-a05f-f93b900059d6-crio-socket\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.364491 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.364364    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:44.364491 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.364419    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:44.864403743 +0000 UTC m=+74.052928907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:44.364491 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.364434    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:44.864428139 +0000 UTC m=+74.052953288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:44.364491 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.364448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c0a257f-857a-4714-a05f-f93b900059d6-crio-socket\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.364695 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.364643    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c0a257f-857a-4714-a05f-f93b900059d6-data-volume\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.375196 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.375160    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlmrq\" (UniqueName: \"kubernetes.io/projected/0c0a257f-857a-4714-a05f-f93b900059d6-kube-api-access-jlmrq\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.814627 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.814600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/1.log"
Jul 10 18:59:44.815030 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.815021    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/0.log"
Jul 10 18:59:44.815074 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.815057    2556 generic.go:356] "Generic (PLEG): container finished" podID="e04c462f-1228-4a9c-8edc-c35416fe21ac" containerID="d08fbf1da99cf4cd7ac82b68598d37ffdb6a3f45fb50579a5ff005178ff3d748" exitCode=255
Jul 10 18:59:44.815138 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.815120    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xpb8v" event={"ID":"e04c462f-1228-4a9c-8edc-c35416fe21ac","Type":"ContainerDied","Data":"d08fbf1da99cf4cd7ac82b68598d37ffdb6a3f45fb50579a5ff005178ff3d748"}
Jul 10 18:59:44.815228 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.815217    2556 scope.go:117] "RemoveContainer" containerID="035c755f4b0b986610a3c56f3b07b98e73e63999b42449d907c3d28b98e861c9"
Jul 10 18:59:44.815410 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.815394    2556 scope.go:117] "RemoveContainer" containerID="d08fbf1da99cf4cd7ac82b68598d37ffdb6a3f45fb50579a5ff005178ff3d748"
Jul 10 18:59:44.815575 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.815556    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xpb8v_openshift-console-operator(e04c462f-1228-4a9c-8edc-c35416fe21ac)\"" pod="openshift-console-operator/console-operator-7866497494-xpb8v" podUID="e04c462f-1228-4a9c-8edc-c35416fe21ac"
Jul 10 18:59:44.868066 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.868036    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.868192 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:44.868079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:44.868192 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.868170    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:44.868316 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.868226    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:45.868207822 +0000 UTC m=+75.056732992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:44.868316 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.868230    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:44.868316 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:44.868290    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:45.868270457 +0000 UTC m=+75.056795668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:45.819399 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:45.819371    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/1.log"
Jul 10 18:59:45.819799 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:45.819664    2556 scope.go:117] "RemoveContainer" containerID="d08fbf1da99cf4cd7ac82b68598d37ffdb6a3f45fb50579a5ff005178ff3d748"
Jul 10 18:59:45.819841 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:45.819812    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xpb8v_openshift-console-operator(e04c462f-1228-4a9c-8edc-c35416fe21ac)\"" pod="openshift-console-operator/console-operator-7866497494-xpb8v" podUID="e04c462f-1228-4a9c-8edc-c35416fe21ac"
Jul 10 18:59:45.875540 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:45.875508    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:45.875540 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:45.875543    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:45.875743 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:45.875609    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:45.875743 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:45.875642    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:45.875743 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:45.875681    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:47.875666428 +0000 UTC m=+77.064191581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:45.875743 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:45.875699    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:47.875689896 +0000 UTC m=+77.064215054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:46.076924 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:46.076821    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:46.077080 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:46.076986    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:46.077080 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:46.077049    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls podName:a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:54.077032756 +0000 UTC m=+83.265557937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bj4sf" (UID: "a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33") : secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:46.101919 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:46.101895    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p7ct2_f9c519d6-a78e-4d7b-9834-cd1b40370815/dns-node-resolver/0.log"
Jul 10 18:59:46.178182 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:46.178139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:46.178281 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:46.178206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:46.178333 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:46.178310    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:46.178370 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:46.178355    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls podName:2815d477-f631-4fea-99e5-62d033472328 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:54.178342948 +0000 UTC m=+83.366868098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls") pod "cluster-samples-operator-65db858894-fjhw6" (UID: "2815d477-f631-4fea-99e5-62d033472328") : secret "samples-operator-tls" not found
Jul 10 18:59:46.178430 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:46.178310    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:46.178430 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:46.178408    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b9b4c684b-bdbrh: secret "image-registry-tls" not found
Jul 10 18:59:46.178514 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:46.178470    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls podName:18b1c477-4134-49b4-a2ac-db3d5e259733 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:54.178448804 +0000 UTC m=+83.366973979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls") pod "image-registry-b9b4c684b-bdbrh" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733") : secret "image-registry-tls" not found
Jul 10 18:59:47.110369 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:47.110340    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nq82_fe60dcc8-96b5-4a96-b372-b05910831a32/node-ca/0.log"
Jul 10 18:59:47.702575 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:47.702550    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rnmln_8d7dfd2e-b2d1-4b38-994c-87b058662e65/serve-healthcheck-canary/0.log"
Jul 10 18:59:47.891727 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:47.891686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:47.891727 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:47.891723    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:47.891944 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:47.891812    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:47.891944 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:47.891840    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:47.891944 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:47.891883    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:51.891866772 +0000 UTC m=+81.080391922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:47.891944 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:47.891899    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:51.891892546 +0000 UTC m=+81.080417695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:48.701317 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:48.701282    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:48.701660 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:48.701363    2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 18:59:48.701697 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:48.701682    2556 scope.go:117] "RemoveContainer" containerID="d08fbf1da99cf4cd7ac82b68598d37ffdb6a3f45fb50579a5ff005178ff3d748"
Jul 10 18:59:48.701859 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:48.701838    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xpb8v_openshift-console-operator(e04c462f-1228-4a9c-8edc-c35416fe21ac)\"" pod="openshift-console-operator/console-operator-7866497494-xpb8v" podUID="e04c462f-1228-4a9c-8edc-c35416fe21ac"
Jul 10 18:59:51.926452 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:51.926413    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:51.926452 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:51.926453    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:51.926912 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:51.926522    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:51.926912 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:51.926564    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:51.926912 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:51.926595    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:59.926576989 +0000 UTC m=+89.115102143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:51.926912 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:51.926661    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls podName:0c0a257f-857a-4714-a05f-f93b900059d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:59.926644823 +0000 UTC m=+89.115169974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4cwjl" (UID: "0c0a257f-857a-4714-a05f-f93b900059d6") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:54.144448 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.144332    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 18:59:54.144792 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:54.144487    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:54.144792 ip-10-0-139-108 kubenswrapper[2556]: E0710 18:59:54.144557    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls podName:a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33 nodeName:}" failed. No retries permitted until 2026-07-10 19:00:10.144539341 +0000 UTC m=+99.333064501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bj4sf" (UID: "a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33") : secret "cluster-monitoring-operator-tls" not found
Jul 10 18:59:54.245683 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.245650    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:54.245823 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.245708    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:54.247951 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.247924    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2815d477-f631-4fea-99e5-62d033472328-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fjhw6\" (UID: \"2815d477-f631-4fea-99e5-62d033472328\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:54.248065 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.248000    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"image-registry-b9b4c684b-bdbrh\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") " pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:54.384219 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.384187    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"
Jul 10 18:59:54.393290 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.393272    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:54.529407 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.529345    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6"]
Jul 10 18:59:54.551929 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.551902    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b9b4c684b-bdbrh"]
Jul 10 18:59:54.555821 ip-10-0-139-108 kubenswrapper[2556]: W0710 18:59:54.555799    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b1c477_4134_49b4_a2ac_db3d5e259733.slice/crio-98b8f8cf1acc8b6a47d41f7e1776cc33c234e7e5a7ca59527b9573c84e34873d WatchSource:0}: Error finding container 98b8f8cf1acc8b6a47d41f7e1776cc33c234e7e5a7ca59527b9573c84e34873d: Status 404 returned error can't find the container with id 98b8f8cf1acc8b6a47d41f7e1776cc33c234e7e5a7ca59527b9573c84e34873d
Jul 10 18:59:54.849987 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.849951    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh" event={"ID":"18b1c477-4134-49b4-a2ac-db3d5e259733","Type":"ContainerStarted","Data":"cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d"}
Jul 10 18:59:54.850201 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.850012    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh" event={"ID":"18b1c477-4134-49b4-a2ac-db3d5e259733","Type":"ContainerStarted","Data":"98b8f8cf1acc8b6a47d41f7e1776cc33c234e7e5a7ca59527b9573c84e34873d"}
Jul 10 18:59:54.850201 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.850036    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 18:59:54.851192 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.851172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6" event={"ID":"2815d477-f631-4fea-99e5-62d033472328","Type":"ContainerStarted","Data":"d5e0e6a141292d549be90dab0af5f50cfc92ee8ae1f39f3a4de50d12127153b0"}
Jul 10 18:59:54.882961 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:54.882913    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh" podStartSLOduration=16.882897995 podStartE2EDuration="16.882897995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:54.882503631 +0000 UTC m=+84.071028802" watchObservedRunningTime="2026-07-10 18:59:54.882897995 +0000 UTC m=+84.071423167"
Jul 10 18:59:56.859211 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:56.859175    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6" event={"ID":"2815d477-f631-4fea-99e5-62d033472328","Type":"ContainerStarted","Data":"adbce261f84f0ed8754160be9d7423dde8112f3bdc8dcf24b0551ea134793272"}
Jul 10 18:59:56.859622 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:56.859229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6" event={"ID":"2815d477-f631-4fea-99e5-62d033472328","Type":"ContainerStarted","Data":"16ca9e43de80c67ea975898a54ec688ef800c2a307105ea918de15775162f22f"}
Jul 10 18:59:56.887851 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:56.887806    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fjhw6" podStartSLOduration=17.189087485 podStartE2EDuration="18.887791099s" totalImagesPullingTime="1.698703614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:56.887186849 +0000 UTC m=+86.075712018" watchObservedRunningTime="2026-07-10 18:59:56.887791099 +0000 UTC m=+86.076316270"
Jul 10 18:59:59.993768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:59.993731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:59.993768 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:59.993769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:59.994263 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:59.994240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0a257f-857a-4714-a05f-f93b900059d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 18:59:59.995989 ip-10-0-139-108 kubenswrapper[2556]: I0710 18:59:59.995972    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0a257f-857a-4714-a05f-f93b900059d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cwjl\" (UID: \"0c0a257f-857a-4714-a05f-f93b900059d6\") " pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 19:00:00.040613 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.040574    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cwjl"
Jul 10 19:00:00.167663 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.167632    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cwjl"]
Jul 10 19:00:00.170788 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:00.170758    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0a257f_857a_4714_a05f_f93b900059d6.slice/crio-bf294fd6bb0b51309d5e6b9a94f220a08936e2def9efb2f383c11e2290628928 WatchSource:0}: Error finding container bf294fd6bb0b51309d5e6b9a94f220a08936e2def9efb2f383c11e2290628928: Status 404 returned error can't find the container with id bf294fd6bb0b51309d5e6b9a94f220a08936e2def9efb2f383c11e2290628928
Jul 10 19:00:00.347133 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.347044    2556 scope.go:117] "RemoveContainer" containerID="d08fbf1da99cf4cd7ac82b68598d37ffdb6a3f45fb50579a5ff005178ff3d748"
Jul 10 19:00:00.875312 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.875221    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:00:00.875794 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.875770    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/1.log"
Jul 10 19:00:00.875907 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.875809    2556 generic.go:356] "Generic (PLEG): container finished" podID="e04c462f-1228-4a9c-8edc-c35416fe21ac" containerID="c46d00baf942a79ce318400834552b722a5b613e957acca0271d419b5baa7d57" exitCode=255
Jul 10 19:00:00.875978 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.875907    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xpb8v" event={"ID":"e04c462f-1228-4a9c-8edc-c35416fe21ac","Type":"ContainerDied","Data":"c46d00baf942a79ce318400834552b722a5b613e957acca0271d419b5baa7d57"}
Jul 10 19:00:00.875978 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.875971    2556 scope.go:117] "RemoveContainer" containerID="d08fbf1da99cf4cd7ac82b68598d37ffdb6a3f45fb50579a5ff005178ff3d748"
Jul 10 19:00:00.876415 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.876362    2556 scope.go:117] "RemoveContainer" containerID="c46d00baf942a79ce318400834552b722a5b613e957acca0271d419b5baa7d57"
Jul 10 19:00:00.876754 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:00:00.876555    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xpb8v_openshift-console-operator(e04c462f-1228-4a9c-8edc-c35416fe21ac)\"" pod="openshift-console-operator/console-operator-7866497494-xpb8v" podUID="e04c462f-1228-4a9c-8edc-c35416fe21ac"
Jul 10 19:00:00.877771 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:00.877746    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cwjl" event={"ID":"0c0a257f-857a-4714-a05f-f93b900059d6","Type":"ContainerStarted","Data":"bf294fd6bb0b51309d5e6b9a94f220a08936e2def9efb2f383c11e2290628928"}
Jul 10 19:00:01.886899 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:01.886870    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:00:03.894768 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:03.894732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cwjl" event={"ID":"0c0a257f-857a-4714-a05f-f93b900059d6","Type":"ContainerStarted","Data":"71ddd85b1b4da04c4db1231635375c7b11d55ff888fc2d7c24a3a763268a7a2e"}
Jul 10 19:00:04.899511 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:04.899478    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cwjl" event={"ID":"0c0a257f-857a-4714-a05f-f93b900059d6","Type":"ContainerStarted","Data":"d76fd3f276e70c410118cd05414b8337dd52ad2d022a1ec54357da7e621142cd"}
Jul 10 19:00:06.327773 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.327739    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"]
Jul 10 19:00:06.331005 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.330984    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.333465 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.333440    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 19:00:06.333577 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.333481    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 10 19:00:06.334033 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.334011    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 10 19:00:06.335250 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.335228    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 19:00:06.335590 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.335558    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 10 19:00:06.336223 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.336206    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 19:00:06.336611 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.336592    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 10 19:00:06.350601 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.350578    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"]
Jul 10 19:00:06.366072 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.366048    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b9b4c684b-bdbrh"]
Jul 10 19:00:06.447841 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.447806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-494l6\" (UniqueName: \"kubernetes.io/projected/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-kube-api-access-494l6\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.448016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.447868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.448016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.447932    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-ca\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.448016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.447963    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-hub\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.448016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.447991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.448225 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.448020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.549352 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.549313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-494l6\" (UniqueName: \"kubernetes.io/projected/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-kube-api-access-494l6\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.549550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.549379    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.549550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.549420    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-ca\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.549550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.549447    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-hub\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.549550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.549474    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.549550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.549505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.550295 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.550251    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.552323 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.552294    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-ca\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.552441 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.552418    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.552541 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.552517    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.552849 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.552831    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-hub\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.562102 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.562081    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-494l6\" (UniqueName: \"kubernetes.io/projected/5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1-kube-api-access-494l6\") pod \"cluster-proxy-proxy-agent-6cf47647bf-c2jj2\" (UID: \"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.656657 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.656572    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"
Jul 10 19:00:06.808239 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.808204    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2"]
Jul 10 19:00:06.811216 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:06.811186    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5555e0bf_1f9d_4b6e_b9e3_ae44cdd1fbb1.slice/crio-7ab9144acc2f67d51ba6e09cb51a1a54113ab069d853db91d09f0e36669b719a WatchSource:0}: Error finding container 7ab9144acc2f67d51ba6e09cb51a1a54113ab069d853db91d09f0e36669b719a: Status 404 returned error can't find the container with id 7ab9144acc2f67d51ba6e09cb51a1a54113ab069d853db91d09f0e36669b719a
Jul 10 19:00:06.907060 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:06.906986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2" event={"ID":"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1","Type":"ContainerStarted","Data":"7ab9144acc2f67d51ba6e09cb51a1a54113ab069d853db91d09f0e36669b719a"}
Jul 10 19:00:08.701231 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:08.701201    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 19:00:08.701569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:08.701252    2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 19:00:08.701569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:08.701540    2556 scope.go:117] "RemoveContainer" containerID="c46d00baf942a79ce318400834552b722a5b613e957acca0271d419b5baa7d57"
Jul 10 19:00:08.701715 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:00:08.701696    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xpb8v_openshift-console-operator(e04c462f-1228-4a9c-8edc-c35416fe21ac)\"" pod="openshift-console-operator/console-operator-7866497494-xpb8v" podUID="e04c462f-1228-4a9c-8edc-c35416fe21ac"
Jul 10 19:00:08.918850 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:08.918811    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cwjl" event={"ID":"0c0a257f-857a-4714-a05f-f93b900059d6","Type":"ContainerStarted","Data":"ab786613708fedd4e5924eda846c74d0ab43dfae8bc13ca014898c20a6c95154"}
Jul 10 19:00:10.082700 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.082669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 19:00:10.084727 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.084706    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1108ee5d-2e79-40e4-97fb-01d41bb43583-metrics-tls\") pod \"dns-default-58nj5\" (UID: \"1108ee5d-2e79-40e4-97fb-01d41bb43583\") " pod="openshift-dns/dns-default-58nj5"
Jul 10 19:00:10.183646 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.183566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 19:00:10.185800 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.185782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bj4sf\" (UID: \"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 19:00:10.336947 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.336912    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6z54\""
Jul 10 19:00:10.344734 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.344713    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-58nj5"
Jul 10 19:00:10.402066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.402038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"
Jul 10 19:00:10.474662 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.474600    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4cwjl" podStartSLOduration=18.777940452 podStartE2EDuration="26.474574295s" totalImagesPullingTime="7.696633843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:59:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:08.958545012 +0000 UTC m=+98.147070184" watchObservedRunningTime="2026-07-10 19:00:10.474574295 +0000 UTC m=+99.663099469"
Jul 10 19:00:10.475892 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.475836    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-58nj5"]
Jul 10 19:00:10.478503 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:10.478476    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1108ee5d_2e79_40e4_97fb_01d41bb43583.slice/crio-5676d1f9a8f973bf7648b77bffcd344bd0489e7e149d79cd5f129b8274e04b15 WatchSource:0}: Error finding container 5676d1f9a8f973bf7648b77bffcd344bd0489e7e149d79cd5f129b8274e04b15: Status 404 returned error can't find the container with id 5676d1f9a8f973bf7648b77bffcd344bd0489e7e149d79cd5f129b8274e04b15
Jul 10 19:00:10.532995 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.532963    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf"]
Jul 10 19:00:10.536771 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:10.536747    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45ea9ba_82ba_49f7_b8ec_4bfbc89fcf33.slice/crio-1066e11a0414a062776496466526684a924aa27650a5b1ed29668a2704f364f4 WatchSource:0}: Error finding container 1066e11a0414a062776496466526684a924aa27650a5b1ed29668a2704f364f4: Status 404 returned error can't find the container with id 1066e11a0414a062776496466526684a924aa27650a5b1ed29668a2704f364f4
Jul 10 19:00:10.926573 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.926534    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-58nj5" event={"ID":"1108ee5d-2e79-40e4-97fb-01d41bb43583","Type":"ContainerStarted","Data":"5676d1f9a8f973bf7648b77bffcd344bd0489e7e149d79cd5f129b8274e04b15"}
Jul 10 19:00:10.927488 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:10.927465    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf" event={"ID":"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33","Type":"ContainerStarted","Data":"1066e11a0414a062776496466526684a924aa27650a5b1ed29668a2704f364f4"}
Jul 10 19:00:12.807028 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:12.806999    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n2qtk"
Jul 10 19:00:12.938813 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:12.938769    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-58nj5" event={"ID":"1108ee5d-2e79-40e4-97fb-01d41bb43583","Type":"ContainerStarted","Data":"b9493d75026bc338a3626ab802ab779ac9dfcb5e1737d0fd8432529708bbb31c"}
Jul 10 19:00:12.941368 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:12.941338    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf" event={"ID":"a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33","Type":"ContainerStarted","Data":"cbe5a1e63990ecc7dc562a9e11e1cd653c3b71341e9dc4271a03049e7c696d42"}
Jul 10 19:00:12.965177 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:12.965109    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bj4sf" podStartSLOduration=32.690034844 podStartE2EDuration="34.965091082s" totalImagesPullingTime="2.275056238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:12.96440045 +0000 UTC m=+102.152925625" watchObservedRunningTime="2026-07-10 19:00:12.965091082 +0000 UTC m=+102.153616254"
Jul 10 19:00:13.950260 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:13.950222    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-58nj5" event={"ID":"1108ee5d-2e79-40e4-97fb-01d41bb43583","Type":"ContainerStarted","Data":"7e285d6a65c9a2aa97cd011b77235d133b2b0749adb8cc6e0d6102b26d4b64d4"}
Jul 10 19:00:13.983452 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:13.983393    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-58nj5" podStartSLOduration=66.344240789 podStartE2EDuration="1m7.983338032s" totalImagesPullingTime="1.639097243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:13.982079759 +0000 UTC m=+103.170604932" watchObservedRunningTime="2026-07-10 19:00:13.983338032 +0000 UTC m=+103.171863204"
Jul 10 19:00:14.954041 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:14.954012    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-58nj5"
Jul 10 19:00:15.958228 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:15.958199    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2" event={"ID":"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1","Type":"ContainerStarted","Data":"9695a1953b55d01679dc71b486a80c4c9bbbe0192ed34a5cffad39631ad21f3c"}
Jul 10 19:00:16.373124 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:16.373041    2556 patch_prober.go:28] interesting pod/image-registry-b9b4c684b-bdbrh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 19:00:16.373124 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:16.373090    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh" podUID="18b1c477-4134-49b4-a2ac-db3d5e259733" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:00:16.966239 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:16.965879    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2" event={"ID":"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1","Type":"ContainerStarted","Data":"6965a682d709149db4afb0745460e3922aec7117066df7b1e0d766b66e0899bf"}
Jul 10 19:00:16.966742 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:16.966716    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2" event={"ID":"5555e0bf-1f9d-4b6e-b9e3-ae44cdd1fbb1","Type":"ContainerStarted","Data":"c1feb126e721c0f7eb69dc2c7b7ffe9154476bd1250f9716caac514b6042fa13"}
Jul 10 19:00:16.989367 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:16.989320    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf47647bf-c2jj2" podStartSLOduration=2.069622488 podStartE2EDuration="10.989308324s" totalImagesPullingTime="8.919685836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:16.987702659 +0000 UTC m=+106.176227823" watchObservedRunningTime="2026-07-10 19:00:16.989308324 +0000 UTC m=+106.177833495"
Jul 10 19:00:21.991382 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:21.991347    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ffczk"]
Jul 10 19:00:21.993778 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:21.993752    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:21.998822 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:21.998691    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gq9d6\""
Jul 10 19:00:21.998959 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:21.998922    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 19:00:22.002165 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:21.999476    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 19:00:22.002165 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:21.999748    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 19:00:22.002165 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:21.999964    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 19:00:22.078022 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.077993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078185 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078032    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-tls\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078185 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8gfj\" (UniqueName: \"kubernetes.io/projected/45d6428e-af44-436f-9b1d-a1285a36172e-kube-api-access-n8gfj\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078185 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078162    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-sys\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078207    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-root\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-wtmp\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45d6428e-af44-436f-9b1d-a1285a36172e-metrics-client-ca\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078273    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.078307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.078292    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-textfile\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179645 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179610    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179645 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179654    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-textfile\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179679    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-tls\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179729    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8gfj\" (UniqueName: \"kubernetes.io/projected/45d6428e-af44-436f-9b1d-a1285a36172e-kube-api-access-n8gfj\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179780    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-sys\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179816    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-root\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179862    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-wtmp\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179874    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-sys\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.179895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179892    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45d6428e-af44-436f-9b1d-a1285a36172e-metrics-client-ca\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.180307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.179953    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-root\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.180307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.180067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-wtmp\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.180307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.180094    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-textfile\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.180514 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.180495    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45d6428e-af44-436f-9b1d-a1285a36172e-metrics-client-ca\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.180577 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.180487    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.182205 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.182181    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.182323 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.182307    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45d6428e-af44-436f-9b1d-a1285a36172e-node-exporter-tls\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.188944 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.188913    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8gfj\" (UniqueName: \"kubernetes.io/projected/45d6428e-af44-436f-9b1d-a1285a36172e-kube-api-access-n8gfj\") pod \"node-exporter-ffczk\" (UID: \"45d6428e-af44-436f-9b1d-a1285a36172e\") " pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.305809 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.305721    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ffczk"
Jul 10 19:00:22.315060 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:22.315019    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d6428e_af44_436f_9b1d_a1285a36172e.slice/crio-121308fb77a0c4118c04b1ecaf1a14b0b4d4c6d95489b4d61987080ef3529526 WatchSource:0}: Error finding container 121308fb77a0c4118c04b1ecaf1a14b0b4d4c6d95489b4d61987080ef3529526: Status 404 returned error can't find the container with id 121308fb77a0c4118c04b1ecaf1a14b0b4d4c6d95489b4d61987080ef3529526
Jul 10 19:00:22.987193 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:22.987140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffczk" event={"ID":"45d6428e-af44-436f-9b1d-a1285a36172e","Type":"ContainerStarted","Data":"121308fb77a0c4118c04b1ecaf1a14b0b4d4c6d95489b4d61987080ef3529526"}
Jul 10 19:00:23.992562 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:23.992523    2556 generic.go:356] "Generic (PLEG): container finished" podID="45d6428e-af44-436f-9b1d-a1285a36172e" containerID="b895c7e3be91608522df6ca85b9a04ef2e582ef5931e64fc81810b10029ec6aa" exitCode=0
Jul 10 19:00:23.992950 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:23.992580    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffczk" event={"ID":"45d6428e-af44-436f-9b1d-a1285a36172e","Type":"ContainerDied","Data":"b895c7e3be91608522df6ca85b9a04ef2e582ef5931e64fc81810b10029ec6aa"}
Jul 10 19:00:24.347207 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:24.347127    2556 scope.go:117] "RemoveContainer" containerID="c46d00baf942a79ce318400834552b722a5b613e957acca0271d419b5baa7d57"
Jul 10 19:00:24.960524 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:24.960493    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-58nj5"
Jul 10 19:00:24.998567 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:24.998534    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffczk" event={"ID":"45d6428e-af44-436f-9b1d-a1285a36172e","Type":"ContainerStarted","Data":"a9cc43daa95d1b8365aa003bf161d298c29ccd8b94b76a39d1fd0d2db12fa018"}
Jul 10 19:00:24.999085 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:24.999054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffczk" event={"ID":"45d6428e-af44-436f-9b1d-a1285a36172e","Type":"ContainerStarted","Data":"3005f9f62262fa67034bc52b40ba3127474c79e652283f28684b5929ce45d224"}
Jul 10 19:00:25.000917 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:25.000897    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:00:25.001023 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:25.000949    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xpb8v" event={"ID":"e04c462f-1228-4a9c-8edc-c35416fe21ac","Type":"ContainerStarted","Data":"03997933a4ac6cca5624126f540959a7071110045d48e72afa138cc12ae88ab3"}
Jul 10 19:00:25.001306 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:25.001289    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 19:00:25.028228 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:25.028177    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ffczk" podStartSLOduration=3.004238228 podStartE2EDuration="4.028159104s" totalImagesPullingTime="958.777007ms" totalInitContainerRuntime="65.143869ms" isStatefulPod=true podCreationTimestamp="2026-07-10 19:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:25.02653429 +0000 UTC m=+114.215059459" watchObservedRunningTime="2026-07-10 19:00:25.028159104 +0000 UTC m=+114.216684271"
Jul 10 19:00:25.051275 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:25.051228    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-xpb8v" podStartSLOduration=45.431022747 podStartE2EDuration="47.051212123s" totalImagesPullingTime="1.620189376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:25.049662369 +0000 UTC m=+114.238187541" watchObservedRunningTime="2026-07-10 19:00:25.051212123 +0000 UTC m=+114.239737300"
Jul 10 19:00:25.480348 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:25.480319    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-xpb8v"
Jul 10 19:00:26.370628 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:26.370603    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 19:00:31.389531 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.389474    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh" podUID="18b1c477-4134-49b4-a2ac-db3d5e259733" containerName="registry" containerID="cri-o://cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d" gracePeriod=30
Jul 10 19:00:31.625515 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.625489    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 19:00:31.646550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.646472    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-trusted-ca\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.646550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.646512    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.646550 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.646544    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18b1c477-4134-49b4-a2ac-db3d5e259733-ca-trust-extracted\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.646763 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.646573    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-image-registry-private-configuration\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.646763 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.646596    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57jht\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-kube-api-access-57jht\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.647077 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.647032    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:00:31.647321 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.647293    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-certificates\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.647436 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.647422    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-bound-sa-token\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.647495 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.647470    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-installation-pull-secrets\") pod \"18b1c477-4134-49b4-a2ac-db3d5e259733\" (UID: \"18b1c477-4134-49b4-a2ac-db3d5e259733\") "
Jul 10 19:00:31.647801 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.647778    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-trusted-ca\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:31.647889 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.647840    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:00:31.651081 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.651036    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-kube-api-access-57jht" (OuterVolumeSpecName: "kube-api-access-57jht") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "kube-api-access-57jht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:00:31.651271 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.651240    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:00:31.651363 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.651299    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:00:31.651412 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.651350    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:00:31.652560 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.652534    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:00:31.657399 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.657376    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b1c477-4134-49b4-a2ac-db3d5e259733-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "18b1c477-4134-49b4-a2ac-db3d5e259733" (UID: "18b1c477-4134-49b4-a2ac-db3d5e259733"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:00:31.748307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.748266    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-bound-sa-token\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:31.748307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.748301    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-installation-pull-secrets\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:31.748307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.748311    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-tls\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:31.748527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.748320    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18b1c477-4134-49b4-a2ac-db3d5e259733-ca-trust-extracted\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:31.748527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.748328    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18b1c477-4134-49b4-a2ac-db3d5e259733-image-registry-private-configuration\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:31.748527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.748338    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57jht\" (UniqueName: \"kubernetes.io/projected/18b1c477-4134-49b4-a2ac-db3d5e259733-kube-api-access-57jht\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:31.748527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:31.748346    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18b1c477-4134-49b4-a2ac-db3d5e259733-registry-certificates\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:00:32.024312 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.024275    2556 generic.go:356] "Generic (PLEG): container finished" podID="18b1c477-4134-49b4-a2ac-db3d5e259733" containerID="cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d" exitCode=0
Jul 10 19:00:32.024468 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.024324    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh"
Jul 10 19:00:32.024468 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.024325    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh" event={"ID":"18b1c477-4134-49b4-a2ac-db3d5e259733","Type":"ContainerDied","Data":"cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d"}
Jul 10 19:00:32.024468 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.024448    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b9b4c684b-bdbrh" event={"ID":"18b1c477-4134-49b4-a2ac-db3d5e259733","Type":"ContainerDied","Data":"98b8f8cf1acc8b6a47d41f7e1776cc33c234e7e5a7ca59527b9573c84e34873d"}
Jul 10 19:00:32.024585 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.024472    2556 scope.go:117] "RemoveContainer" containerID="cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d"
Jul 10 19:00:32.032561 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.032539    2556 scope.go:117] "RemoveContainer" containerID="cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d"
Jul 10 19:00:32.032857 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:00:32.032832    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d\": container with ID starting with cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d not found: ID does not exist" containerID="cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d"
Jul 10 19:00:32.032933 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.032867    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d"} err="failed to get container status \"cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d\": rpc error: code = NotFound desc = could not find container \"cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d\": container with ID starting with cadb5a2043de6a0fe83370dcdea3c824dd2dbc57f9ae31e9da678acfa4c4d71d not found: ID does not exist"
Jul 10 19:00:32.045729 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.045707    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b9b4c684b-bdbrh"]
Jul 10 19:00:32.050727 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:32.050702    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b9b4c684b-bdbrh"]
Jul 10 19:00:33.351047 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:33.351015    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b1c477-4134-49b4-a2ac-db3d5e259733" path="/var/lib/kubelet/pods/18b1c477-4134-49b4-a2ac-db3d5e259733/volumes"
Jul 10 19:00:37.393059 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.393024    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-545675cdc-q6jxl"]
Jul 10 19:00:37.393520 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.393303    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b1c477-4134-49b4-a2ac-db3d5e259733" containerName="registry"
Jul 10 19:00:37.393520 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.393315    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b1c477-4134-49b4-a2ac-db3d5e259733" containerName="registry"
Jul 10 19:00:37.393520 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.393369    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b1c477-4134-49b4-a2ac-db3d5e259733" containerName="registry"
Jul 10 19:00:37.410028 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.409987    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545675cdc-q6jxl"]
Jul 10 19:00:37.410169 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.410114    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.412966 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.412937    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 19:00:37.413245 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.413226    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 19:00:37.413344 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.413226    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 19:00:37.413344 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.413230    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 19:00:37.413975 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.413958    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 19:00:37.414375 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.414358    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ctgj5\""
Jul 10 19:00:37.414555 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.414539    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 19:00:37.414700 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.414564    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 19:00:37.492109 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.492070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-oauth-serving-cert\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.492326 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.492129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-config\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.492326 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.492228    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-service-ca\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.492326 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.492299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-serving-cert\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.492481 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.492327    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-oauth-config\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.492481 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.492387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwplg\" (UniqueName: \"kubernetes.io/projected/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-kube-api-access-xwplg\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.592714 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.592680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwplg\" (UniqueName: \"kubernetes.io/projected/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-kube-api-access-xwplg\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.592866 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.592731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-oauth-serving-cert\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.592866 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.592785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-config\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.592866 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.592815    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-service-ca\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.592866 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.592841    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-serving-cert\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.593060 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.592863    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-oauth-config\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.593592 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.593567    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-config\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.593592 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.593578    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-oauth-serving-cert\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.593770 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.593598    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-service-ca\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.595245 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.595217    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-oauth-config\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.595408 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.595388    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-serving-cert\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.605799 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.605777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwplg\" (UniqueName: \"kubernetes.io/projected/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-kube-api-access-xwplg\") pod \"console-545675cdc-q6jxl\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") " pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.719413 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.719334    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:37.847225 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:37.847193    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545675cdc-q6jxl"]
Jul 10 19:00:37.850303 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:37.850275    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee4c7b2_1d72_43dc_a7ed_b5e6697822c7.slice/crio-4e4e0ebc86210a21c08de6ee54a23d64a7167e8ae474e452d9a9514a2ecfaa50 WatchSource:0}: Error finding container 4e4e0ebc86210a21c08de6ee54a23d64a7167e8ae474e452d9a9514a2ecfaa50: Status 404 returned error can't find the container with id 4e4e0ebc86210a21c08de6ee54a23d64a7167e8ae474e452d9a9514a2ecfaa50
Jul 10 19:00:38.046508 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:38.046472    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545675cdc-q6jxl" event={"ID":"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7","Type":"ContainerStarted","Data":"4e4e0ebc86210a21c08de6ee54a23d64a7167e8ae474e452d9a9514a2ecfaa50"}
Jul 10 19:00:40.115406 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:40.115362    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 19:00:40.117971 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:40.117939    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44400a71-5f0b-4b41-bf90-96e9b1dc91b9-metrics-certs\") pod \"network-metrics-daemon-rpd9k\" (UID: \"44400a71-5f0b-4b41-bf90-96e9b1dc91b9\") " pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 19:00:40.261561 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:40.261523    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mzc76\""
Jul 10 19:00:40.269589 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:40.269553    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpd9k"
Jul 10 19:00:40.531759 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:40.531726    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rpd9k"]
Jul 10 19:00:40.535224 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:40.535196    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44400a71_5f0b_4b41_bf90_96e9b1dc91b9.slice/crio-c47259c2dcf52991cc39a646f61ea9e93ad0551f66620afd77cfb3822674adb8 WatchSource:0}: Error finding container c47259c2dcf52991cc39a646f61ea9e93ad0551f66620afd77cfb3822674adb8: Status 404 returned error can't find the container with id c47259c2dcf52991cc39a646f61ea9e93ad0551f66620afd77cfb3822674adb8
Jul 10 19:00:41.062032 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:41.061992    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545675cdc-q6jxl" event={"ID":"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7","Type":"ContainerStarted","Data":"5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea"}
Jul 10 19:00:41.063268 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:41.063238    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpd9k" event={"ID":"44400a71-5f0b-4b41-bf90-96e9b1dc91b9","Type":"ContainerStarted","Data":"c47259c2dcf52991cc39a646f61ea9e93ad0551f66620afd77cfb3822674adb8"}
Jul 10 19:00:41.082049 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:41.081988    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-545675cdc-q6jxl" podStartSLOduration=1.493307042 podStartE2EDuration="4.081968689s" totalImagesPullingTime="2.588661647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:41.080310465 +0000 UTC m=+130.268835637" watchObservedRunningTime="2026-07-10 19:00:41.081968689 +0000 UTC m=+130.270493863"
Jul 10 19:00:42.068606 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:42.068572    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpd9k" event={"ID":"44400a71-5f0b-4b41-bf90-96e9b1dc91b9","Type":"ContainerStarted","Data":"4ddcec6c6e4591a5ae987385d8e171fcdbd5572df83a3b206ac1ab5aac4b7066"}
Jul 10 19:00:42.068984 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:42.068631    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpd9k" event={"ID":"44400a71-5f0b-4b41-bf90-96e9b1dc91b9","Type":"ContainerStarted","Data":"b91b4b646ee8365817476dd330c23e25a4bcbb0d3a6729af8afe35993a820b35"}
Jul 10 19:00:42.089470 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:42.089422    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rpd9k" podStartSLOduration=130.194426415 podStartE2EDuration="2m11.089404331s" totalImagesPullingTime="894.977916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:42.088428618 +0000 UTC m=+131.276953791" watchObservedRunningTime="2026-07-10 19:00:42.089404331 +0000 UTC m=+131.277929505"
Jul 10 19:00:47.611567 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.611534    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d8c8f645-xwjvb"]
Jul 10 19:00:47.658652 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.658617    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d8c8f645-xwjvb"]
Jul 10 19:00:47.658800 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.658717    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.676193 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.676161    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 19:00:47.719613 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.719575    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:47.719765 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.719637    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:47.724342 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.724321    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:47.769324 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.769289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-service-ca\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.769586 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.769558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78sx\" (UniqueName: \"kubernetes.io/projected/dcc39851-9f02-4fa1-81af-f2e99cd947f2-kube-api-access-p78sx\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.769720 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.769601    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-trusted-ca-bundle\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.769720 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.769665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-serving-cert\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.769836 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.769727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-oauth-config\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.769836 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.769783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-config\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.769836 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.769824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-oauth-serving-cert\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.870536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.870458    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-service-ca\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.870536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.870497    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78sx\" (UniqueName: \"kubernetes.io/projected/dcc39851-9f02-4fa1-81af-f2e99cd947f2-kube-api-access-p78sx\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.870536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.870516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-trusted-ca-bundle\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.870773 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.870541    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-serving-cert\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.870773 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.870661    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-oauth-config\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.870773 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.870700    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-config\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.870773 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.870726    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-oauth-serving-cert\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.871317 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.871290    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-service-ca\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.871464 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.871441    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-oauth-serving-cert\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.871537 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.871451    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-config\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.871703 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.871685    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-trusted-ca-bundle\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.872993 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.872971    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-serving-cert\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.873083 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.873003    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-oauth-config\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.885564 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.885546    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78sx\" (UniqueName: \"kubernetes.io/projected/dcc39851-9f02-4fa1-81af-f2e99cd947f2-kube-api-access-p78sx\") pod \"console-65d8c8f645-xwjvb\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") " pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:47.967532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:47.967495    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:48.095901 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:48.095868    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:00:48.140405 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:48.140296    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d8c8f645-xwjvb"]
Jul 10 19:00:48.143545 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:00:48.143514    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc39851_9f02_4fa1_81af_f2e99cd947f2.slice/crio-67d7f3bb1574c3a38390c6e14b73a5d2851c0b24e01ed9370035ae7894289908 WatchSource:0}: Error finding container 67d7f3bb1574c3a38390c6e14b73a5d2851c0b24e01ed9370035ae7894289908: Status 404 returned error can't find the container with id 67d7f3bb1574c3a38390c6e14b73a5d2851c0b24e01ed9370035ae7894289908
Jul 10 19:00:49.096008 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:49.095960    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8c8f645-xwjvb" event={"ID":"dcc39851-9f02-4fa1-81af-f2e99cd947f2","Type":"ContainerStarted","Data":"2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b"}
Jul 10 19:00:49.096398 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:49.096064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8c8f645-xwjvb" event={"ID":"dcc39851-9f02-4fa1-81af-f2e99cd947f2","Type":"ContainerStarted","Data":"67d7f3bb1574c3a38390c6e14b73a5d2851c0b24e01ed9370035ae7894289908"}
Jul 10 19:00:49.121063 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:49.121012    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d8c8f645-xwjvb" podStartSLOduration=2.120996413 podStartE2EDuration="2.120996413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:49.120451155 +0000 UTC m=+138.308976341" watchObservedRunningTime="2026-07-10 19:00:49.120996413 +0000 UTC m=+138.309521659"
Jul 10 19:00:57.967890 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:57.967852    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:57.968397 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:57.967947    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:57.972617 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:57.972597    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:58.131625 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:58.131594    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:00:58.185650 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:00:58.185619    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545675cdc-q6jxl"]
Jul 10 19:01:23.206071 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.205980    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-545675cdc-q6jxl" podUID="4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" containerName="console" containerID="cri-o://5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea" gracePeriod=15
Jul 10 19:01:23.445606 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.445584    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:01:23.548062 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548015    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-config\") pod \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") "
Jul 10 19:01:23.548062 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548077    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-service-ca\") pod \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") "
Jul 10 19:01:23.548308 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548108    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwplg\" (UniqueName: \"kubernetes.io/projected/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-kube-api-access-xwplg\") pod \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") "
Jul 10 19:01:23.548308 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548233    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-oauth-config\") pod \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") "
Jul 10 19:01:23.548308 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548276    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-oauth-serving-cert\") pod \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") "
Jul 10 19:01:23.548424 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548312    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-serving-cert\") pod \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\" (UID: \"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7\") "
Jul 10 19:01:23.548576 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548539    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-config" (OuterVolumeSpecName: "console-config") pod "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" (UID: "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:01:23.548576 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548553    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" (UID: "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:01:23.548732 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.548634    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" (UID: "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:01:23.550491 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.550463    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" (UID: "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:01:23.550577 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.550486    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" (UID: "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:01:23.550577 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.550520    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-kube-api-access-xwplg" (OuterVolumeSpecName: "kube-api-access-xwplg") pod "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" (UID: "4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7"). InnerVolumeSpecName "kube-api-access-xwplg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:01:23.649236 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.649189    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-service-ca\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:01:23.649236 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.649233    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwplg\" (UniqueName: \"kubernetes.io/projected/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-kube-api-access-xwplg\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:01:23.649236 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.649245    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-oauth-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:01:23.649236 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.649255    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-oauth-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:01:23.649507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.649264    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:01:23.649507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:23.649272    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7-console-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:01:24.216054 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.216017    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" containerID="5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea" exitCode=0
Jul 10 19:01:24.216456 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.216060    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545675cdc-q6jxl"
Jul 10 19:01:24.216456 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.216102    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545675cdc-q6jxl" event={"ID":"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7","Type":"ContainerDied","Data":"5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea"}
Jul 10 19:01:24.216456 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.216171    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545675cdc-q6jxl" event={"ID":"4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7","Type":"ContainerDied","Data":"4e4e0ebc86210a21c08de6ee54a23d64a7167e8ae474e452d9a9514a2ecfaa50"}
Jul 10 19:01:24.216456 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.216194    2556 scope.go:117] "RemoveContainer" containerID="5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea"
Jul 10 19:01:24.224313 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.224295    2556 scope.go:117] "RemoveContainer" containerID="5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea"
Jul 10 19:01:24.224597 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:01:24.224579    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea\": container with ID starting with 5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea not found: ID does not exist" containerID="5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea"
Jul 10 19:01:24.224642 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.224606    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea"} err="failed to get container status \"5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea\": rpc error: code = NotFound desc = could not find container \"5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea\": container with ID starting with 5d5d48c9327ec0bdd71292990dbcba1b05d4aac3ea098b7039160f33ecb0e4ea not found: ID does not exist"
Jul 10 19:01:24.236304 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.236284    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545675cdc-q6jxl"]
Jul 10 19:01:24.240716 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:24.240698    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-545675cdc-q6jxl"]
Jul 10 19:01:25.351981 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:25.351950    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" path="/var/lib/kubelet/pods/4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7/volumes"
Jul 10 19:01:51.164041 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.164004    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57cfc89d75-gkj2q"]
Jul 10 19:01:51.164507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.164268    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" containerName="console"
Jul 10 19:01:51.164507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.164280    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" containerName="console"
Jul 10 19:01:51.164507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.164330    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee4c7b2-1d72-43dc-a7ed-b5e6697822c7" containerName="console"
Jul 10 19:01:51.168587 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.168563    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.179229 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.179204    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cfc89d75-gkj2q"]
Jul 10 19:01:51.348705 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.348673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-oauth-serving-cert\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.348705 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.348711    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-console-config\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.348941 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.348742    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-oauth-config\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.348941 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.348863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-serving-cert\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.348941 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.348932    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h9jx\" (UniqueName: \"kubernetes.io/projected/423f4350-810d-49cb-b6e3-31f4803c588f-kube-api-access-9h9jx\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.349046 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.348961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-service-ca\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.349046 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.348994    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-trusted-ca-bundle\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.449510 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.449414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-oauth-serving-cert\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.449670 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.449533    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-console-config\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.449670 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.449580    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-oauth-config\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.449670 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.449607    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-serving-cert\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.449670 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.449659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9jx\" (UniqueName: \"kubernetes.io/projected/423f4350-810d-49cb-b6e3-31f4803c588f-kube-api-access-9h9jx\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.449942 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.449691    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-service-ca\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.449942 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.449728    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-trusted-ca-bundle\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.450285 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.450264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-console-config\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.450485 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.450461    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-service-ca\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.450603 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.450583    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-oauth-serving-cert\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.450662 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.450622    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-trusted-ca-bundle\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.451993 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.451970    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-oauth-config\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.452171 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.452136    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-serving-cert\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.458090 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.458069    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h9jx\" (UniqueName: \"kubernetes.io/projected/423f4350-810d-49cb-b6e3-31f4803c588f-kube-api-access-9h9jx\") pod \"console-57cfc89d75-gkj2q\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") " pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.477926 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.477901    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:01:51.610404 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:51.610373    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cfc89d75-gkj2q"]
Jul 10 19:01:51.613466 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:01:51.613442    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423f4350_810d_49cb_b6e3_31f4803c588f.slice/crio-d3b7d5f3bf80b88efe44bf61b9622997beccfe70e1f37ece4f4f8ab901758de5 WatchSource:0}: Error finding container d3b7d5f3bf80b88efe44bf61b9622997beccfe70e1f37ece4f4f8ab901758de5: Status 404 returned error can't find the container with id d3b7d5f3bf80b88efe44bf61b9622997beccfe70e1f37ece4f4f8ab901758de5
Jul 10 19:01:52.315125 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:52.315087    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cfc89d75-gkj2q" event={"ID":"423f4350-810d-49cb-b6e3-31f4803c588f","Type":"ContainerStarted","Data":"98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41"}
Jul 10 19:01:52.315543 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:52.315193    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cfc89d75-gkj2q" event={"ID":"423f4350-810d-49cb-b6e3-31f4803c588f","Type":"ContainerStarted","Data":"d3b7d5f3bf80b88efe44bf61b9622997beccfe70e1f37ece4f4f8ab901758de5"}
Jul 10 19:01:52.335008 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:01:52.334961    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57cfc89d75-gkj2q" podStartSLOduration=1.33494553 podStartE2EDuration="1.33494553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:01:52.334038704 +0000 UTC m=+201.522563868" watchObservedRunningTime="2026-07-10 19:01:52.33494553 +0000 UTC m=+201.523470703"
Jul 10 19:02:01.478423 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:01.478388    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:02:01.478913 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:01.478478    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:02:01.483182 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:01.483161    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:02:02.353766 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:02.353738    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:02:02.403496 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:02.403466    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d8c8f645-xwjvb"]
Jul 10 19:02:27.426099 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.426035    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65d8c8f645-xwjvb" podUID="dcc39851-9f02-4fa1-81af-f2e99cd947f2" containerName="console" containerID="cri-o://2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b" gracePeriod=15
Jul 10 19:02:27.657035 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.657011    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:02:27.704136 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704064    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-trusted-ca-bundle\") pod \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") "
Jul 10 19:02:27.704136 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704110    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-serving-cert\") pod \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") "
Jul 10 19:02:27.704136 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704135    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p78sx\" (UniqueName: \"kubernetes.io/projected/dcc39851-9f02-4fa1-81af-f2e99cd947f2-kube-api-access-p78sx\") pod \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") "
Jul 10 19:02:27.704400 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704185    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-config\") pod \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") "
Jul 10 19:02:27.704400 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704210    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-oauth-config\") pod \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") "
Jul 10 19:02:27.704400 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704252    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-service-ca\") pod \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") "
Jul 10 19:02:27.704400 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704285    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-oauth-serving-cert\") pod \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\" (UID: \"dcc39851-9f02-4fa1-81af-f2e99cd947f2\") "
Jul 10 19:02:27.704703 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704669    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "dcc39851-9f02-4fa1-81af-f2e99cd947f2" (UID: "dcc39851-9f02-4fa1-81af-f2e99cd947f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:02:27.704792 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704693    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-config" (OuterVolumeSpecName: "console-config") pod "dcc39851-9f02-4fa1-81af-f2e99cd947f2" (UID: "dcc39851-9f02-4fa1-81af-f2e99cd947f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:02:27.704792 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704751    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dcc39851-9f02-4fa1-81af-f2e99cd947f2" (UID: "dcc39851-9f02-4fa1-81af-f2e99cd947f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:02:27.704792 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.704755    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dcc39851-9f02-4fa1-81af-f2e99cd947f2" (UID: "dcc39851-9f02-4fa1-81af-f2e99cd947f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:02:27.706278 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.706245    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dcc39851-9f02-4fa1-81af-f2e99cd947f2" (UID: "dcc39851-9f02-4fa1-81af-f2e99cd947f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:02:27.706278 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.706266    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dcc39851-9f02-4fa1-81af-f2e99cd947f2" (UID: "dcc39851-9f02-4fa1-81af-f2e99cd947f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:02:27.706411 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.706352    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcc39851-9f02-4fa1-81af-f2e99cd947f2-kube-api-access-p78sx" (OuterVolumeSpecName: "kube-api-access-p78sx") pod "dcc39851-9f02-4fa1-81af-f2e99cd947f2" (UID: "dcc39851-9f02-4fa1-81af-f2e99cd947f2"). InnerVolumeSpecName "kube-api-access-p78sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:02:27.804803 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.804769    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-service-ca\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:02:27.804803 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.804799    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-oauth-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:02:27.804803 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.804809    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-trusted-ca-bundle\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:02:27.805011 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.804818    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:02:27.805011 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.804827    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p78sx\" (UniqueName: \"kubernetes.io/projected/dcc39851-9f02-4fa1-81af-f2e99cd947f2-kube-api-access-p78sx\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:02:27.805011 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.804836    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:02:27.805011 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:27.804844    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcc39851-9f02-4fa1-81af-f2e99cd947f2-console-oauth-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:02:28.434323 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.434285    2556 generic.go:356] "Generic (PLEG): container finished" podID="dcc39851-9f02-4fa1-81af-f2e99cd947f2" containerID="2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b" exitCode=0
Jul 10 19:02:28.434791 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.434340    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d8c8f645-xwjvb"
Jul 10 19:02:28.434791 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.434376    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8c8f645-xwjvb" event={"ID":"dcc39851-9f02-4fa1-81af-f2e99cd947f2","Type":"ContainerDied","Data":"2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b"}
Jul 10 19:02:28.434791 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.434417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d8c8f645-xwjvb" event={"ID":"dcc39851-9f02-4fa1-81af-f2e99cd947f2","Type":"ContainerDied","Data":"67d7f3bb1574c3a38390c6e14b73a5d2851c0b24e01ed9370035ae7894289908"}
Jul 10 19:02:28.434791 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.434436    2556 scope.go:117] "RemoveContainer" containerID="2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b"
Jul 10 19:02:28.442278 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.442257    2556 scope.go:117] "RemoveContainer" containerID="2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b"
Jul 10 19:02:28.442540 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:02:28.442523    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b\": container with ID starting with 2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b not found: ID does not exist" containerID="2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b"
Jul 10 19:02:28.442608 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.442547    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b"} err="failed to get container status \"2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b\": rpc error: code = NotFound desc = could not find container \"2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b\": container with ID starting with 2568fa7456fb10a78b807d8a7284bfc655a69fba2c4c045cdde0548e3e147d4b not found: ID does not exist"
Jul 10 19:02:28.454221 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.454193    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d8c8f645-xwjvb"]
Jul 10 19:02:28.456534 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:28.456511    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d8c8f645-xwjvb"]
Jul 10 19:02:29.350798 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:02:29.350766    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcc39851-9f02-4fa1-81af-f2e99cd947f2" path="/var/lib/kubelet/pods/dcc39851-9f02-4fa1-81af-f2e99cd947f2/volumes"
Jul 10 19:03:04.184917 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.184879    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c7cc58d5-9sg6t"]
Jul 10 19:03:04.185523 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.185132    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcc39851-9f02-4fa1-81af-f2e99cd947f2" containerName="console"
Jul 10 19:03:04.185523 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.185159    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcc39851-9f02-4fa1-81af-f2e99cd947f2" containerName="console"
Jul 10 19:03:04.185523 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.185249    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcc39851-9f02-4fa1-81af-f2e99cd947f2" containerName="console"
Jul 10 19:03:04.188257 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.188232    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.203785 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.203761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c7cc58d5-9sg6t"]
Jul 10 19:03:04.358361 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.358328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-oauth-serving-cert\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.358536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.358368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-service-ca\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.358536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.358391    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzfqr\" (UniqueName: \"kubernetes.io/projected/51ea04b5-0963-4b8f-82c4-10e619e65a9d-kube-api-access-nzfqr\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.358536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.358490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-serving-cert\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.358536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.358522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-oauth-config\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.358710 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.358540    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-trusted-ca-bundle\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.358710 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.358570    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-config\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.459546 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.459461    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-oauth-serving-cert\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.459546 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.459502    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-service-ca\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.459546 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.459523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzfqr\" (UniqueName: \"kubernetes.io/projected/51ea04b5-0963-4b8f-82c4-10e619e65a9d-kube-api-access-nzfqr\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.459811 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.459557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-serving-cert\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.459811 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.459575    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-oauth-config\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.459811 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.459592    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-trusted-ca-bundle\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.459811 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.459756    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-config\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.460402 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.460345    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-oauth-serving-cert\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.460402 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.460393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-config\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.460543 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.460433    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-service-ca\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.460848 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.460822    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-trusted-ca-bundle\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.462024 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.462005    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-oauth-config\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.462223 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.462205    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-serving-cert\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.468934 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.468903    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzfqr\" (UniqueName: \"kubernetes.io/projected/51ea04b5-0963-4b8f-82c4-10e619e65a9d-kube-api-access-nzfqr\") pod \"console-59c7cc58d5-9sg6t\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") " pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.498001 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.497978    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:04.632299 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:04.632269    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c7cc58d5-9sg6t"]
Jul 10 19:03:04.634710 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:03:04.634677    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ea04b5_0963_4b8f_82c4_10e619e65a9d.slice/crio-097acee3cf36f47d0cf1bc8c6875a1f52974cc4c63ad9646047cbe3b1cca9559 WatchSource:0}: Error finding container 097acee3cf36f47d0cf1bc8c6875a1f52974cc4c63ad9646047cbe3b1cca9559: Status 404 returned error can't find the container with id 097acee3cf36f47d0cf1bc8c6875a1f52974cc4c63ad9646047cbe3b1cca9559
Jul 10 19:03:05.560689 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:05.560647    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c7cc58d5-9sg6t" event={"ID":"51ea04b5-0963-4b8f-82c4-10e619e65a9d","Type":"ContainerStarted","Data":"74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1"}
Jul 10 19:03:05.561041 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:05.560708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c7cc58d5-9sg6t" event={"ID":"51ea04b5-0963-4b8f-82c4-10e619e65a9d","Type":"ContainerStarted","Data":"097acee3cf36f47d0cf1bc8c6875a1f52974cc4c63ad9646047cbe3b1cca9559"}
Jul 10 19:03:05.578936 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:05.578890    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c7cc58d5-9sg6t" podStartSLOduration=1.578876371 podStartE2EDuration="1.578876371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:03:05.577725857 +0000 UTC m=+274.766251032" watchObservedRunningTime="2026-07-10 19:03:05.578876371 +0000 UTC m=+274.767401542"
Jul 10 19:03:14.498704 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:14.498653    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:14.499225 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:14.498732    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:14.503479 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:14.503456    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:14.596699 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:14.596671    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:03:14.643621 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:14.643593    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cfc89d75-gkj2q"]
Jul 10 19:03:31.209680 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:31.209650    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:03:31.214683 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:31.214664    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:03:31.217455 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:31.217433    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:03:31.218929 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:31.218913    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 19:03:31.222488 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:31.222469    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:03:39.670910 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.670863    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57cfc89d75-gkj2q" podUID="423f4350-810d-49cb-b6e3-31f4803c588f" containerName="console" containerID="cri-o://98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41" gracePeriod=15
Jul 10 19:03:39.910309 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.910284    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:03:39.922528 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922477    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-trusted-ca-bundle\") pod \"423f4350-810d-49cb-b6e3-31f4803c588f\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") "
Jul 10 19:03:39.922528 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922518    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-serving-cert\") pod \"423f4350-810d-49cb-b6e3-31f4803c588f\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") "
Jul 10 19:03:39.922671 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922546    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-console-config\") pod \"423f4350-810d-49cb-b6e3-31f4803c588f\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") "
Jul 10 19:03:39.922671 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922585    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h9jx\" (UniqueName: \"kubernetes.io/projected/423f4350-810d-49cb-b6e3-31f4803c588f-kube-api-access-9h9jx\") pod \"423f4350-810d-49cb-b6e3-31f4803c588f\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") "
Jul 10 19:03:39.922671 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922609    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-oauth-config\") pod \"423f4350-810d-49cb-b6e3-31f4803c588f\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") "
Jul 10 19:03:39.922671 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922651    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-service-ca\") pod \"423f4350-810d-49cb-b6e3-31f4803c588f\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") "
Jul 10 19:03:39.922873 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922701    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-oauth-serving-cert\") pod \"423f4350-810d-49cb-b6e3-31f4803c588f\" (UID: \"423f4350-810d-49cb-b6e3-31f4803c588f\") "
Jul 10 19:03:39.922984 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.922953    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "423f4350-810d-49cb-b6e3-31f4803c588f" (UID: "423f4350-810d-49cb-b6e3-31f4803c588f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:39.923181 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.923119    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-service-ca" (OuterVolumeSpecName: "service-ca") pod "423f4350-810d-49cb-b6e3-31f4803c588f" (UID: "423f4350-810d-49cb-b6e3-31f4803c588f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:39.923181 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.923138    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-console-config" (OuterVolumeSpecName: "console-config") pod "423f4350-810d-49cb-b6e3-31f4803c588f" (UID: "423f4350-810d-49cb-b6e3-31f4803c588f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:39.923347 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.923230    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "423f4350-810d-49cb-b6e3-31f4803c588f" (UID: "423f4350-810d-49cb-b6e3-31f4803c588f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:39.924694 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.924664    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "423f4350-810d-49cb-b6e3-31f4803c588f" (UID: "423f4350-810d-49cb-b6e3-31f4803c588f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:03:39.924815 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.924791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "423f4350-810d-49cb-b6e3-31f4803c588f" (UID: "423f4350-810d-49cb-b6e3-31f4803c588f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:03:39.924882 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:39.924864    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423f4350-810d-49cb-b6e3-31f4803c588f-kube-api-access-9h9jx" (OuterVolumeSpecName: "kube-api-access-9h9jx") pod "423f4350-810d-49cb-b6e3-31f4803c588f" (UID: "423f4350-810d-49cb-b6e3-31f4803c588f"). InnerVolumeSpecName "kube-api-access-9h9jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:03:40.024089 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.024060    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-oauth-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:03:40.024089 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.024086    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-trusted-ca-bundle\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:03:40.024089 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.024095    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:03:40.024333 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.024105    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-console-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:03:40.024333 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.024114    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h9jx\" (UniqueName: \"kubernetes.io/projected/423f4350-810d-49cb-b6e3-31f4803c588f-kube-api-access-9h9jx\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:03:40.024333 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.024123    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/423f4350-810d-49cb-b6e3-31f4803c588f-console-oauth-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:03:40.024333 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.024131    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/423f4350-810d-49cb-b6e3-31f4803c588f-service-ca\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:03:40.680613 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.680578    2556 generic.go:356] "Generic (PLEG): container finished" podID="423f4350-810d-49cb-b6e3-31f4803c588f" containerID="98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41" exitCode=0
Jul 10 19:03:40.680997 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.680623    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cfc89d75-gkj2q"
Jul 10 19:03:40.680997 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.680651    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cfc89d75-gkj2q" event={"ID":"423f4350-810d-49cb-b6e3-31f4803c588f","Type":"ContainerDied","Data":"98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41"}
Jul 10 19:03:40.680997 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.680697    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cfc89d75-gkj2q" event={"ID":"423f4350-810d-49cb-b6e3-31f4803c588f","Type":"ContainerDied","Data":"d3b7d5f3bf80b88efe44bf61b9622997beccfe70e1f37ece4f4f8ab901758de5"}
Jul 10 19:03:40.680997 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.680716    2556 scope.go:117] "RemoveContainer" containerID="98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41"
Jul 10 19:03:40.689000 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.688980    2556 scope.go:117] "RemoveContainer" containerID="98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41"
Jul 10 19:03:40.689297 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:03:40.689279    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41\": container with ID starting with 98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41 not found: ID does not exist" containerID="98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41"
Jul 10 19:03:40.689353 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.689308    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41"} err="failed to get container status \"98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41\": rpc error: code = NotFound desc = could not find container \"98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41\": container with ID starting with 98357bb20d1bf907c74373b56d784f9c08a9e35347247a398f11972fdcef9a41 not found: ID does not exist"
Jul 10 19:03:40.701518 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.701492    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cfc89d75-gkj2q"]
Jul 10 19:03:40.704772 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:40.704747    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57cfc89d75-gkj2q"]
Jul 10 19:03:41.351090 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:03:41.351057    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="423f4350-810d-49cb-b6e3-31f4803c588f" path="/var/lib/kubelet/pods/423f4350-810d-49cb-b6e3-31f4803c588f/volumes"
Jul 10 19:04:32.086658 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.086618    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"]
Jul 10 19:04:32.087037 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.086865    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423f4350-810d-49cb-b6e3-31f4803c588f" containerName="console"
Jul 10 19:04:32.087037 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.086877    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="423f4350-810d-49cb-b6e3-31f4803c588f" containerName="console"
Jul 10 19:04:32.087037 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.086928    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="423f4350-810d-49cb-b6e3-31f4803c588f" containerName="console"
Jul 10 19:04:32.089846 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.089830    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.092344 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.092324    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zp6l7\""
Jul 10 19:04:32.092452 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.092434    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 19:04:32.093428 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.093409    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 19:04:32.100892 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.100871    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"]
Jul 10 19:04:32.190990 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.190952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm9qx\" (UniqueName: \"kubernetes.io/projected/c53282c7-6b2e-449e-baea-29d7d94e88a5-kube-api-access-tm9qx\") pod \"cert-manager-cainjector-559cdd8c87-4jq9q\" (UID: \"c53282c7-6b2e-449e-baea-29d7d94e88a5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.191187 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.190999    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53282c7-6b2e-449e-baea-29d7d94e88a5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4jq9q\" (UID: \"c53282c7-6b2e-449e-baea-29d7d94e88a5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.291687 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.291657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm9qx\" (UniqueName: \"kubernetes.io/projected/c53282c7-6b2e-449e-baea-29d7d94e88a5-kube-api-access-tm9qx\") pod \"cert-manager-cainjector-559cdd8c87-4jq9q\" (UID: \"c53282c7-6b2e-449e-baea-29d7d94e88a5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.291866 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.291697    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53282c7-6b2e-449e-baea-29d7d94e88a5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4jq9q\" (UID: \"c53282c7-6b2e-449e-baea-29d7d94e88a5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.300373 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.300340    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c53282c7-6b2e-449e-baea-29d7d94e88a5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4jq9q\" (UID: \"c53282c7-6b2e-449e-baea-29d7d94e88a5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.300552 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.300535    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm9qx\" (UniqueName: \"kubernetes.io/projected/c53282c7-6b2e-449e-baea-29d7d94e88a5-kube-api-access-tm9qx\") pod \"cert-manager-cainjector-559cdd8c87-4jq9q\" (UID: \"c53282c7-6b2e-449e-baea-29d7d94e88a5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.398979 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.398906    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"
Jul 10 19:04:32.505387 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.505358    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"]
Jul 10 19:04:32.508503 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.508481    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.511036 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.511012    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 19:04:32.511036 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.511028    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 19:04:32.511235 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.511032    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-z6kw7\""
Jul 10 19:04:32.517895 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.517872    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"]
Jul 10 19:04:32.523989 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.523966    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q"]
Jul 10 19:04:32.527265 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:04:32.527236    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc53282c7_6b2e_449e_baea_29d7d94e88a5.slice/crio-66c3128efb19de7161a37235b2cea20be17a809cf9703722b9145002bd81b195 WatchSource:0}: Error finding container 66c3128efb19de7161a37235b2cea20be17a809cf9703722b9145002bd81b195: Status 404 returned error can't find the container with id 66c3128efb19de7161a37235b2cea20be17a809cf9703722b9145002bd81b195
Jul 10 19:04:32.529683 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.529664    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 19:04:32.594906 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.594880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v2gk\" (UniqueName: \"kubernetes.io/projected/76491635-3221-4dd0-8e0a-d1a356e97103-kube-api-access-6v2gk\") pod \"openshift-lws-operator-fd8ccff4c-pql99\" (UID: \"76491635-3221-4dd0-8e0a-d1a356e97103\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.595027 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.594916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76491635-3221-4dd0-8e0a-d1a356e97103-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pql99\" (UID: \"76491635-3221-4dd0-8e0a-d1a356e97103\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.695472 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.695406    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76491635-3221-4dd0-8e0a-d1a356e97103-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pql99\" (UID: \"76491635-3221-4dd0-8e0a-d1a356e97103\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.695578 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.695472    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v2gk\" (UniqueName: \"kubernetes.io/projected/76491635-3221-4dd0-8e0a-d1a356e97103-kube-api-access-6v2gk\") pod \"openshift-lws-operator-fd8ccff4c-pql99\" (UID: \"76491635-3221-4dd0-8e0a-d1a356e97103\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.695788 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.695769    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76491635-3221-4dd0-8e0a-d1a356e97103-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pql99\" (UID: \"76491635-3221-4dd0-8e0a-d1a356e97103\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.705010 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.704987    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v2gk\" (UniqueName: \"kubernetes.io/projected/76491635-3221-4dd0-8e0a-d1a356e97103-kube-api-access-6v2gk\") pod \"openshift-lws-operator-fd8ccff4c-pql99\" (UID: \"76491635-3221-4dd0-8e0a-d1a356e97103\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.818689 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.818661    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"
Jul 10 19:04:32.853570 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.853541    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q" event={"ID":"c53282c7-6b2e-449e-baea-29d7d94e88a5","Type":"ContainerStarted","Data":"66c3128efb19de7161a37235b2cea20be17a809cf9703722b9145002bd81b195"}
Jul 10 19:04:32.942611 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:32.942580    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99"]
Jul 10 19:04:32.945251 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:04:32.945220    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76491635_3221_4dd0_8e0a_d1a356e97103.slice/crio-60edb352bd4a42ac8752c1a6a86832c3f4a2fa2f4ffca91fb7470c1ab9e998be WatchSource:0}: Error finding container 60edb352bd4a42ac8752c1a6a86832c3f4a2fa2f4ffca91fb7470c1ab9e998be: Status 404 returned error can't find the container with id 60edb352bd4a42ac8752c1a6a86832c3f4a2fa2f4ffca91fb7470c1ab9e998be
Jul 10 19:04:33.861348 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:33.861273    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99" event={"ID":"76491635-3221-4dd0-8e0a-d1a356e97103","Type":"ContainerStarted","Data":"60edb352bd4a42ac8752c1a6a86832c3f4a2fa2f4ffca91fb7470c1ab9e998be"}
Jul 10 19:04:36.875638 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:36.875598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q" event={"ID":"c53282c7-6b2e-449e-baea-29d7d94e88a5","Type":"ContainerStarted","Data":"951cf03b016d57c2c231426adb9923def995a170fa7dc045eb897f45a52c0532"}
Jul 10 19:04:36.877665 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:36.877625    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99" event={"ID":"76491635-3221-4dd0-8e0a-d1a356e97103","Type":"ContainerStarted","Data":"4cf4e68b91df9c7765b8ec4396fce06a7948937869524c03591e46ccb138991f"}
Jul 10 19:04:36.897177 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:36.896843    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4jq9q" podStartSLOduration=0.689155516 podStartE2EDuration="4.896827026s" totalImagesPullingTime="4.20767151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:36.895968034 +0000 UTC m=+366.084493221" watchObservedRunningTime="2026-07-10 19:04:36.896827026 +0000 UTC m=+366.085352198"
Jul 10 19:04:36.913669 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:36.913617    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pql99" podStartSLOduration=1.075431627 podStartE2EDuration="4.913598672s" totalImagesPullingTime="3.838167045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:36.912180107 +0000 UTC m=+366.100705280" watchObservedRunningTime="2026-07-10 19:04:36.913598672 +0000 UTC m=+366.102123844"
Jul 10 19:04:57.226527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.226495    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"]
Jul 10 19:04:57.229566 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.229548    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.234259 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.234234    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 19:04:57.234390 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.234300    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 19:04:57.234390 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.234240    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 19:04:57.234848 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.234833    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kshvj\""
Jul 10 19:04:57.234938 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.234920    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 19:04:57.259737 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.259713    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"]
Jul 10 19:04:57.375163 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.375126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjnmq\" (UniqueName: \"kubernetes.io/projected/80d44188-5341-4f51-bddc-56106c2c3475-kube-api-access-jjnmq\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.375334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.375188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80d44188-5341-4f51-bddc-56106c2c3475-tmp\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.375334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.375209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80d44188-5341-4f51-bddc-56106c2c3475-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.375334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.375229    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80d44188-5341-4f51-bddc-56106c2c3475-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.375334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.375279    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80d44188-5341-4f51-bddc-56106c2c3475-manifests\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.475826 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.475787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80d44188-5341-4f51-bddc-56106c2c3475-manifests\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.476026 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.475851    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjnmq\" (UniqueName: \"kubernetes.io/projected/80d44188-5341-4f51-bddc-56106c2c3475-kube-api-access-jjnmq\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.476026 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.475887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80d44188-5341-4f51-bddc-56106c2c3475-tmp\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.476026 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.475917    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80d44188-5341-4f51-bddc-56106c2c3475-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.476026 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.475948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80d44188-5341-4f51-bddc-56106c2c3475-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.476295 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.476270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80d44188-5341-4f51-bddc-56106c2c3475-manifests\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.478349 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.478296    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80d44188-5341-4f51-bddc-56106c2c3475-tmp\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.478465 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.478447    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80d44188-5341-4f51-bddc-56106c2c3475-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.478535 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.478515    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80d44188-5341-4f51-bddc-56106c2c3475-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.490171 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.490135    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjnmq\" (UniqueName: \"kubernetes.io/projected/80d44188-5341-4f51-bddc-56106c2c3475-kube-api-access-jjnmq\") pod \"opendatahub-operator-controller-manager-7cfcf59dd-vsn6f\" (UID: \"80d44188-5341-4f51-bddc-56106c2c3475\") " pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.539368 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.539334    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:04:57.670089 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.670042    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"]
Jul 10 19:04:57.673315 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:04:57.673284    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d44188_5341_4f51_bddc_56106c2c3475.slice/crio-460f3859136a29e874e650076d119eb990be99c5498c61797277463f9612bb3d WatchSource:0}: Error finding container 460f3859136a29e874e650076d119eb990be99c5498c61797277463f9612bb3d: Status 404 returned error can't find the container with id 460f3859136a29e874e650076d119eb990be99c5498c61797277463f9612bb3d
Jul 10 19:04:57.949697 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:04:57.949658    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f" event={"ID":"80d44188-5341-4f51-bddc-56106c2c3475","Type":"ContainerStarted","Data":"460f3859136a29e874e650076d119eb990be99c5498c61797277463f9612bb3d"}
Jul 10 19:05:00.963596 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:00.963559    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f" event={"ID":"80d44188-5341-4f51-bddc-56106c2c3475","Type":"ContainerStarted","Data":"35e6c507fe04ca97a3e85d1026f917747d5d61e70cbcc9eb7fae2cd8ae350392"}
Jul 10 19:05:01.968743 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:01.968646    2556 generic.go:356] "Generic (PLEG): container finished" podID="80d44188-5341-4f51-bddc-56106c2c3475" containerID="35e6c507fe04ca97a3e85d1026f917747d5d61e70cbcc9eb7fae2cd8ae350392" exitCode=0
Jul 10 19:05:01.968743 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:01.968701    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f" event={"ID":"80d44188-5341-4f51-bddc-56106c2c3475","Type":"ContainerDied","Data":"35e6c507fe04ca97a3e85d1026f917747d5d61e70cbcc9eb7fae2cd8ae350392"}
Jul 10 19:05:02.973935 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:02.973846    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f" event={"ID":"80d44188-5341-4f51-bddc-56106c2c3475","Type":"ContainerStarted","Data":"a71753137a235cd2bf79fa6a3028a154e059ec485a2751ab331335828d6cc66c"}
Jul 10 19:05:02.974355 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:02.973964    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:05:03.034951 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:03.034897    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f" podStartSLOduration=1.616377358 podStartE2EDuration="6.034880656s" totalImagesPullingTime="3.366620163s" totalInitContainerRuntime="1.051883135s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:03.032571802 +0000 UTC m=+392.221096973" watchObservedRunningTime="2026-07-10 19:05:03.034880656 +0000 UTC m=+392.223405828"
Jul 10 19:05:13.979741 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:13.979703    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cfcf59dd-vsn6f"
Jul 10 19:05:20.242936 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.242896    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-697457d895-l5x9x"]
Jul 10 19:05:20.250655 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.250638    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.267723 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.267698    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sdgrg\""
Jul 10 19:05:20.269420 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.269407    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 19:05:20.281383 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.281365    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 19:05:20.283254 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.283239    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 19:05:20.284181 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.284166    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 19:05:20.306461 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.306437    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-697457d895-l5x9x"]
Jul 10 19:05:20.341828 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.341800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041d4d30-f150-4bb8-aa28-2f62f57619bb-tmp\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.341964 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.341873    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041d4d30-f150-4bb8-aa28-2f62f57619bb-tls-certs\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.341964 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.341904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svmmw\" (UniqueName: \"kubernetes.io/projected/041d4d30-f150-4bb8-aa28-2f62f57619bb-kube-api-access-svmmw\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.443028 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.442991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041d4d30-f150-4bb8-aa28-2f62f57619bb-tls-certs\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.443028 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.443030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svmmw\" (UniqueName: \"kubernetes.io/projected/041d4d30-f150-4bb8-aa28-2f62f57619bb-kube-api-access-svmmw\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.443287 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.443182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041d4d30-f150-4bb8-aa28-2f62f57619bb-tmp\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.445323 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.445302    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041d4d30-f150-4bb8-aa28-2f62f57619bb-tmp\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.445546 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.445529    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041d4d30-f150-4bb8-aa28-2f62f57619bb-tls-certs\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.510830 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.510773    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svmmw\" (UniqueName: \"kubernetes.io/projected/041d4d30-f150-4bb8-aa28-2f62f57619bb-kube-api-access-svmmw\") pod \"kube-auth-proxy-697457d895-l5x9x\" (UID: \"041d4d30-f150-4bb8-aa28-2f62f57619bb\") " pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.559985 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.559960    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x"
Jul 10 19:05:20.755683 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:05:20.755651    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041d4d30_f150_4bb8_aa28_2f62f57619bb.slice/crio-6fd69c69700b57704f9b79d16eef457afe18056bb17b8f3740bd4af2c08472cf WatchSource:0}: Error finding container 6fd69c69700b57704f9b79d16eef457afe18056bb17b8f3740bd4af2c08472cf: Status 404 returned error can't find the container with id 6fd69c69700b57704f9b79d16eef457afe18056bb17b8f3740bd4af2c08472cf
Jul 10 19:05:20.755793 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:20.755735    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-697457d895-l5x9x"]
Jul 10 19:05:21.044904 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:21.044867    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x" event={"ID":"041d4d30-f150-4bb8-aa28-2f62f57619bb","Type":"ContainerStarted","Data":"6fd69c69700b57704f9b79d16eef457afe18056bb17b8f3740bd4af2c08472cf"}
Jul 10 19:05:23.054273 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:23.054189    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x" event={"ID":"041d4d30-f150-4bb8-aa28-2f62f57619bb","Type":"ContainerStarted","Data":"a6d33cb33dee94a536ea66262133e17ad74cdf72e2d8ed722af175048f632715"}
Jul 10 19:05:27.245991 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.245933    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-697457d895-l5x9x" podStartSLOduration=5.248256154 podStartE2EDuration="7.245913051s" totalImagesPullingTime="1.997656897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:23.151676019 +0000 UTC m=+412.340201191" watchObservedRunningTime="2026-07-10 19:05:27.245913051 +0000 UTC m=+416.434438222"
Jul 10 19:05:27.246404 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.246268    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"]
Jul 10 19:05:27.248389 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.248373    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.253619 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.253596    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 19:05:27.253753 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.253668    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 19:05:27.253753 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.253683    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ht7f4\""
Jul 10 19:05:27.262605 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.262584    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"]
Jul 10 19:05:27.274640 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.274623    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 19:05:27.296884 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.296860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83d43444-5674-4518-8bf7-90efbe12fd6b-manager-config\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.297023 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.296902    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lpr\" (UniqueName: \"kubernetes.io/projected/83d43444-5674-4518-8bf7-90efbe12fd6b-kube-api-access-c4lpr\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.297023 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.296953    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83d43444-5674-4518-8bf7-90efbe12fd6b-cert\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.297023 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.296991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83d43444-5674-4518-8bf7-90efbe12fd6b-metrics-cert\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.397563 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.397531    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83d43444-5674-4518-8bf7-90efbe12fd6b-metrics-cert\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.397719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.397596    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83d43444-5674-4518-8bf7-90efbe12fd6b-manager-config\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.397719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.397620    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lpr\" (UniqueName: \"kubernetes.io/projected/83d43444-5674-4518-8bf7-90efbe12fd6b-kube-api-access-c4lpr\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.397719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.397645    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83d43444-5674-4518-8bf7-90efbe12fd6b-cert\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.398315 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.398289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83d43444-5674-4518-8bf7-90efbe12fd6b-manager-config\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.400055 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.400031    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83d43444-5674-4518-8bf7-90efbe12fd6b-metrics-cert\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.400178 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.400080    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83d43444-5674-4518-8bf7-90efbe12fd6b-cert\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.419052 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.419026    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lpr\" (UniqueName: \"kubernetes.io/projected/83d43444-5674-4518-8bf7-90efbe12fd6b-kube-api-access-c4lpr\") pod \"lws-controller-manager-5b69967895-4dhns\" (UID: \"83d43444-5674-4518-8bf7-90efbe12fd6b\") " pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.556637 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.556565    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:27.728903 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:27.728868    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"]
Jul 10 19:05:27.733123 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:05:27.733098    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d43444_5674_4518_8bf7_90efbe12fd6b.slice/crio-cc0ad721f42a636e6b24e84c1d67d5f9e78bcea63df7ba38dc789c686374c258 WatchSource:0}: Error finding container cc0ad721f42a636e6b24e84c1d67d5f9e78bcea63df7ba38dc789c686374c258: Status 404 returned error can't find the container with id cc0ad721f42a636e6b24e84c1d67d5f9e78bcea63df7ba38dc789c686374c258
Jul 10 19:05:28.075678 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:28.075641    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns" event={"ID":"83d43444-5674-4518-8bf7-90efbe12fd6b","Type":"ContainerStarted","Data":"cc0ad721f42a636e6b24e84c1d67d5f9e78bcea63df7ba38dc789c686374c258"}
Jul 10 19:05:30.084984 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:30.084948    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns" event={"ID":"83d43444-5674-4518-8bf7-90efbe12fd6b","Type":"ContainerStarted","Data":"7dfb072cecb0a7436cdcf4a7de1b867f2cacf43e77eec390dadeadde340741a8"}
Jul 10 19:05:30.085423 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:30.085056    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:05:30.146096 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:30.146041    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns" podStartSLOduration=1.799331327 podStartE2EDuration="3.146025993s" totalImagesPullingTime="1.346694666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:30.134290629 +0000 UTC m=+419.322815800" watchObservedRunningTime="2026-07-10 19:05:30.146025993 +0000 UTC m=+419.334551164"
Jul 10 19:05:41.090959 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:05:41.090927    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b69967895-4dhns"
Jul 10 19:06:53.891446 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.891405    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fbff55c-hf569"]
Jul 10 19:06:53.893820 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.893794    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:53.914699 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.914669    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fbff55c-hf569"]
Jul 10 19:06:53.958866 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.958834    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-config\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:53.959016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.958880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr4j5\" (UniqueName: \"kubernetes.io/projected/067e8c21-dd0a-4b49-a699-6eac8446b64c-kube-api-access-zr4j5\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:53.959016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.958910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-service-ca\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:53.959016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.958961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-serving-cert\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:53.959016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.958986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-oauth-config\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:53.959016 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.959012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-trusted-ca-bundle\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:53.959224 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:53.959039    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-oauth-serving-cert\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.059677 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.059640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-service-ca\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.059677 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.059680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-serving-cert\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.059920 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.059702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-oauth-config\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.059920 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.059718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-trusted-ca-bundle\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.059920 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.059743    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-oauth-serving-cert\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.059920 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.059791    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-config\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.059920 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.059813    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr4j5\" (UniqueName: \"kubernetes.io/projected/067e8c21-dd0a-4b49-a699-6eac8446b64c-kube-api-access-zr4j5\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.060561 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.060533    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-service-ca\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.060686 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.060589    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-oauth-serving-cert\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.060686 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.060647    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-config\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.060844 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.060821    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067e8c21-dd0a-4b49-a699-6eac8446b64c-trusted-ca-bundle\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.062397 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.062370    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-oauth-config\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.062491 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.062426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/067e8c21-dd0a-4b49-a699-6eac8446b64c-console-serving-cert\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.076329 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.076305    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr4j5\" (UniqueName: \"kubernetes.io/projected/067e8c21-dd0a-4b49-a699-6eac8446b64c-kube-api-access-zr4j5\") pod \"console-54fbff55c-hf569\" (UID: \"067e8c21-dd0a-4b49-a699-6eac8446b64c\") " pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.203927 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.203843    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:06:54.356665 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.356641    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fbff55c-hf569"]
Jul 10 19:06:54.358861 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:06:54.358838    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067e8c21_dd0a_4b49_a699_6eac8446b64c.slice/crio-ece2180a1b91291e5624f38282605ad0fc81c3e7e12ec31ce2fc7ba1dbb86b9f WatchSource:0}: Error finding container ece2180a1b91291e5624f38282605ad0fc81c3e7e12ec31ce2fc7ba1dbb86b9f: Status 404 returned error can't find the container with id ece2180a1b91291e5624f38282605ad0fc81c3e7e12ec31ce2fc7ba1dbb86b9f
Jul 10 19:06:54.409941 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.409909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fbff55c-hf569" event={"ID":"067e8c21-dd0a-4b49-a699-6eac8446b64c","Type":"ContainerStarted","Data":"8fc2f7e9b468cb4041f2e2d402aa6337ca620b368b72a14846f765015164be21"}
Jul 10 19:06:54.410058 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:54.409967    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fbff55c-hf569" event={"ID":"067e8c21-dd0a-4b49-a699-6eac8446b64c","Type":"ContainerStarted","Data":"ece2180a1b91291e5624f38282605ad0fc81c3e7e12ec31ce2fc7ba1dbb86b9f"}
Jul 10 19:06:55.435813 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:06:55.435762    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54fbff55c-hf569" podStartSLOduration=2.435746352 podStartE2EDuration="2.435746352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:06:55.435309139 +0000 UTC m=+504.623834314" watchObservedRunningTime="2026-07-10 19:06:55.435746352 +0000 UTC m=+504.624271524"
Jul 10 19:07:04.204213 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:04.204172    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:07:04.204655 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:04.204246    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:07:04.209056 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:04.209036    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:07:04.451760 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:04.451732    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54fbff55c-hf569"
Jul 10 19:07:04.503255 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:04.503225    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c7cc58d5-9sg6t"]
Jul 10 19:07:29.524635 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.524553    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59c7cc58d5-9sg6t" podUID="51ea04b5-0963-4b8f-82c4-10e619e65a9d" containerName="console" containerID="cri-o://74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1" gracePeriod=15
Jul 10 19:07:29.760468 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.760443    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:07:29.851898 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.851825    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-service-ca\") pod \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") "
Jul 10 19:07:29.852042 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.851900    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzfqr\" (UniqueName: \"kubernetes.io/projected/51ea04b5-0963-4b8f-82c4-10e619e65a9d-kube-api-access-nzfqr\") pod \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") "
Jul 10 19:07:29.852042 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.851920    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-oauth-config\") pod \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") "
Jul 10 19:07:29.852042 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.851947    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-oauth-serving-cert\") pod \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") "
Jul 10 19:07:29.852042 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.851988    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-serving-cert\") pod \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") "
Jul 10 19:07:29.852042 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.852006    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-trusted-ca-bundle\") pod \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") "
Jul 10 19:07:29.852334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.852167    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-config\") pod \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\" (UID: \"51ea04b5-0963-4b8f-82c4-10e619e65a9d\") "
Jul 10 19:07:29.852334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.852308    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "51ea04b5-0963-4b8f-82c4-10e619e65a9d" (UID: "51ea04b5-0963-4b8f-82c4-10e619e65a9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:29.852450 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.852425    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-service-ca\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:07:29.852554 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.852450    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51ea04b5-0963-4b8f-82c4-10e619e65a9d" (UID: "51ea04b5-0963-4b8f-82c4-10e619e65a9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:29.852674 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.852556    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51ea04b5-0963-4b8f-82c4-10e619e65a9d" (UID: "51ea04b5-0963-4b8f-82c4-10e619e65a9d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:29.852674 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.852636    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-config" (OuterVolumeSpecName: "console-config") pod "51ea04b5-0963-4b8f-82c4-10e619e65a9d" (UID: "51ea04b5-0963-4b8f-82c4-10e619e65a9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:29.854201 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.854167    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51ea04b5-0963-4b8f-82c4-10e619e65a9d" (UID: "51ea04b5-0963-4b8f-82c4-10e619e65a9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:07:29.854288 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.854237    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51ea04b5-0963-4b8f-82c4-10e619e65a9d" (UID: "51ea04b5-0963-4b8f-82c4-10e619e65a9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:07:29.854288 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.854270    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ea04b5-0963-4b8f-82c4-10e619e65a9d-kube-api-access-nzfqr" (OuterVolumeSpecName: "kube-api-access-nzfqr") pod "51ea04b5-0963-4b8f-82c4-10e619e65a9d" (UID: "51ea04b5-0963-4b8f-82c4-10e619e65a9d"). InnerVolumeSpecName "kube-api-access-nzfqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:07:29.953448 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.953414    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:07:29.953448 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.953443    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzfqr\" (UniqueName: \"kubernetes.io/projected/51ea04b5-0963-4b8f-82c4-10e619e65a9d-kube-api-access-nzfqr\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:07:29.953645 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.953466    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-oauth-config\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:07:29.953645 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.953480    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-oauth-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:07:29.953645 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.953492    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51ea04b5-0963-4b8f-82c4-10e619e65a9d-console-serving-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:07:29.953645 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:29.953503    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51ea04b5-0963-4b8f-82c4-10e619e65a9d-trusted-ca-bundle\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:07:30.549124 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.549088    2556 generic.go:356] "Generic (PLEG): container finished" podID="51ea04b5-0963-4b8f-82c4-10e619e65a9d" containerID="74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1" exitCode=0
Jul 10 19:07:30.549124 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.549128    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c7cc58d5-9sg6t"
Jul 10 19:07:30.549590 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.549167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c7cc58d5-9sg6t" event={"ID":"51ea04b5-0963-4b8f-82c4-10e619e65a9d","Type":"ContainerDied","Data":"74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1"}
Jul 10 19:07:30.549590 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.549214    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c7cc58d5-9sg6t" event={"ID":"51ea04b5-0963-4b8f-82c4-10e619e65a9d","Type":"ContainerDied","Data":"097acee3cf36f47d0cf1bc8c6875a1f52974cc4c63ad9646047cbe3b1cca9559"}
Jul 10 19:07:30.549590 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.549240    2556 scope.go:117] "RemoveContainer" containerID="74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1"
Jul 10 19:07:30.557908 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.557886    2556 scope.go:117] "RemoveContainer" containerID="74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1"
Jul 10 19:07:30.558257 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:07:30.558137    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1\": container with ID starting with 74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1 not found: ID does not exist" containerID="74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1"
Jul 10 19:07:30.558322 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.558268    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1"} err="failed to get container status \"74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1\": rpc error: code = NotFound desc = could not find container \"74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1\": container with ID starting with 74ad56f8f217ec5800492150e15e5b9a911a550f12187b53524d12c205964bf1 not found: ID does not exist"
Jul 10 19:07:30.571254 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.571233    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c7cc58d5-9sg6t"]
Jul 10 19:07:30.575508 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:30.575487    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c7cc58d5-9sg6t"]
Jul 10 19:07:31.352938 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:31.352899    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ea04b5-0963-4b8f-82c4-10e619e65a9d" path="/var/lib/kubelet/pods/51ea04b5-0963-4b8f-82c4-10e619e65a9d/volumes"
Jul 10 19:07:55.249313 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.249278    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:07:55.249752 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.249569    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ea04b5-0963-4b8f-82c4-10e619e65a9d" containerName="console"
Jul 10 19:07:55.249752 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.249581    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ea04b5-0963-4b8f-82c4-10e619e65a9d" containerName="console"
Jul 10 19:07:55.249752 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.249634    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ea04b5-0963-4b8f-82c4-10e619e65a9d" containerName="console"
Jul 10 19:07:55.251377 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.251362    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.253760 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.253733    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 19:07:55.253879 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.253741    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4d9qg\""
Jul 10 19:07:55.253935 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.253892    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 19:07:55.254556 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.254535    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 19:07:55.259706 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.259683    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:07:55.298660 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.298638    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:07:55.348629 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.348604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5dg\" (UniqueName: \"kubernetes.io/projected/c4cb302a-f6aa-4b4e-8242-0af29dcd16c8-kube-api-access-ft5dg\") pod \"limitador-limitador-54d6d988d5-27xwk\" (UID: \"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.348764 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.348647    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4cb302a-f6aa-4b4e-8242-0af29dcd16c8-config-file\") pod \"limitador-limitador-54d6d988d5-27xwk\" (UID: \"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.449316 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.449270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5dg\" (UniqueName: \"kubernetes.io/projected/c4cb302a-f6aa-4b4e-8242-0af29dcd16c8-kube-api-access-ft5dg\") pod \"limitador-limitador-54d6d988d5-27xwk\" (UID: \"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.449316 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.449319    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4cb302a-f6aa-4b4e-8242-0af29dcd16c8-config-file\") pod \"limitador-limitador-54d6d988d5-27xwk\" (UID: \"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.449894 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.449876    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4cb302a-f6aa-4b4e-8242-0af29dcd16c8-config-file\") pod \"limitador-limitador-54d6d988d5-27xwk\" (UID: \"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.457831 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.457807    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5dg\" (UniqueName: \"kubernetes.io/projected/c4cb302a-f6aa-4b4e-8242-0af29dcd16c8-kube-api-access-ft5dg\") pod \"limitador-limitador-54d6d988d5-27xwk\" (UID: \"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.561616 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.561538    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:07:55.664432 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.664402    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-k5wm8"]
Jul 10 19:07:55.667409 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.667389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k5wm8"
Jul 10 19:07:55.669739 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.669714    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8d4jn\""
Jul 10 19:07:55.677142 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.677116    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k5wm8"]
Jul 10 19:07:55.691674 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.691655    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:07:55.694265 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:07:55.694238    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cb302a_f6aa_4b4e_8242_0af29dcd16c8.slice/crio-b4613d99408c289a635564a240ab40af057ac691e11e3f0226a5b4d597503f24 WatchSource:0}: Error finding container b4613d99408c289a635564a240ab40af057ac691e11e3f0226a5b4d597503f24: Status 404 returned error can't find the container with id b4613d99408c289a635564a240ab40af057ac691e11e3f0226a5b4d597503f24
Jul 10 19:07:55.751917 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.751892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5v5h\" (UniqueName: \"kubernetes.io/projected/d83498f9-1a75-4346-aae0-443450d8d6c1-kube-api-access-w5v5h\") pod \"authorino-58cd955675-k5wm8\" (UID: \"d83498f9-1a75-4346-aae0-443450d8d6c1\") " pod="kuadrant-system/authorino-58cd955675-k5wm8"
Jul 10 19:07:55.853255 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.853192    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5v5h\" (UniqueName: \"kubernetes.io/projected/d83498f9-1a75-4346-aae0-443450d8d6c1-kube-api-access-w5v5h\") pod \"authorino-58cd955675-k5wm8\" (UID: \"d83498f9-1a75-4346-aae0-443450d8d6c1\") " pod="kuadrant-system/authorino-58cd955675-k5wm8"
Jul 10 19:07:55.862182 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.862138    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5v5h\" (UniqueName: \"kubernetes.io/projected/d83498f9-1a75-4346-aae0-443450d8d6c1-kube-api-access-w5v5h\") pod \"authorino-58cd955675-k5wm8\" (UID: \"d83498f9-1a75-4346-aae0-443450d8d6c1\") " pod="kuadrant-system/authorino-58cd955675-k5wm8"
Jul 10 19:07:55.978249 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:55.978219    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k5wm8"
Jul 10 19:07:56.100801 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:56.100769    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k5wm8"]
Jul 10 19:07:56.103834 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:07:56.103769    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd83498f9_1a75_4346_aae0_443450d8d6c1.slice/crio-12738ab0e0c29cd6f75dfdb511d48c4764b2f2a379e8c3d30b641927457ea4ad WatchSource:0}: Error finding container 12738ab0e0c29cd6f75dfdb511d48c4764b2f2a379e8c3d30b641927457ea4ad: Status 404 returned error can't find the container with id 12738ab0e0c29cd6f75dfdb511d48c4764b2f2a379e8c3d30b641927457ea4ad
Jul 10 19:07:56.648469 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:56.648432    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k5wm8" event={"ID":"d83498f9-1a75-4346-aae0-443450d8d6c1","Type":"ContainerStarted","Data":"12738ab0e0c29cd6f75dfdb511d48c4764b2f2a379e8c3d30b641927457ea4ad"}
Jul 10 19:07:56.649796 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:07:56.649757    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk" event={"ID":"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8","Type":"ContainerStarted","Data":"b4613d99408c289a635564a240ab40af057ac691e11e3f0226a5b4d597503f24"}
Jul 10 19:08:00.301912 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:00.301876    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k5wm8"]
Jul 10 19:08:00.669829 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:00.669731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k5wm8" event={"ID":"d83498f9-1a75-4346-aae0-443450d8d6c1","Type":"ContainerStarted","Data":"090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f"}
Jul 10 19:08:00.671162 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:00.671124    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk" event={"ID":"c4cb302a-f6aa-4b4e-8242-0af29dcd16c8","Type":"ContainerStarted","Data":"637533adbc07b1d7c210671619211990022b496147a52a06c3837258840e9f2c"}
Jul 10 19:08:00.671289 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:00.671276    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:08:00.685825 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:00.685774    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-k5wm8" podStartSLOduration=1.7589359359999999 podStartE2EDuration="5.685760066s" totalImagesPullingTime="3.92682413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:00.684660601 +0000 UTC m=+569.873185773" watchObservedRunningTime="2026-07-10 19:08:00.685760066 +0000 UTC m=+569.874285237"
Jul 10 19:08:00.702068 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:00.702026    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk" podStartSLOduration=1.426000845 podStartE2EDuration="5.702010819s" totalImagesPullingTime="4.276009974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:00.701172074 +0000 UTC m=+569.889697247" watchObservedRunningTime="2026-07-10 19:08:00.702010819 +0000 UTC m=+569.890535990"
Jul 10 19:08:01.675448 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:01.675402    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-k5wm8" podUID="d83498f9-1a75-4346-aae0-443450d8d6c1" containerName="authorino" containerID="cri-o://090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f" gracePeriod=30
Jul 10 19:08:01.921159 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:01.921126    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k5wm8"
Jul 10 19:08:02.001898 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.001865    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5v5h\" (UniqueName: \"kubernetes.io/projected/d83498f9-1a75-4346-aae0-443450d8d6c1-kube-api-access-w5v5h\") pod \"d83498f9-1a75-4346-aae0-443450d8d6c1\" (UID: \"d83498f9-1a75-4346-aae0-443450d8d6c1\") "
Jul 10 19:08:02.003946 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.003922    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83498f9-1a75-4346-aae0-443450d8d6c1-kube-api-access-w5v5h" (OuterVolumeSpecName: "kube-api-access-w5v5h") pod "d83498f9-1a75-4346-aae0-443450d8d6c1" (UID: "d83498f9-1a75-4346-aae0-443450d8d6c1"). InnerVolumeSpecName "kube-api-access-w5v5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:08:02.103053 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.103012    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5v5h\" (UniqueName: \"kubernetes.io/projected/d83498f9-1a75-4346-aae0-443450d8d6c1-kube-api-access-w5v5h\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:08:02.680140 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.680102    2556 generic.go:356] "Generic (PLEG): container finished" podID="d83498f9-1a75-4346-aae0-443450d8d6c1" containerID="090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f" exitCode=0
Jul 10 19:08:02.680545 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.680142    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k5wm8"
Jul 10 19:08:02.680545 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.680189    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k5wm8" event={"ID":"d83498f9-1a75-4346-aae0-443450d8d6c1","Type":"ContainerDied","Data":"090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f"}
Jul 10 19:08:02.680545 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.680230    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k5wm8" event={"ID":"d83498f9-1a75-4346-aae0-443450d8d6c1","Type":"ContainerDied","Data":"12738ab0e0c29cd6f75dfdb511d48c4764b2f2a379e8c3d30b641927457ea4ad"}
Jul 10 19:08:02.680545 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.680252    2556 scope.go:117] "RemoveContainer" containerID="090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f"
Jul 10 19:08:02.688461 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.688445    2556 scope.go:117] "RemoveContainer" containerID="090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f"
Jul 10 19:08:02.688700 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:08:02.688680    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f\": container with ID starting with 090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f not found: ID does not exist" containerID="090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f"
Jul 10 19:08:02.688741 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.688709    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f"} err="failed to get container status \"090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f\": rpc error: code = NotFound desc = could not find container \"090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f\": container with ID starting with 090c9378e3a86ff3df58d7732468e478035cfa4121b87370b93dfd3715b5ec3f not found: ID does not exist"
Jul 10 19:08:02.699938 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.699909    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k5wm8"]
Jul 10 19:08:02.704105 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:02.704084    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-k5wm8"]
Jul 10 19:08:03.352610 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:03.352575    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83498f9-1a75-4346-aae0-443450d8d6c1" path="/var/lib/kubelet/pods/d83498f9-1a75-4346-aae0-443450d8d6c1/volumes"
Jul 10 19:08:11.676703 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:11.676674    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-27xwk"
Jul 10 19:08:28.940659 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.940625    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks5lz"]
Jul 10 19:08:28.941120 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.940917    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83498f9-1a75-4346-aae0-443450d8d6c1" containerName="authorino"
Jul 10 19:08:28.941120 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.940932    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83498f9-1a75-4346-aae0-443450d8d6c1" containerName="authorino"
Jul 10 19:08:28.941120 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.940988    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83498f9-1a75-4346-aae0-443450d8d6c1" containerName="authorino"
Jul 10 19:08:28.943744 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.943726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks5lz"
Jul 10 19:08:28.946209 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.946184    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8d4jn\""
Jul 10 19:08:28.948311 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.948285    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks5lz"]
Jul 10 19:08:28.999740 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:28.999713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rw87\" (UniqueName: \"kubernetes.io/projected/4b78523d-4700-44ef-9ba9-215e26fa5c2a-kube-api-access-9rw87\") pod \"authorino-5d4b67c446-ks5lz\" (UID: \"4b78523d-4700-44ef-9ba9-215e26fa5c2a\") " pod="kuadrant-system/authorino-5d4b67c446-ks5lz"
Jul 10 19:08:29.101091 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.101046    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rw87\" (UniqueName: \"kubernetes.io/projected/4b78523d-4700-44ef-9ba9-215e26fa5c2a-kube-api-access-9rw87\") pod \"authorino-5d4b67c446-ks5lz\" (UID: \"4b78523d-4700-44ef-9ba9-215e26fa5c2a\") " pod="kuadrant-system/authorino-5d4b67c446-ks5lz"
Jul 10 19:08:29.109329 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.109295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rw87\" (UniqueName: \"kubernetes.io/projected/4b78523d-4700-44ef-9ba9-215e26fa5c2a-kube-api-access-9rw87\") pod \"authorino-5d4b67c446-ks5lz\" (UID: \"4b78523d-4700-44ef-9ba9-215e26fa5c2a\") " pod="kuadrant-system/authorino-5d4b67c446-ks5lz"
Jul 10 19:08:29.172100 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.172068    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks5lz"]
Jul 10 19:08:29.172292 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.172280    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks5lz"
Jul 10 19:08:29.204394 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.204318    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b8f5b8dc6-zlrgc"]
Jul 10 19:08:29.207724 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.207707    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc"
Jul 10 19:08:29.218538 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.218512    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b8f5b8dc6-zlrgc"]
Jul 10 19:08:29.299561 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.299521    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks5lz"]
Jul 10 19:08:29.302097 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.302067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m5kf\" (UniqueName: \"kubernetes.io/projected/15d0bd69-33f4-4a43-a0ee-520489625f50-kube-api-access-2m5kf\") pod \"authorino-b8f5b8dc6-zlrgc\" (UID: \"15d0bd69-33f4-4a43-a0ee-520489625f50\") " pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc"
Jul 10 19:08:29.302097 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:08:29.302078    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b78523d_4700_44ef_9ba9_215e26fa5c2a.slice/crio-af57caed6386c71a845099a367a34425513be8b4818e4cb6c7cfcaa552502bc1 WatchSource:0}: Error finding container af57caed6386c71a845099a367a34425513be8b4818e4cb6c7cfcaa552502bc1: Status 404 returned error can't find the container with id af57caed6386c71a845099a367a34425513be8b4818e4cb6c7cfcaa552502bc1
Jul 10 19:08:29.391796 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.391760    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8f5b8dc6-zlrgc"]
Jul 10 19:08:29.392030 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:08:29.392007    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2m5kf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc" podUID="15d0bd69-33f4-4a43-a0ee-520489625f50"
Jul 10 19:08:29.402657 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.402631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m5kf\" (UniqueName: \"kubernetes.io/projected/15d0bd69-33f4-4a43-a0ee-520489625f50-kube-api-access-2m5kf\") pod \"authorino-b8f5b8dc6-zlrgc\" (UID: \"15d0bd69-33f4-4a43-a0ee-520489625f50\") " pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc"
Jul 10 19:08:29.413561 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.413532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m5kf\" (UniqueName: \"kubernetes.io/projected/15d0bd69-33f4-4a43-a0ee-520489625f50-kube-api-access-2m5kf\") pod \"authorino-b8f5b8dc6-zlrgc\" (UID: \"15d0bd69-33f4-4a43-a0ee-520489625f50\") " pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc"
Jul 10 19:08:29.418598 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.418574    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9dc6fc6d4-6n9ch"]
Jul 10 19:08:29.422233 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.422140    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.424576 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.424558    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 19:08:29.429028 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.429003    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9dc6fc6d4-6n9ch"]
Jul 10 19:08:29.503020 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.502992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg92b\" (UniqueName: \"kubernetes.io/projected/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-kube-api-access-gg92b\") pod \"authorino-9dc6fc6d4-6n9ch\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") " pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.503189 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.503047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-tls-cert\") pod \"authorino-9dc6fc6d4-6n9ch\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") " pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.603435 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.603404    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg92b\" (UniqueName: \"kubernetes.io/projected/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-kube-api-access-gg92b\") pod \"authorino-9dc6fc6d4-6n9ch\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") " pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.603586 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.603458    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-tls-cert\") pod \"authorino-9dc6fc6d4-6n9ch\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") " pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.605720 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.605692    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-tls-cert\") pod \"authorino-9dc6fc6d4-6n9ch\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") " pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.611411 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.611391    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg92b\" (UniqueName: \"kubernetes.io/projected/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-kube-api-access-gg92b\") pod \"authorino-9dc6fc6d4-6n9ch\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") " pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.732363 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.732336    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:08:29.784724 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.784705    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc"
Jul 10 19:08:29.784840 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.784706    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks5lz" event={"ID":"4b78523d-4700-44ef-9ba9-215e26fa5c2a","Type":"ContainerStarted","Data":"af57caed6386c71a845099a367a34425513be8b4818e4cb6c7cfcaa552502bc1"}
Jul 10 19:08:29.797119 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.797096    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc"
Jul 10 19:08:29.873423 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.873299    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9dc6fc6d4-6n9ch"]
Jul 10 19:08:29.876527 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:08:29.876501    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod074f7202_71a8_4dd5_98fb_91a04eb6b1ba.slice/crio-ea0b69fa3f5203615535fc994e45b5a511e53eeae4a1505b36cc13c129c5b211 WatchSource:0}: Error finding container ea0b69fa3f5203615535fc994e45b5a511e53eeae4a1505b36cc13c129c5b211: Status 404 returned error can't find the container with id ea0b69fa3f5203615535fc994e45b5a511e53eeae4a1505b36cc13c129c5b211
Jul 10 19:08:29.906004 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.905972    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m5kf\" (UniqueName: \"kubernetes.io/projected/15d0bd69-33f4-4a43-a0ee-520489625f50-kube-api-access-2m5kf\") pod \"15d0bd69-33f4-4a43-a0ee-520489625f50\" (UID: \"15d0bd69-33f4-4a43-a0ee-520489625f50\") "
Jul 10 19:08:29.908091 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:29.908068    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d0bd69-33f4-4a43-a0ee-520489625f50-kube-api-access-2m5kf" (OuterVolumeSpecName: "kube-api-access-2m5kf") pod "15d0bd69-33f4-4a43-a0ee-520489625f50" (UID: "15d0bd69-33f4-4a43-a0ee-520489625f50"). InnerVolumeSpecName "kube-api-access-2m5kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:08:30.007143 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.007110    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m5kf\" (UniqueName: \"kubernetes.io/projected/15d0bd69-33f4-4a43-a0ee-520489625f50-kube-api-access-2m5kf\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:08:30.789945 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.789909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch" event={"ID":"074f7202-71a8-4dd5-98fb-91a04eb6b1ba","Type":"ContainerStarted","Data":"01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34"}
Jul 10 19:08:30.789945 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.789950    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch" event={"ID":"074f7202-71a8-4dd5-98fb-91a04eb6b1ba","Type":"ContainerStarted","Data":"ea0b69fa3f5203615535fc994e45b5a511e53eeae4a1505b36cc13c129c5b211"}
Jul 10 19:08:30.791321 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.791302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8f5b8dc6-zlrgc"
Jul 10 19:08:30.791435 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.791323    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks5lz" event={"ID":"4b78523d-4700-44ef-9ba9-215e26fa5c2a","Type":"ContainerStarted","Data":"727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f"}
Jul 10 19:08:30.791435 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.791349    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ks5lz" podUID="4b78523d-4700-44ef-9ba9-215e26fa5c2a" containerName="authorino" containerID="cri-o://727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f" gracePeriod=30
Jul 10 19:08:30.807109 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.807069    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch" podStartSLOduration=1.4433838350000001 podStartE2EDuration="1.807056466s" totalImagesPullingTime="363.672631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:30.806512932 +0000 UTC m=+599.995038105" watchObservedRunningTime="2026-07-10 19:08:30.807056466 +0000 UTC m=+599.995581640"
Jul 10 19:08:30.828005 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.827975    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8f5b8dc6-zlrgc"]
Jul 10 19:08:30.834955 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.834924    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b8f5b8dc6-zlrgc"]
Jul 10 19:08:30.851337 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:30.851281    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ks5lz" podStartSLOduration=2.408185444 podStartE2EDuration="2.851261111s" totalImagesPullingTime="443.075667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:30.850266154 +0000 UTC m=+600.038791326" watchObservedRunningTime="2026-07-10 19:08:30.851261111 +0000 UTC m=+600.039786285"
Jul 10 19:08:31.026215 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.026187    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks5lz"
Jul 10 19:08:31.118198 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.118177    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rw87\" (UniqueName: \"kubernetes.io/projected/4b78523d-4700-44ef-9ba9-215e26fa5c2a-kube-api-access-9rw87\") pod \"4b78523d-4700-44ef-9ba9-215e26fa5c2a\" (UID: \"4b78523d-4700-44ef-9ba9-215e26fa5c2a\") "
Jul 10 19:08:31.120092 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.120069    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b78523d-4700-44ef-9ba9-215e26fa5c2a-kube-api-access-9rw87" (OuterVolumeSpecName: "kube-api-access-9rw87") pod "4b78523d-4700-44ef-9ba9-215e26fa5c2a" (UID: "4b78523d-4700-44ef-9ba9-215e26fa5c2a"). InnerVolumeSpecName "kube-api-access-9rw87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:08:31.219272 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.219244    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rw87\" (UniqueName: \"kubernetes.io/projected/4b78523d-4700-44ef-9ba9-215e26fa5c2a-kube-api-access-9rw87\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:08:31.234997 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.234974    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:08:31.239684 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.239664    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:08:31.240873 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.240855    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:08:31.245956 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.245938    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:08:31.353115 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.353086    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d0bd69-33f4-4a43-a0ee-520489625f50" path="/var/lib/kubelet/pods/15d0bd69-33f4-4a43-a0ee-520489625f50/volumes"
Jul 10 19:08:31.796888 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.796856    2556 generic.go:356] "Generic (PLEG): container finished" podID="4b78523d-4700-44ef-9ba9-215e26fa5c2a" containerID="727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f" exitCode=0
Jul 10 19:08:31.797066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.796899    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ks5lz"
Jul 10 19:08:31.797066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.796942    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks5lz" event={"ID":"4b78523d-4700-44ef-9ba9-215e26fa5c2a","Type":"ContainerDied","Data":"727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f"}
Jul 10 19:08:31.797066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.797004    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ks5lz" event={"ID":"4b78523d-4700-44ef-9ba9-215e26fa5c2a","Type":"ContainerDied","Data":"af57caed6386c71a845099a367a34425513be8b4818e4cb6c7cfcaa552502bc1"}
Jul 10 19:08:31.797066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.797026    2556 scope.go:117] "RemoveContainer" containerID="727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f"
Jul 10 19:08:31.805136 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.805121    2556 scope.go:117] "RemoveContainer" containerID="727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f"
Jul 10 19:08:31.805416 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:08:31.805399    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f\": container with ID starting with 727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f not found: ID does not exist" containerID="727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f"
Jul 10 19:08:31.805474 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.805424    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f"} err="failed to get container status \"727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f\": rpc error: code = NotFound desc = could not find container \"727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f\": container with ID starting with 727b18ac88bbd9f59f152ef24cdcf5f560d4fd3c25bb4426699cc688966d8b9f not found: ID does not exist"
Jul 10 19:08:31.813839 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.813819    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks5lz"]
Jul 10 19:08:31.819902 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:31.819880    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ks5lz"]
Jul 10 19:08:33.357278 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:08:33.357239    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b78523d-4700-44ef-9ba9-215e26fa5c2a" path="/var/lib/kubelet/pods/4b78523d-4700-44ef-9ba9-215e26fa5c2a/volumes"
Jul 10 19:09:12.195387 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:09:12.195354    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:09:26.991105 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:09:26.991062    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:09:41.603026 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:09:41.602991    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:10:01.087864 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:01.087832    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:10:05.488620 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:05.488582    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:10:21.995096 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:21.995059    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:10:27.690630 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.690549    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"]
Jul 10 19:10:27.691059 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.690819    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b78523d-4700-44ef-9ba9-215e26fa5c2a" containerName="authorino"
Jul 10 19:10:27.691059 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.690829    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b78523d-4700-44ef-9ba9-215e26fa5c2a" containerName="authorino"
Jul 10 19:10:27.691059 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.690899    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b78523d-4700-44ef-9ba9-215e26fa5c2a" containerName="authorino"
Jul 10 19:10:27.692839 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.692818    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.696332 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.696308    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-plhxh\""
Jul 10 19:10:27.696465 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.696326    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 19:10:27.696465 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.696313    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 19:10:27.696465 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.696419    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 19:10:27.701952 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.701915    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"]
Jul 10 19:10:27.727542 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.727514    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.727646 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.727549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5aff3f-cec9-49c1-9102-b940d266828a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.727646 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.727585    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.727646 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.727602    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.727646 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.727625    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rrgm\" (UniqueName: \"kubernetes.io/projected/2b5aff3f-cec9-49c1-9102-b940d266828a-kube-api-access-7rrgm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.727778 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.727676    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.828566 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.828539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.828676 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.828582    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.828676 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.828616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5aff3f-cec9-49c1-9102-b940d266828a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.828676 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.828652    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.828842 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.828675    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.828842 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.828711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rrgm\" (UniqueName: \"kubernetes.io/projected/2b5aff3f-cec9-49c1-9102-b940d266828a-kube-api-access-7rrgm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.829027 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.829007    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.829083 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.829065    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.829120 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.829102    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.830972 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.830950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b5aff3f-cec9-49c1-9102-b940d266828a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.831133 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.831115    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b5aff3f-cec9-49c1-9102-b940d266828a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:27.838463 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:27.838437    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rrgm\" (UniqueName: \"kubernetes.io/projected/2b5aff3f-cec9-49c1-9102-b940d266828a-kube-api-access-7rrgm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf\" (UID: \"2b5aff3f-cec9-49c1-9102-b940d266828a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:28.003308 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:28.003278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:28.131477 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:28.131428    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"]
Jul 10 19:10:28.133624 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:10:28.133598    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b5aff3f_cec9_49c1_9102_b940d266828a.slice/crio-054171f13e4c4ef73ab9385c0588cbe61ac4c2c3e6ff30eb8d6e1059cbf6eb6e WatchSource:0}: Error finding container 054171f13e4c4ef73ab9385c0588cbe61ac4c2c3e6ff30eb8d6e1059cbf6eb6e: Status 404 returned error can't find the container with id 054171f13e4c4ef73ab9385c0588cbe61ac4c2c3e6ff30eb8d6e1059cbf6eb6e
Jul 10 19:10:28.134868 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:28.134849    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 19:10:28.263402 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:28.263314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf" event={"ID":"2b5aff3f-cec9-49c1-9102-b940d266828a","Type":"ContainerStarted","Data":"054171f13e4c4ef73ab9385c0588cbe61ac4c2c3e6ff30eb8d6e1059cbf6eb6e"}
Jul 10 19:10:30.273354 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:30.273314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf" event={"ID":"2b5aff3f-cec9-49c1-9102-b940d266828a","Type":"ContainerStarted","Data":"50447a36527a12ed5b47731634bbfb4d9c84f577b5c16b401a39ea5348580424"}
Jul 10 19:10:30.291405 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:30.291354    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf" podStartSLOduration=2.100747513 podStartE2EDuration="3.291339244s" totalImagesPullingTime="1.190591731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:10:30.290098682 +0000 UTC m=+719.478623869" watchObservedRunningTime="2026-07-10 19:10:30.291339244 +0000 UTC m=+719.479864415"
Jul 10 19:10:31.495610 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:31.495573    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:10:38.003731 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:38.003696    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:38.004170 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:38.003746    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:38.016287 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:38.016258    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:10:38.316779 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:10:38.316695    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf"
Jul 10 19:11:13.082648 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.082609    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c487c7465-nlnwj"]
Jul 10 19:11:13.085979 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.085962    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.094408 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.094379    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c487c7465-nlnwj"]
Jul 10 19:11:13.100114 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.100092    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5-tls-cert\") pod \"authorino-7c487c7465-nlnwj\" (UID: \"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5\") " pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.100263 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.100134    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl7ch\" (UniqueName: \"kubernetes.io/projected/5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5-kube-api-access-cl7ch\") pod \"authorino-7c487c7465-nlnwj\" (UID: \"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5\") " pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.200825 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.200787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5-tls-cert\") pod \"authorino-7c487c7465-nlnwj\" (UID: \"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5\") " pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.200973 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.200835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl7ch\" (UniqueName: \"kubernetes.io/projected/5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5-kube-api-access-cl7ch\") pod \"authorino-7c487c7465-nlnwj\" (UID: \"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5\") " pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.203159 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.203128    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5-tls-cert\") pod \"authorino-7c487c7465-nlnwj\" (UID: \"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5\") " pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.209780 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.209758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl7ch\" (UniqueName: \"kubernetes.io/projected/5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5-kube-api-access-cl7ch\") pod \"authorino-7c487c7465-nlnwj\" (UID: \"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5\") " pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.395793 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.395711    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c487c7465-nlnwj"
Jul 10 19:11:13.526470 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:13.526445    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c487c7465-nlnwj"]
Jul 10 19:11:13.528904 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:11:13.528868    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4a0f0a_8d18_42b5_b2db_8ae2d3dc35d5.slice/crio-7e25f0e2a077b586ee4e0861b5d935ffbe14eabb8b26122b28c1705bee739ba4 WatchSource:0}: Error finding container 7e25f0e2a077b586ee4e0861b5d935ffbe14eabb8b26122b28c1705bee739ba4: Status 404 returned error can't find the container with id 7e25f0e2a077b586ee4e0861b5d935ffbe14eabb8b26122b28c1705bee739ba4
Jul 10 19:11:14.466883 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.466840    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c487c7465-nlnwj" event={"ID":"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5","Type":"ContainerStarted","Data":"7e1a5d4f4195c8ef5ea9fd8e1dc95442b6c2d9b2431c0c84605817387276069f"}
Jul 10 19:11:14.466883 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.466888    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c487c7465-nlnwj" event={"ID":"5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5","Type":"ContainerStarted","Data":"7e25f0e2a077b586ee4e0861b5d935ffbe14eabb8b26122b28c1705bee739ba4"}
Jul 10 19:11:14.487607 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.487545    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c487c7465-nlnwj" podStartSLOduration=1.094871564 podStartE2EDuration="1.487522097s" totalImagesPullingTime="392.650533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:11:14.485838313 +0000 UTC m=+763.674363485" watchObservedRunningTime="2026-07-10 19:11:14.487522097 +0000 UTC m=+763.676047273"
Jul 10 19:11:14.515297 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.515268    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9dc6fc6d4-6n9ch"]
Jul 10 19:11:14.515502 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.515476    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch" podUID="074f7202-71a8-4dd5-98fb-91a04eb6b1ba" containerName="authorino" containerID="cri-o://01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34" gracePeriod=30
Jul 10 19:11:14.759767 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.759734    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:11:14.812045 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.812014    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-tls-cert\") pod \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") "
Jul 10 19:11:14.812248 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.812076    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg92b\" (UniqueName: \"kubernetes.io/projected/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-kube-api-access-gg92b\") pod \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\" (UID: \"074f7202-71a8-4dd5-98fb-91a04eb6b1ba\") "
Jul 10 19:11:14.814109 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.814080    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-kube-api-access-gg92b" (OuterVolumeSpecName: "kube-api-access-gg92b") pod "074f7202-71a8-4dd5-98fb-91a04eb6b1ba" (UID: "074f7202-71a8-4dd5-98fb-91a04eb6b1ba"). InnerVolumeSpecName "kube-api-access-gg92b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:11:14.821639 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.821602    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "074f7202-71a8-4dd5-98fb-91a04eb6b1ba" (UID: "074f7202-71a8-4dd5-98fb-91a04eb6b1ba"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:11:14.913041 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.913001    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-tls-cert\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:11:14.913041 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:14.913035    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg92b\" (UniqueName: \"kubernetes.io/projected/074f7202-71a8-4dd5-98fb-91a04eb6b1ba-kube-api-access-gg92b\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:11:15.472178 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.472059    2556 generic.go:356] "Generic (PLEG): container finished" podID="074f7202-71a8-4dd5-98fb-91a04eb6b1ba" containerID="01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34" exitCode=0
Jul 10 19:11:15.472178 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.472116    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch"
Jul 10 19:11:15.472696 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.472171    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch" event={"ID":"074f7202-71a8-4dd5-98fb-91a04eb6b1ba","Type":"ContainerDied","Data":"01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34"}
Jul 10 19:11:15.472696 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.472211    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dc6fc6d4-6n9ch" event={"ID":"074f7202-71a8-4dd5-98fb-91a04eb6b1ba","Type":"ContainerDied","Data":"ea0b69fa3f5203615535fc994e45b5a511e53eeae4a1505b36cc13c129c5b211"}
Jul 10 19:11:15.472696 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.472229    2556 scope.go:117] "RemoveContainer" containerID="01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34"
Jul 10 19:11:15.480648 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.480631    2556 scope.go:117] "RemoveContainer" containerID="01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34"
Jul 10 19:11:15.480928 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:11:15.480909    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34\": container with ID starting with 01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34 not found: ID does not exist" containerID="01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34"
Jul 10 19:11:15.480984 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.480939    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34"} err="failed to get container status \"01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34\": rpc error: code = NotFound desc = could not find container \"01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34\": container with ID starting with 01092d972b926eea6b0947f3c3e3f3c6cada93720faaa0d9b497a766ca112e34 not found: ID does not exist"
Jul 10 19:11:15.508105 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.508070    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9dc6fc6d4-6n9ch"]
Jul 10 19:11:15.517791 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:15.517763    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9dc6fc6d4-6n9ch"]
Jul 10 19:11:17.351712 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:17.351679    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="074f7202-71a8-4dd5-98fb-91a04eb6b1ba" path="/var/lib/kubelet/pods/074f7202-71a8-4dd5-98fb-91a04eb6b1ba/volumes"
Jul 10 19:11:41.097762 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:41.097727    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:11:50.597261 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:11:50.597226    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:12:01.788025 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:12:01.787991    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:12:12.187602 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:12:12.187566    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:12:21.787645 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:12:21.787608    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:12:49.701971 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:12:49.701932    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:13:03.884490 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:03.884448    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:13:31.258577 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:31.258503    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:13:31.262527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:31.262502    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:13:31.263715 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:31.263696    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:13:31.267488 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:31.267467    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:13:41.394761 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:41.394727    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:13:49.322216 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:49.322170    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:13:58.901141 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:13:58.901104    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:14:04.894796 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:14:04.894757    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:14:15.808038 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:14:15.807998    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:14:25.385547 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:14:25.385510    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:14:36.889591 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:14:36.889550    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:14:46.885785 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:14:46.885747    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:15:09.594328 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:15:09.594288    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:15:18.785733 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:15:18.785699    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:15:40.816722 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:15:40.816688    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:15:52.886442 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:15:52.886404    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:16:08.496210 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:16:08.496171    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:16:18.086854 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:16:18.086821    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:16:27.393113 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:16:27.393031    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:16:37.283412 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:16:37.283375    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:16:46.691709 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:16:46.691674    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:18:31.283007 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:18:31.282977    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:18:31.283976 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:18:31.283957    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:18:31.287878 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:18:31.287857    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:18:31.288843 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:18:31.288828    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:18:33.787998 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:18:33.787965    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:18:43.190227 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:18:43.190189    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:18:55.993534 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:18:55.993496    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:19:06.983793 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:19:06.983757    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:19:18.492480 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:19:18.492439    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:19:27.892325 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:19:27.892242    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:19:38.293192 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:19:38.293135    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:19:48.089439 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:19:48.089405    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:19:58.793770 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:19:58.793734    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:20:06.490195 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:20:06.490159    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:20:15.788581 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:20:15.788543    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:20:23.594648 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:20:23.594603    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:20:42.593905 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:20:42.593863    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:20:51.995691 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:20:51.995657    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:21:09.190881 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:21:09.190849    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:21:27.427258 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:21:27.427220    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:21:41.387413 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:21:41.387372    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:21:50.386703 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:21:50.386666    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:22:05.091989 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:22:05.091954    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:22:14.390198 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:22:14.390156    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:22:27.887622 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:22:27.887537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:22:37.300179 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:22:37.299577    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:22:46.897761 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:22:46.897723    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:22:59.500553 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:22:59.500521    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:23:11.504486 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:11.504444    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:23:19.691069 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:19.691038    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:23:31.306846 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:31.306820    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:23:31.307351 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:31.307015    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:23:31.311711 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:31.311693    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:23:31.311917 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:31.311756    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:23:32.793130 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:32.793093    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:23:44.596399 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:44.596364    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:23:56.285710 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:23:56.285629    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:24:07.990948 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:24:07.990916    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:24:17.490659 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:24:17.490626    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:24:27.188828 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:24:27.188793    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:24:40.281622 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:24:40.281580    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:25:46.989195 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:25:46.989161    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:26:02.793831 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:26:02.793793    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:27:18.886536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:27:18.886498    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:27:35.889137 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:27:35.889103    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:28:31.329880 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:28:31.329852    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:28:31.330543 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:28:31.330525    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:28:31.334957 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:28:31.334938    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:28:31.335454 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:28:31.335431    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:28:40.987834 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:28:40.987797    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:30:15.784974 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:30:15.784934    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:30:24.786984 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:30:24.786946    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:30:37.276757 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:30:37.276721    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:30:57.491955 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:30:57.491921    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:31:38.589377 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:31:38.589340    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:32:00.494475 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.494440    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"]
Jul 10 19:32:00.494932 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.494882    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="074f7202-71a8-4dd5-98fb-91a04eb6b1ba" containerName="authorino"
Jul 10 19:32:00.494932 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.494900    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="074f7202-71a8-4dd5-98fb-91a04eb6b1ba" containerName="authorino"
Jul 10 19:32:00.495046 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.494996    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="074f7202-71a8-4dd5-98fb-91a04eb6b1ba" containerName="authorino"
Jul 10 19:32:00.497885 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.497865    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.501230 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.501212    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cacc33b0\"/\"openshift-service-ca.crt\""
Jul 10 19:32:00.501455 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.501434    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cacc33b0\"/\"e2e-lifecycle-model-cacc33b0-kserve-self-signed-certs\""
Jul 10 19:32:00.501569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.501486    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cacc33b0\"/\"default-dockercfg-78ljd\""
Jul 10 19:32:00.501569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.501505    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cacc33b0\"/\"kube-root-ca.crt\""
Jul 10 19:32:00.506580 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.506560    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"]
Jul 10 19:32:00.586376 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.586346    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dfcd85-ca59-410a-962b-f39107f534d9-tls-certs\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.586532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.586383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-model-cache\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.586532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.586419    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv56q\" (UniqueName: \"kubernetes.io/projected/c9dfcd85-ca59-410a-962b-f39107f534d9-kube-api-access-sv56q\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.586532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.586474    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-tmp-dir\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.586639 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.586545    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-home\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.586639 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.586578    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-dshm\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.686925 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.686889    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-dshm\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.686925 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.686930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dfcd85-ca59-410a-962b-f39107f534d9-tls-certs\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.687185 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.686958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-model-cache\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.687185 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.687001    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv56q\" (UniqueName: \"kubernetes.io/projected/c9dfcd85-ca59-410a-962b-f39107f534d9-kube-api-access-sv56q\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.687185 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.687051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-tmp-dir\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.687185 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.687097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-home\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.687428 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.687402    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-model-cache\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.687475 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.687448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-home\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.687514 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.687498    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-tmp-dir\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.689276 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.689254    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-dshm\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.689486 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.689467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dfcd85-ca59-410a-962b-f39107f534d9-tls-certs\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.695832 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.695814    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv56q\" (UniqueName: \"kubernetes.io/projected/c9dfcd85-ca59-410a-962b-f39107f534d9-kube-api-access-sv56q\") pod \"e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") " pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.807514 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.807417    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:00.936997 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:00.936972    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"]
Jul 10 19:32:00.939474 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:32:00.939428    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9dfcd85_ca59_410a_962b_f39107f534d9.slice/crio-1c277638ac5fcafd16863ea147d76b812e0b8d51eb9277bbc7982563f4688699 WatchSource:0}: Error finding container 1c277638ac5fcafd16863ea147d76b812e0b8d51eb9277bbc7982563f4688699: Status 404 returned error can't find the container with id 1c277638ac5fcafd16863ea147d76b812e0b8d51eb9277bbc7982563f4688699
Jul 10 19:32:01.505923 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:01.505885    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8" event={"ID":"c9dfcd85-ca59-410a-962b-f39107f534d9","Type":"ContainerStarted","Data":"21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e"}
Jul 10 19:32:01.505923 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:01.505926    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8" event={"ID":"c9dfcd85-ca59-410a-962b-f39107f534d9","Type":"ContainerStarted","Data":"1c277638ac5fcafd16863ea147d76b812e0b8d51eb9277bbc7982563f4688699"}
Jul 10 19:32:01.525530 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:01.525481    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8" podStartSLOduration=1.525464973 podStartE2EDuration="1.525464973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:32:01.524572034 +0000 UTC m=+2010.713097188" watchObservedRunningTime="2026-07-10 19:32:01.525464973 +0000 UTC m=+2010.713990146"
Jul 10 19:32:04.311735 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:04.311700    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:32:10.807663 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:10.807627    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:10.808292 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:10.807706    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:10.819687 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:10.819666    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:11.562486 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:11.562454    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:32:17.888674 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:17.888633    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:32:39.882127 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:39.882088    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:32:45.810290 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:32:45.810255    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"]
Jul 10 19:33:00.829982 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:00.829921    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8" podUID="c9dfcd85-ca59-410a-962b-f39107f534d9" containerName="main" containerID="cri-o://21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e" gracePeriod=45
Jul 10 19:33:01.076343 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.076319    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:33:01.164512 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164436    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dfcd85-ca59-410a-962b-f39107f534d9-tls-certs\") pod \"c9dfcd85-ca59-410a-962b-f39107f534d9\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") "
Jul 10 19:33:01.164660 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164532    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv56q\" (UniqueName: \"kubernetes.io/projected/c9dfcd85-ca59-410a-962b-f39107f534d9-kube-api-access-sv56q\") pod \"c9dfcd85-ca59-410a-962b-f39107f534d9\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") "
Jul 10 19:33:01.164660 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164585    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-home\") pod \"c9dfcd85-ca59-410a-962b-f39107f534d9\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") "
Jul 10 19:33:01.164660 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164603    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-tmp-dir\") pod \"c9dfcd85-ca59-410a-962b-f39107f534d9\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") "
Jul 10 19:33:01.164660 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164624    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-model-cache\") pod \"c9dfcd85-ca59-410a-962b-f39107f534d9\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") "
Jul 10 19:33:01.164660 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164649    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-dshm\") pod \"c9dfcd85-ca59-410a-962b-f39107f534d9\" (UID: \"c9dfcd85-ca59-410a-962b-f39107f534d9\") "
Jul 10 19:33:01.164918 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164834    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9dfcd85-ca59-410a-962b-f39107f534d9" (UID: "c9dfcd85-ca59-410a-962b-f39107f534d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:33:01.164918 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164844    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-home" (OuterVolumeSpecName: "home") pod "c9dfcd85-ca59-410a-962b-f39107f534d9" (UID: "c9dfcd85-ca59-410a-962b-f39107f534d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:33:01.164918 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.164906    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9dfcd85-ca59-410a-962b-f39107f534d9" (UID: "c9dfcd85-ca59-410a-962b-f39107f534d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:33:01.166641 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.166610    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9dfcd85-ca59-410a-962b-f39107f534d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9dfcd85-ca59-410a-962b-f39107f534d9" (UID: "c9dfcd85-ca59-410a-962b-f39107f534d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:33:01.166766 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.166644    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-dshm" (OuterVolumeSpecName: "dshm") pod "c9dfcd85-ca59-410a-962b-f39107f534d9" (UID: "c9dfcd85-ca59-410a-962b-f39107f534d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:33:01.166766 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.166734    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9dfcd85-ca59-410a-962b-f39107f534d9-kube-api-access-sv56q" (OuterVolumeSpecName: "kube-api-access-sv56q") pod "c9dfcd85-ca59-410a-962b-f39107f534d9" (UID: "c9dfcd85-ca59-410a-962b-f39107f534d9"). InnerVolumeSpecName "kube-api-access-sv56q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:33:01.265369 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.265341    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv56q\" (UniqueName: \"kubernetes.io/projected/c9dfcd85-ca59-410a-962b-f39107f534d9-kube-api-access-sv56q\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:33:01.265369 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.265365    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:33:01.265532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.265378    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:33:01.265532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.265392    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:33:01.265532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.265404    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9dfcd85-ca59-410a-962b-f39107f534d9-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:33:01.265532 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.265416    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9dfcd85-ca59-410a-962b-f39107f534d9-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:33:01.757445 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.757417    2556 generic.go:356] "Generic (PLEG): container finished" podID="c9dfcd85-ca59-410a-962b-f39107f534d9" containerID="21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e" exitCode=0
Jul 10 19:33:01.757631 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.757464    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"
Jul 10 19:33:01.757631 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.757486    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8" event={"ID":"c9dfcd85-ca59-410a-962b-f39107f534d9","Type":"ContainerDied","Data":"21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e"}
Jul 10 19:33:01.757631 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.757517    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8" event={"ID":"c9dfcd85-ca59-410a-962b-f39107f534d9","Type":"ContainerDied","Data":"1c277638ac5fcafd16863ea147d76b812e0b8d51eb9277bbc7982563f4688699"}
Jul 10 19:33:01.757631 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.757534    2556 scope.go:117] "RemoveContainer" containerID="21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e"
Jul 10 19:33:01.767816 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.767795    2556 scope.go:117] "RemoveContainer" containerID="21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e"
Jul 10 19:33:01.768090 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:33:01.768062    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e\": container with ID starting with 21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e not found: ID does not exist" containerID="21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e"
Jul 10 19:33:01.768212 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.768092    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e"} err="failed to get container status \"21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e\": rpc error: code = NotFound desc = could not find container \"21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e\": container with ID starting with 21c90a7273a7256ff50f4e8e03212d4a7f65a6a0230aa0b167cf497d63621b0e not found: ID does not exist"
Jul 10 19:33:01.776630 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.776608    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"]
Jul 10 19:33:01.780641 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:01.780621    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-cacc33b0/e2e-lifecycle-model-cacc33b0-kserve-8d69c8bd7-b5ft8"]
Jul 10 19:33:03.352661 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:03.352627    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9dfcd85-ca59-410a-962b-f39107f534d9" path="/var/lib/kubelet/pods/c9dfcd85-ca59-410a-962b-f39107f534d9/volumes"
Jul 10 19:33:31.359274 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:31.359243    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:33:31.360560 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:31.360531    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:33:31.364295 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:31.364274    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:33:31.365725 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:31.365706    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:33:37.497128 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:37.497094    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:33:51.796319 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:33:51.796284    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:34:40.288386 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:34:40.288344    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:34:51.692801 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:34:51.692767    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:35:09.604653 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.604618    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"]
Jul 10 19:35:09.605102 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.604900    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9dfcd85-ca59-410a-962b-f39107f534d9" containerName="main"
Jul 10 19:35:09.605102 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.604911    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9dfcd85-ca59-410a-962b-f39107f534d9" containerName="main"
Jul 10 19:35:09.605102 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.604976    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9dfcd85-ca59-410a-962b-f39107f534d9" containerName="main"
Jul 10 19:35:09.607604 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.607586    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.611015 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.610993    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd22f1\"/\"kube-root-ca.crt\""
Jul 10 19:35:09.611127 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.610995    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd22f1\"/\"default-dockercfg-cxs6m\""
Jul 10 19:35:09.611127 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.611042    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd22f1\"/\"test-model-fd22f1-kserve-self-signed-certs\""
Jul 10 19:35:09.611127 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.611114    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd22f1\"/\"openshift-service-ca.crt\""
Jul 10 19:35:09.618327 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.618302    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"]
Jul 10 19:35:09.756559 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.756524    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a8ba8-394c-4a58-bb79-033e30591910-tls-certs\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.756754 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.756597    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-model-cache\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.756754 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.756622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-tmp-dir\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.756754 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.756641    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhtb\" (UniqueName: \"kubernetes.io/projected/9b0a8ba8-394c-4a58-bb79-033e30591910-kube-api-access-cnhtb\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.756754 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.756665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-dshm\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.756754 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.756727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-home\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.857969 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.857870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-model-cache\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.857969 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.857909    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-tmp-dir\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.857969 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.857933    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhtb\" (UniqueName: \"kubernetes.io/projected/9b0a8ba8-394c-4a58-bb79-033e30591910-kube-api-access-cnhtb\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.857969 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.857961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-dshm\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.858343 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.857985    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-home\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.858343 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.858067    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a8ba8-394c-4a58-bb79-033e30591910-tls-certs\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.858507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.858374    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-tmp-dir\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.858507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.858400    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-model-cache\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.858507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.858433    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-home\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.860307 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.860283    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-dshm\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.860511 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.860493    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a8ba8-394c-4a58-bb79-033e30591910-tls-certs\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.865294 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.865264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhtb\" (UniqueName: \"kubernetes.io/projected/9b0a8ba8-394c-4a58-bb79-033e30591910-kube-api-access-cnhtb\") pod \"test-model-fd22f1-kserve-5564fc6855-q9jdj\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") " pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:09.917000 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:09.916967    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:10.048874 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:10.048840    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"]
Jul 10 19:35:10.051520 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:35:10.051493    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b0a8ba8_394c_4a58_bb79_033e30591910.slice/crio-8332c98bd00d56f6473582ecf4fa1a087929f8e322554f009a7225bd95ee6984 WatchSource:0}: Error finding container 8332c98bd00d56f6473582ecf4fa1a087929f8e322554f009a7225bd95ee6984: Status 404 returned error can't find the container with id 8332c98bd00d56f6473582ecf4fa1a087929f8e322554f009a7225bd95ee6984
Jul 10 19:35:10.270633 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:10.270600    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj" event={"ID":"9b0a8ba8-394c-4a58-bb79-033e30591910","Type":"ContainerStarted","Data":"5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3"}
Jul 10 19:35:10.270798 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:10.270642    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj" event={"ID":"9b0a8ba8-394c-4a58-bb79-033e30591910","Type":"ContainerStarted","Data":"8332c98bd00d56f6473582ecf4fa1a087929f8e322554f009a7225bd95ee6984"}
Jul 10 19:35:10.294176 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:10.294106    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj" podStartSLOduration=1.294092355 podStartE2EDuration="1.294092355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:35:10.293595458 +0000 UTC m=+2199.482120613" watchObservedRunningTime="2026-07-10 19:35:10.294092355 +0000 UTC m=+2199.482617527"
Jul 10 19:35:14.506496 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:14.506463    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:35:19.918166 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:19.918109    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:19.918569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:19.918181    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:19.930769 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:19.930744    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:20.325058 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:20.325023    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:35:43.977350 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:43.977311    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"]
Jul 10 19:35:43.980671 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:43.980648    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:43.983058 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:43.983037    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8c42c2\"/\"kube-root-ca.crt\""
Jul 10 19:35:43.984029 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:43.984008    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8c42c2\"/\"default-dockercfg-4m5bl\""
Jul 10 19:35:43.984173 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:43.984073    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8c42c2\"/\"openshift-service-ca.crt\""
Jul 10 19:35:43.984173 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:43.984098    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8c42c2\"/\"test-model-8c42c2-kserve-self-signed-certs\""
Jul 10 19:35:43.989099 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:43.989076    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"]
Jul 10 19:35:44.009939 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.009908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tls-certs\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.010066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.009961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-home\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.010066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.009986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-dshm\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.010066 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.010054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-model-cache\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.010205 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.010119    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzsx\" (UniqueName: \"kubernetes.io/projected/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-kube-api-access-nrzsx\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.010205 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.010173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tmp-dir\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111168 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzsx\" (UniqueName: \"kubernetes.io/projected/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-kube-api-access-nrzsx\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111354 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tmp-dir\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111354 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111213    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tls-certs\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111354 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-home\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111354 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111252    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-dshm\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111354 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-model-cache\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111636 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111613    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-home\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111696 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111668    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tmp-dir\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.111741 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.111696    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-model-cache\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.113547 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.113525    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-dshm\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.113787 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.113771    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tls-certs\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.119567 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.119545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzsx\" (UniqueName: \"kubernetes.io/projected/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-kube-api-access-nrzsx\") pod \"test-model-8c42c2-kserve-776bf599b9-qh79c\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") " pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.291205 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.291180    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:44.421731 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:44.421662    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"]
Jul 10 19:35:44.424419 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:35:44.424389    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbdfdb7e_ec1f_451e_9084_9ba361e96ea5.slice/crio-f4f2e12db1fd159a611fd8e7bf4df6c3a908f79b182f307e7a5de16885ce94b2 WatchSource:0}: Error finding container f4f2e12db1fd159a611fd8e7bf4df6c3a908f79b182f307e7a5de16885ce94b2: Status 404 returned error can't find the container with id f4f2e12db1fd159a611fd8e7bf4df6c3a908f79b182f307e7a5de16885ce94b2
Jul 10 19:35:45.415436 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:45.415398    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c" event={"ID":"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5","Type":"ContainerStarted","Data":"1b2748ece693de54869add26041b31fb80dfca2859766793ee894466dd767ca7"}
Jul 10 19:35:45.415436 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:45.415438    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c" event={"ID":"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5","Type":"ContainerStarted","Data":"f4f2e12db1fd159a611fd8e7bf4df6c3a908f79b182f307e7a5de16885ce94b2"}
Jul 10 19:35:45.433982 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:45.433925    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c" podStartSLOduration=2.433906346 podStartE2EDuration="2.433906346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:35:45.433727695 +0000 UTC m=+2234.622252868" watchObservedRunningTime="2026-07-10 19:35:45.433906346 +0000 UTC m=+2234.622431519"
Jul 10 19:35:48.283304 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:48.283267    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:35:54.292199 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:54.292100    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:54.292199 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:54.292163    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:54.304450 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:54.304425    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:35:54.462496 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:35:54.462467    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:36:02.102399 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:02.102361    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:36:19.333497 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:19.333465    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"]
Jul 10 19:36:20.382916 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:20.382884    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"]
Jul 10 19:36:24.491646 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:24.491611    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:36:34.352924 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.352862    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj" podUID="9b0a8ba8-394c-4a58-bb79-033e30591910" containerName="main" containerID="cri-o://5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3" gracePeriod=45
Jul 10 19:36:34.593945 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.593920    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:36:34.617300 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.617219    2556 generic.go:356] "Generic (PLEG): container finished" podID="9b0a8ba8-394c-4a58-bb79-033e30591910" containerID="5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3" exitCode=0
Jul 10 19:36:34.617300 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.617255    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"
Jul 10 19:36:34.617510 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.617294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj" event={"ID":"9b0a8ba8-394c-4a58-bb79-033e30591910","Type":"ContainerDied","Data":"5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3"}
Jul 10 19:36:34.617510 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.617342    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj" event={"ID":"9b0a8ba8-394c-4a58-bb79-033e30591910","Type":"ContainerDied","Data":"8332c98bd00d56f6473582ecf4fa1a087929f8e322554f009a7225bd95ee6984"}
Jul 10 19:36:34.617510 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.617365    2556 scope.go:117] "RemoveContainer" containerID="5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3"
Jul 10 19:36:34.625988 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.625973    2556 scope.go:117] "RemoveContainer" containerID="5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3"
Jul 10 19:36:34.626279 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:36:34.626259    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3\": container with ID starting with 5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3 not found: ID does not exist" containerID="5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3"
Jul 10 19:36:34.626357 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.626292    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3"} err="failed to get container status \"5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3\": rpc error: code = NotFound desc = could not find container \"5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3\": container with ID starting with 5c364475f7d6bc31b773a62374c8ce6baddf2cd0437240511326e5753ee147f3 not found: ID does not exist"
Jul 10 19:36:34.630549 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630532    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-home\") pod \"9b0a8ba8-394c-4a58-bb79-033e30591910\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") "
Jul 10 19:36:34.630617 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630606    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a8ba8-394c-4a58-bb79-033e30591910-tls-certs\") pod \"9b0a8ba8-394c-4a58-bb79-033e30591910\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") "
Jul 10 19:36:34.630656 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630635    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-tmp-dir\") pod \"9b0a8ba8-394c-4a58-bb79-033e30591910\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") "
Jul 10 19:36:34.630698 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630656    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-dshm\") pod \"9b0a8ba8-394c-4a58-bb79-033e30591910\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") "
Jul 10 19:36:34.630749 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630696    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnhtb\" (UniqueName: \"kubernetes.io/projected/9b0a8ba8-394c-4a58-bb79-033e30591910-kube-api-access-cnhtb\") pod \"9b0a8ba8-394c-4a58-bb79-033e30591910\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") "
Jul 10 19:36:34.630749 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630726    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-model-cache\") pod \"9b0a8ba8-394c-4a58-bb79-033e30591910\" (UID: \"9b0a8ba8-394c-4a58-bb79-033e30591910\") "
Jul 10 19:36:34.630900 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630800    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-home" (OuterVolumeSpecName: "home") pod "9b0a8ba8-394c-4a58-bb79-033e30591910" (UID: "9b0a8ba8-394c-4a58-bb79-033e30591910"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:34.630974 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630925    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b0a8ba8-394c-4a58-bb79-033e30591910" (UID: "9b0a8ba8-394c-4a58-bb79-033e30591910"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:34.631021 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.630995    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b0a8ba8-394c-4a58-bb79-033e30591910" (UID: "9b0a8ba8-394c-4a58-bb79-033e30591910"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:34.631021 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.631006    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:34.632772 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.632743    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b0a8ba8-394c-4a58-bb79-033e30591910-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b0a8ba8-394c-4a58-bb79-033e30591910" (UID: "9b0a8ba8-394c-4a58-bb79-033e30591910"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:36:34.633108 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.633089    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-dshm" (OuterVolumeSpecName: "dshm") pod "9b0a8ba8-394c-4a58-bb79-033e30591910" (UID: "9b0a8ba8-394c-4a58-bb79-033e30591910"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:34.633223 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.633108    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0a8ba8-394c-4a58-bb79-033e30591910-kube-api-access-cnhtb" (OuterVolumeSpecName: "kube-api-access-cnhtb") pod "9b0a8ba8-394c-4a58-bb79-033e30591910" (UID: "9b0a8ba8-394c-4a58-bb79-033e30591910"). InnerVolumeSpecName "kube-api-access-cnhtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:36:34.732112 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.732078    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:34.732112 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.732106    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:34.732112 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.732117    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnhtb\" (UniqueName: \"kubernetes.io/projected/9b0a8ba8-394c-4a58-bb79-033e30591910-kube-api-access-cnhtb\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:34.732367 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.732126    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b0a8ba8-394c-4a58-bb79-033e30591910-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:34.732367 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.732135    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b0a8ba8-394c-4a58-bb79-033e30591910-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:34.938603 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.938569    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"]
Jul 10 19:36:34.944212 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:34.944181    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fd22f1/test-model-fd22f1-kserve-5564fc6855-q9jdj"]
Jul 10 19:36:35.352206 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.352171    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b0a8ba8-394c-4a58-bb79-033e30591910" path="/var/lib/kubelet/pods/9b0a8ba8-394c-4a58-bb79-033e30591910/volumes"
Jul 10 19:36:35.403166 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.403108    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c" podUID="dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" containerName="main" containerID="cri-o://1b2748ece693de54869add26041b31fb80dfca2859766793ee894466dd767ca7" gracePeriod=45
Jul 10 19:36:35.623567 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.623486    2556 generic.go:356] "Generic (PLEG): container finished" podID="dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" containerID="1b2748ece693de54869add26041b31fb80dfca2859766793ee894466dd767ca7" exitCode=0
Jul 10 19:36:35.623724 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.623562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c" event={"ID":"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5","Type":"ContainerDied","Data":"1b2748ece693de54869add26041b31fb80dfca2859766793ee894466dd767ca7"}
Jul 10 19:36:35.647138 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.647114    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:36:35.739310 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739274    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrzsx\" (UniqueName: \"kubernetes.io/projected/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-kube-api-access-nrzsx\") pod \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") "
Jul 10 19:36:35.739310 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739312    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-home\") pod \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") "
Jul 10 19:36:35.739555 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739368    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-dshm\") pod \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") "
Jul 10 19:36:35.739555 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739428    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tls-certs\") pod \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") "
Jul 10 19:36:35.739555 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739452    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-model-cache\") pod \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") "
Jul 10 19:36:35.739555 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739476    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tmp-dir\") pod \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\" (UID: \"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5\") "
Jul 10 19:36:35.739749 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-home" (OuterVolumeSpecName: "home") pod "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" (UID: "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:35.739801 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739746    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" (UID: "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:35.739801 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.739773    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" (UID: "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:35.741682 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.741651    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-dshm" (OuterVolumeSpecName: "dshm") pod "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" (UID: "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:36:35.741791 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.741682    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" (UID: "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:36:35.741791 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.741710    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-kube-api-access-nrzsx" (OuterVolumeSpecName: "kube-api-access-nrzsx") pod "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" (UID: "dbdfdb7e-ec1f-451e-9084-9ba361e96ea5"). InnerVolumeSpecName "kube-api-access-nrzsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:36:35.840463 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.840428    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:35.840463 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.840459    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:35.840463 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.840468    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:35.840689 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.840477    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrzsx\" (UniqueName: \"kubernetes.io/projected/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-kube-api-access-nrzsx\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:35.840689 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.840486    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:35.840689 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:35.840494    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:36:36.630275 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:36.630248    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"
Jul 10 19:36:36.630703 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:36.630244    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c" event={"ID":"dbdfdb7e-ec1f-451e-9084-9ba361e96ea5","Type":"ContainerDied","Data":"f4f2e12db1fd159a611fd8e7bf4df6c3a908f79b182f307e7a5de16885ce94b2"}
Jul 10 19:36:36.630703 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:36.630383    2556 scope.go:117] "RemoveContainer" containerID="1b2748ece693de54869add26041b31fb80dfca2859766793ee894466dd767ca7"
Jul 10 19:36:36.650462 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:36.650440    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"]
Jul 10 19:36:36.654701 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:36.654680    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8c42c2/test-model-8c42c2-kserve-776bf599b9-qh79c"]
Jul 10 19:36:37.351973 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:37.351931    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" path="/var/lib/kubelet/pods/dbdfdb7e-ec1f-451e-9084-9ba361e96ea5/volumes"
Jul 10 19:36:41.087825 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:36:41.087790    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:37:00.585219 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:37:00.585183    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:37:21.491864 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:37:21.491828    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:37:32.988460 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:37:32.988418    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:37:52.292765 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:37:52.292730    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:38:17.987888 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:17.987850    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:38:31.381909 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:31.381879    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:38:31.384266 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:31.384234    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:38:31.386884 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:31.386858    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:38:31.389198 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:31.389181    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:38:38.695095 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:38.695057    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:38:49.890161 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:49.890106    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:38:56.882112 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.882023    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"]
Jul 10 19:38:56.882601 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.882315    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" containerName="main"
Jul 10 19:38:56.882601 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.882327    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" containerName="main"
Jul 10 19:38:56.882601 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.882342    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0a8ba8-394c-4a58-bb79-033e30591910" containerName="main"
Jul 10 19:38:56.882601 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.882348    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0a8ba8-394c-4a58-bb79-033e30591910" containerName="main"
Jul 10 19:38:56.882601 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.882393    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbdfdb7e-ec1f-451e-9084-9ba361e96ea5" containerName="main"
Jul 10 19:38:56.882601 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.882401    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0a8ba8-394c-4a58-bb79-033e30591910" containerName="main"
Jul 10 19:38:56.885358 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.885340    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:56.887816 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.887764    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"kube-root-ca.crt\""
Jul 10 19:38:56.888782 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.888759    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"auth-test-model-7207cb-kserve-self-signed-certs\""
Jul 10 19:38:56.888887 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.888866    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"default-dockercfg-hdtms\""
Jul 10 19:38:56.888887 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.888879    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"openshift-service-ca.crt\""
Jul 10 19:38:56.894191 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.894169    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"]
Jul 10 19:38:56.944205 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.944179    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn5fl\" (UniqueName: \"kubernetes.io/projected/4626684b-d0c7-4044-bac0-fcc41a8f4828-kube-api-access-qn5fl\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:56.944315 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.944217    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-home\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:56.944315 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.944279    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-model-cache\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:56.944315 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.944309    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-tmp-dir\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:56.944420 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.944347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4626684b-d0c7-4044-bac0-fcc41a8f4828-tls-certs\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:56.944420 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:56.944368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-dshm\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045113 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4626684b-d0c7-4044-bac0-fcc41a8f4828-tls-certs\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045274 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045122    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-dshm\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045274 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn5fl\" (UniqueName: \"kubernetes.io/projected/4626684b-d0c7-4044-bac0-fcc41a8f4828-kube-api-access-qn5fl\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045274 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-home\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045274 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-model-cache\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045274 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-tmp-dir\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045699 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045676    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-model-cache\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045784 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045703    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-home\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.045784 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.045724    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-tmp-dir\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.047424 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.047399    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-dshm\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.047706 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.047689    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4626684b-d0c7-4044-bac0-fcc41a8f4828-tls-certs\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.053422 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.053401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn5fl\" (UniqueName: \"kubernetes.io/projected/4626684b-d0c7-4044-bac0-fcc41a8f4828-kube-api-access-qn5fl\") pod \"auth-test-model-7207cb-kserve-7f9b556995-2jn6b\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") " pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.195429 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.195350    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:38:57.319686 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:57.319657    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"]
Jul 10 19:38:57.322495 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:38:57.322457    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4626684b_d0c7_4044_bac0_fcc41a8f4828.slice/crio-ba8233c423c788a9cc0b92e4cc252e56cd1289c9e3a7e44c41a67da1c84a8d50 WatchSource:0}: Error finding container ba8233c423c788a9cc0b92e4cc252e56cd1289c9e3a7e44c41a67da1c84a8d50: Status 404 returned error can't find the container with id ba8233c423c788a9cc0b92e4cc252e56cd1289c9e3a7e44c41a67da1c84a8d50
Jul 10 19:38:58.209226 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:58.209189    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b" event={"ID":"4626684b-d0c7-4044-bac0-fcc41a8f4828","Type":"ContainerStarted","Data":"99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff"}
Jul 10 19:38:58.209651 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:58.209236    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b" event={"ID":"4626684b-d0c7-4044-bac0-fcc41a8f4828","Type":"ContainerStarted","Data":"ba8233c423c788a9cc0b92e4cc252e56cd1289c9e3a7e44c41a67da1c84a8d50"}
Jul 10 19:38:58.226084 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:38:58.226043    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b" podStartSLOduration=2.226027603 podStartE2EDuration="2.226027603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:38:58.225338835 +0000 UTC m=+2427.413864007" watchObservedRunningTime="2026-07-10 19:38:58.226027603 +0000 UTC m=+2427.414552775"
Jul 10 19:39:02.894048 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:02.894009    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:39:07.195905 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:07.195868    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:39:07.196312 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:07.196175    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:39:07.208238 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:07.208216    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:39:07.258722 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:07.258700    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:39:30.897378 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:30.897345    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"]
Jul 10 19:39:30.900509 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:30.900490    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:30.904054 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:30.904015    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"openshift-service-ca.crt\""
Jul 10 19:39:30.904054 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:30.904047    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"default-dockercfg-blkf6\""
Jul 10 19:39:30.904310 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:30.904013    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"auth-test-model-3ec3c4-kserve-self-signed-certs\""
Jul 10 19:39:30.904310 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:30.904158    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"kube-root-ca.crt\""
Jul 10 19:39:30.911354 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:30.911328    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"]
Jul 10 19:39:31.032752 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.032698    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5k5h\" (UniqueName: \"kubernetes.io/projected/2c1bd681-1266-425b-93ec-ade9a6970f6f-kube-api-access-d5k5h\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.032752 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.032755    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-home\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.032983 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.032859    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-model-cache\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.032983 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.032893    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1bd681-1266-425b-93ec-ade9a6970f6f-tls-certs\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.032983 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.032918    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-dshm\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.032983 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.032947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-tmp-dir\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134028 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.133987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5k5h\" (UniqueName: \"kubernetes.io/projected/2c1bd681-1266-425b-93ec-ade9a6970f6f-kube-api-access-d5k5h\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134028 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134029    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-home\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134317 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-model-cache\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134317 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134120    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1bd681-1266-425b-93ec-ade9a6970f6f-tls-certs\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134317 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-dshm\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134317 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-tmp-dir\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134544    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-home\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134641 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134597    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-model-cache\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.134684 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.134625    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-tmp-dir\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.136508 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.136488    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-dshm\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.136738 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.136721    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1bd681-1266-425b-93ec-ade9a6970f6f-tls-certs\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.143986 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.143963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5k5h\" (UniqueName: \"kubernetes.io/projected/2c1bd681-1266-425b-93ec-ade9a6970f6f-kube-api-access-d5k5h\") pod \"auth-test-model-3ec3c4-kserve-84d994975f-kw956\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") " pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.213286 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.213215    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"default-dockercfg-blkf6\""
Jul 10 19:39:31.221375 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.221353    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:31.354348 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:31.354325    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"]
Jul 10 19:39:31.355167 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:39:31.355125    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c1bd681_1266_425b_93ec_ade9a6970f6f.slice/crio-693124f1791d7b3f2e78b437fe438a17753388208c53596c0cbe0fd495835b81 WatchSource:0}: Error finding container 693124f1791d7b3f2e78b437fe438a17753388208c53596c0cbe0fd495835b81: Status 404 returned error can't find the container with id 693124f1791d7b3f2e78b437fe438a17753388208c53596c0cbe0fd495835b81
Jul 10 19:39:32.351943 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:32.351906    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956" event={"ID":"2c1bd681-1266-425b-93ec-ade9a6970f6f","Type":"ContainerStarted","Data":"dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38"}
Jul 10 19:39:32.351943 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:32.351949    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956" event={"ID":"2c1bd681-1266-425b-93ec-ade9a6970f6f","Type":"ContainerStarted","Data":"693124f1791d7b3f2e78b437fe438a17753388208c53596c0cbe0fd495835b81"}
Jul 10 19:39:34.788720 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:34.788666    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956" podStartSLOduration=4.788647263 podStartE2EDuration="4.788647263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:39:32.376419628 +0000 UTC m=+2461.564944800" watchObservedRunningTime="2026-07-10 19:39:34.788647263 +0000 UTC m=+2463.977172438"
Jul 10 19:39:34.789817 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:34.789798    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:39:41.221737 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:41.221685    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:41.221737 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:41.221749    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:41.234165 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:41.234121    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:41.397306 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:41.397272    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:39:49.489184 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:39:49.489135    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:40:06.439177 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:40:06.439127    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:40:22.888197 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:40:22.888161    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:40:40.282435 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:40:40.282394    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:40:54.986291 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:40:54.986258    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:41:11.286853 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:11.286818    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:41:26.187717 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:26.187681    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"]
Jul 10 19:41:27.092410 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:27.092379    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"]
Jul 10 19:41:29.797670 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:29.797632    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:41:41.207038 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.206983    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b" podUID="4626684b-d0c7-4044-bac0-fcc41a8f4828" containerName="main" containerID="cri-o://99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff" gracePeriod=45
Jul 10 19:41:41.454276 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.454253    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:41:41.587253 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587218    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-model-cache\") pod \"4626684b-d0c7-4044-bac0-fcc41a8f4828\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") "
Jul 10 19:41:41.587253 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587251    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-dshm\") pod \"4626684b-d0c7-4044-bac0-fcc41a8f4828\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") "
Jul 10 19:41:41.587498 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587279    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-home\") pod \"4626684b-d0c7-4044-bac0-fcc41a8f4828\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") "
Jul 10 19:41:41.587498 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587360    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4626684b-d0c7-4044-bac0-fcc41a8f4828-tls-certs\") pod \"4626684b-d0c7-4044-bac0-fcc41a8f4828\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") "
Jul 10 19:41:41.587498 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587390    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-tmp-dir\") pod \"4626684b-d0c7-4044-bac0-fcc41a8f4828\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") "
Jul 10 19:41:41.587498 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587447    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn5fl\" (UniqueName: \"kubernetes.io/projected/4626684b-d0c7-4044-bac0-fcc41a8f4828-kube-api-access-qn5fl\") pod \"4626684b-d0c7-4044-bac0-fcc41a8f4828\" (UID: \"4626684b-d0c7-4044-bac0-fcc41a8f4828\") "
Jul 10 19:41:41.587498 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587478    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-model-cache" (OuterVolumeSpecName: "model-cache") pod "4626684b-d0c7-4044-bac0-fcc41a8f4828" (UID: "4626684b-d0c7-4044-bac0-fcc41a8f4828"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:41.587741 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587570    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-home" (OuterVolumeSpecName: "home") pod "4626684b-d0c7-4044-bac0-fcc41a8f4828" (UID: "4626684b-d0c7-4044-bac0-fcc41a8f4828"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:41.587741 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587705    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4626684b-d0c7-4044-bac0-fcc41a8f4828" (UID: "4626684b-d0c7-4044-bac0-fcc41a8f4828"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:41.587817 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587745    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:41.587817 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.587762    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:41.589564 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.589532    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-dshm" (OuterVolumeSpecName: "dshm") pod "4626684b-d0c7-4044-bac0-fcc41a8f4828" (UID: "4626684b-d0c7-4044-bac0-fcc41a8f4828"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:41.589690 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.589658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4626684b-d0c7-4044-bac0-fcc41a8f4828-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4626684b-d0c7-4044-bac0-fcc41a8f4828" (UID: "4626684b-d0c7-4044-bac0-fcc41a8f4828"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:41:41.589690 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.589674    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4626684b-d0c7-4044-bac0-fcc41a8f4828-kube-api-access-qn5fl" (OuterVolumeSpecName: "kube-api-access-qn5fl") pod "4626684b-d0c7-4044-bac0-fcc41a8f4828" (UID: "4626684b-d0c7-4044-bac0-fcc41a8f4828"). InnerVolumeSpecName "kube-api-access-qn5fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:41:41.688119 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.688086    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn5fl\" (UniqueName: \"kubernetes.io/projected/4626684b-d0c7-4044-bac0-fcc41a8f4828-kube-api-access-qn5fl\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:41.688119 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.688112    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:41.688119 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.688123    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4626684b-d0c7-4044-bac0-fcc41a8f4828-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:41.688344 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.688132    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4626684b-d0c7-4044-bac0-fcc41a8f4828-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:41.873077 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.872997    2556 generic.go:356] "Generic (PLEG): container finished" podID="4626684b-d0c7-4044-bac0-fcc41a8f4828" containerID="99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff" exitCode=0
Jul 10 19:41:41.873077 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.873043    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"
Jul 10 19:41:41.873273 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.873087    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b" event={"ID":"4626684b-d0c7-4044-bac0-fcc41a8f4828","Type":"ContainerDied","Data":"99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff"}
Jul 10 19:41:41.873273 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.873137    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b" event={"ID":"4626684b-d0c7-4044-bac0-fcc41a8f4828","Type":"ContainerDied","Data":"ba8233c423c788a9cc0b92e4cc252e56cd1289c9e3a7e44c41a67da1c84a8d50"}
Jul 10 19:41:41.873273 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.873183    2556 scope.go:117] "RemoveContainer" containerID="99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff"
Jul 10 19:41:41.882077 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.882061    2556 scope.go:117] "RemoveContainer" containerID="99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff"
Jul 10 19:41:41.882408 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:41:41.882387    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff\": container with ID starting with 99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff not found: ID does not exist" containerID="99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff"
Jul 10 19:41:41.882502 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.882414    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff"} err="failed to get container status \"99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff\": rpc error: code = NotFound desc = could not find container \"99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff\": container with ID starting with 99fd828246d116b7b7334dda36b3dbc715d84f6c3b97b4f31202df1cc98fb1ff not found: ID does not exist"
Jul 10 19:41:41.895731 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.895709    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"]
Jul 10 19:41:41.899738 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:41.899718    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/auth-test-model-7207cb-kserve-7f9b556995-2jn6b"]
Jul 10 19:41:42.111753 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.111707    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956" podUID="2c1bd681-1266-425b-93ec-ade9a6970f6f" containerName="main" containerID="cri-o://dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38" gracePeriod=45
Jul 10 19:41:42.361195 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.361169    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:41:42.495573 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495547    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-dshm\") pod \"2c1bd681-1266-425b-93ec-ade9a6970f6f\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") "
Jul 10 19:41:42.495719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495586    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-tmp-dir\") pod \"2c1bd681-1266-425b-93ec-ade9a6970f6f\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") "
Jul 10 19:41:42.495719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495610    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1bd681-1266-425b-93ec-ade9a6970f6f-tls-certs\") pod \"2c1bd681-1266-425b-93ec-ade9a6970f6f\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") "
Jul 10 19:41:42.495719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495652    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5k5h\" (UniqueName: \"kubernetes.io/projected/2c1bd681-1266-425b-93ec-ade9a6970f6f-kube-api-access-d5k5h\") pod \"2c1bd681-1266-425b-93ec-ade9a6970f6f\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") "
Jul 10 19:41:42.495719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495684    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-home\") pod \"2c1bd681-1266-425b-93ec-ade9a6970f6f\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") "
Jul 10 19:41:42.495719 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495713    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-model-cache\") pod \"2c1bd681-1266-425b-93ec-ade9a6970f6f\" (UID: \"2c1bd681-1266-425b-93ec-ade9a6970f6f\") "
Jul 10 19:41:42.495947 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495854    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c1bd681-1266-425b-93ec-ade9a6970f6f" (UID: "2c1bd681-1266-425b-93ec-ade9a6970f6f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:42.496005 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.495944    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-home" (OuterVolumeSpecName: "home") pod "2c1bd681-1266-425b-93ec-ade9a6970f6f" (UID: "2c1bd681-1266-425b-93ec-ade9a6970f6f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:42.496064 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.496025    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:42.496064 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.496024    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c1bd681-1266-425b-93ec-ade9a6970f6f" (UID: "2c1bd681-1266-425b-93ec-ade9a6970f6f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:42.497900 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.497876    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1bd681-1266-425b-93ec-ade9a6970f6f-kube-api-access-d5k5h" (OuterVolumeSpecName: "kube-api-access-d5k5h") pod "2c1bd681-1266-425b-93ec-ade9a6970f6f" (UID: "2c1bd681-1266-425b-93ec-ade9a6970f6f"). InnerVolumeSpecName "kube-api-access-d5k5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:41:42.498001 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.497915    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-dshm" (OuterVolumeSpecName: "dshm") pod "2c1bd681-1266-425b-93ec-ade9a6970f6f" (UID: "2c1bd681-1266-425b-93ec-ade9a6970f6f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:41:42.498001 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.497918    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1bd681-1266-425b-93ec-ade9a6970f6f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c1bd681-1266-425b-93ec-ade9a6970f6f" (UID: "2c1bd681-1266-425b-93ec-ade9a6970f6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:41:42.597197 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.597172    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:42.597197 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.597192    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1bd681-1266-425b-93ec-ade9a6970f6f-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:42.597197 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.597203    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5k5h\" (UniqueName: \"kubernetes.io/projected/2c1bd681-1266-425b-93ec-ade9a6970f6f-kube-api-access-d5k5h\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:42.597378 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.597211    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:42.597378 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.597220    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1bd681-1266-425b-93ec-ade9a6970f6f-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:41:42.878889 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.878798    2556 generic.go:356] "Generic (PLEG): container finished" podID="2c1bd681-1266-425b-93ec-ade9a6970f6f" containerID="dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38" exitCode=0
Jul 10 19:41:42.878889 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.878848    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"
Jul 10 19:41:42.878889 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.878874    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956" event={"ID":"2c1bd681-1266-425b-93ec-ade9a6970f6f","Type":"ContainerDied","Data":"dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38"}
Jul 10 19:41:42.879175 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.878915    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956" event={"ID":"2c1bd681-1266-425b-93ec-ade9a6970f6f","Type":"ContainerDied","Data":"693124f1791d7b3f2e78b437fe438a17753388208c53596c0cbe0fd495835b81"}
Jul 10 19:41:42.879175 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.878938    2556 scope.go:117] "RemoveContainer" containerID="dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38"
Jul 10 19:41:42.892561 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.892544    2556 scope.go:117] "RemoveContainer" containerID="dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38"
Jul 10 19:41:42.892816 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:41:42.892798    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38\": container with ID starting with dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38 not found: ID does not exist" containerID="dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38"
Jul 10 19:41:42.892854 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.892826    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38"} err="failed to get container status \"dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38\": rpc error: code = NotFound desc = could not find container \"dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38\": container with ID starting with dfc507beee6eef774cd2ddd58043a8497924b96dcb17784302592fb876574f38 not found: ID does not exist"
Jul 10 19:41:42.905121 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.905101    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"]
Jul 10 19:41:42.909061 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:42.909041    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/auth-test-model-3ec3c4-kserve-84d994975f-kw956"]
Jul 10 19:41:43.352846 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.352811    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1bd681-1266-425b-93ec-ade9a6970f6f" path="/var/lib/kubelet/pods/2c1bd681-1266-425b-93ec-ade9a6970f6f/volumes"
Jul 10 19:41:43.353204 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.353190    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4626684b-d0c7-4044-bac0-fcc41a8f4828" path="/var/lib/kubelet/pods/4626684b-d0c7-4044-bac0-fcc41a8f4828/volumes"
Jul 10 19:41:43.896399 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.896369    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"]
Jul 10 19:41:43.896751 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.896665    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1bd681-1266-425b-93ec-ade9a6970f6f" containerName="main"
Jul 10 19:41:43.896751 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.896676    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1bd681-1266-425b-93ec-ade9a6970f6f" containerName="main"
Jul 10 19:41:43.896751 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.896695    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4626684b-d0c7-4044-bac0-fcc41a8f4828" containerName="main"
Jul 10 19:41:43.896751 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.896704    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4626684b-d0c7-4044-bac0-fcc41a8f4828" containerName="main"
Jul 10 19:41:43.896870 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.896759    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1bd681-1266-425b-93ec-ade9a6970f6f" containerName="main"
Jul 10 19:41:43.896870 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.896774    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4626684b-d0c7-4044-bac0-fcc41a8f4828" containerName="main"
Jul 10 19:41:43.900662 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.900646    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:43.904405 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.904381    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"openshift-service-ca.crt\""
Jul 10 19:41:43.904527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.904482    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"kube-root-ca.crt\""
Jul 10 19:41:43.904527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.904491    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"sub-test-model-7207cb-kserve-self-signed-certs\""
Jul 10 19:41:43.904527 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.904506    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"default-dockercfg-hdtms\""
Jul 10 19:41:43.909241 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:43.909219    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"]
Jul 10 19:41:44.008107 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.008071    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-home\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.008107 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.008107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-model-cache\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.008334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.008138    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzqb\" (UniqueName: \"kubernetes.io/projected/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-kube-api-access-nbzqb\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.008334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.008210    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tls-certs\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.008334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.008272    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tmp-dir\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.008334 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.008299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-dshm\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.109515 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.109464    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzqb\" (UniqueName: \"kubernetes.io/projected/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-kube-api-access-nbzqb\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.109684 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.109533    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tls-certs\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.109684 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.109623    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tmp-dir\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.109684 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.109675    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-dshm\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.109873 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.109729    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-home\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.109873 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.109752    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-model-cache\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.109982 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.109952    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tmp-dir\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.110092 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.110072    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-home\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.110251 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.110105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-model-cache\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.111952 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.111928    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-dshm\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.112135 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.112117    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tls-certs\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.117888 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.117862    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzqb\" (UniqueName: \"kubernetes.io/projected/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-kube-api-access-nbzqb\") pod \"sub-test-model-7207cb-kserve-fccb897d9-wrd52\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") " pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.209943 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.209858    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:44.337381 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.337355    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"]
Jul 10 19:41:44.339795 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:41:44.339769    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9b8f5d1_494b_4f62_8f14_4f4efab1c752.slice/crio-c838cfe3dd5d507307a00653579323059eb83b21ac6d1b253442b3309b17e459 WatchSource:0}: Error finding container c838cfe3dd5d507307a00653579323059eb83b21ac6d1b253442b3309b17e459: Status 404 returned error can't find the container with id c838cfe3dd5d507307a00653579323059eb83b21ac6d1b253442b3309b17e459
Jul 10 19:41:44.890536 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.890506    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52" event={"ID":"b9b8f5d1-494b-4f62-8f14-4f4efab1c752","Type":"ContainerStarted","Data":"e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d"}
Jul 10 19:41:44.890707 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.890547    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52" event={"ID":"b9b8f5d1-494b-4f62-8f14-4f4efab1c752","Type":"ContainerStarted","Data":"c838cfe3dd5d507307a00653579323059eb83b21ac6d1b253442b3309b17e459"}
Jul 10 19:41:44.909344 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:44.909298    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52" podStartSLOduration=1.909283466 podStartE2EDuration="1.909283466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:41:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:41:44.90792301 +0000 UTC m=+2594.096448184" watchObservedRunningTime="2026-07-10 19:41:44.909283466 +0000 UTC m=+2594.097808638"
Jul 10 19:41:49.096472 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:49.096435    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:41:54.210258 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:54.210183    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:54.210258 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:54.210235    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:54.222422 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:54.222399    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:41:54.942558 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:41:54.942528    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:42:07.979224 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:07.979194    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"]
Jul 10 19:42:07.982744 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:07.982720    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:07.986431 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:07.986406    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"default-dockercfg-blkf6\""
Jul 10 19:42:07.986549 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:07.986437    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"kube-root-ca.crt\""
Jul 10 19:42:07.986549 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:07.986409    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"sub-test-model-3ec3c4-kserve-self-signed-certs\""
Jul 10 19:42:07.986632 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:07.986408    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"openshift-service-ca.crt\""
Jul 10 19:42:07.995726 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:07.995705    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"]
Jul 10 19:42:08.103942 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.103911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-model-cache\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.104095 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.103948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a07624-0669-4c6e-83ec-604e3dfa8364-tls-certs\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.104095 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.103993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-home\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.104095 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.104056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-tmp-dir\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.104095 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.104087    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg8jr\" (UniqueName: \"kubernetes.io/projected/b6a07624-0669-4c6e-83ec-604e3dfa8364-kube-api-access-tg8jr\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.104290 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.104113    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-dshm\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205347 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-model-cache\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205477 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a07624-0669-4c6e-83ec-604e3dfa8364-tls-certs\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205477 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-home\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205477 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205408    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-tmp-dir\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205477 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205426    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg8jr\" (UniqueName: \"kubernetes.io/projected/b6a07624-0669-4c6e-83ec-604e3dfa8364-kube-api-access-tg8jr\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205477 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205447    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-dshm\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205789 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205754    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-model-cache\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205904 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205821    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-tmp-dir\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.205904 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.205831    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-home\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.207650 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.207624    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-dshm\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.207843 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.207826    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a07624-0669-4c6e-83ec-604e3dfa8364-tls-certs\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.214503 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.214480    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg8jr\" (UniqueName: \"kubernetes.io/projected/b6a07624-0669-4c6e-83ec-604e3dfa8364-kube-api-access-tg8jr\") pod \"sub-test-model-3ec3c4-kserve-654df88569-xqksz\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") " pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.293585 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.293557    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:08.420490 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.420467    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"]
Jul 10 19:42:08.423040 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:42:08.423012    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6a07624_0669_4c6e_83ec_604e3dfa8364.slice/crio-bd396d448b866f1af681b3eeddca3ef8bfd2549ecbf83827fbcdca43ef03c56f WatchSource:0}: Error finding container bd396d448b866f1af681b3eeddca3ef8bfd2549ecbf83827fbcdca43ef03c56f: Status 404 returned error can't find the container with id bd396d448b866f1af681b3eeddca3ef8bfd2549ecbf83827fbcdca43ef03c56f
Jul 10 19:42:08.996329 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.996292    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz" event={"ID":"b6a07624-0669-4c6e-83ec-604e3dfa8364","Type":"ContainerStarted","Data":"389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd"}
Jul 10 19:42:08.996723 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:08.996339    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz" event={"ID":"b6a07624-0669-4c6e-83ec-604e3dfa8364","Type":"ContainerStarted","Data":"bd396d448b866f1af681b3eeddca3ef8bfd2549ecbf83827fbcdca43ef03c56f"}
Jul 10 19:42:12.492794 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:12.492737    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz" podStartSLOduration=5.492721495 podStartE2EDuration="5.492721495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:42:09.013402089 +0000 UTC m=+2618.201927264" watchObservedRunningTime="2026-07-10 19:42:12.492721495 +0000 UTC m=+2621.681246666"
Jul 10 19:42:12.494049 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:12.494028    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:42:18.294033 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:18.293992    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:18.294543 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:18.294053    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:18.306407 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:18.306378    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:19.047359 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:19.047333    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:42:28.094663 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:28.094626    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:42:44.578585 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:44.578551    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"]
Jul 10 19:42:45.478961 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:45.478929    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"]
Jul 10 19:42:49.988604 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:49.988566    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:42:57.790714 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.790679    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"]
Jul 10 19:42:57.793749 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.793732    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.796367 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.796343    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7207cb\"/\"rate-test-model-7207cb-kserve-self-signed-certs\""
Jul 10 19:42:57.809304 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.805778    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"]
Jul 10 19:42:57.897254 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.897211    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tls-certs\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.897426 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.897359    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq7s4\" (UniqueName: \"kubernetes.io/projected/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-kube-api-access-tq7s4\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.897498 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.897430    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-dshm\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.897498 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.897455    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tmp-dir\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.897605 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.897496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-home\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.897605 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.897539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-model-cache\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998267 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998227    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-dshm\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998267 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tmp-dir\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998501 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-home\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998501 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998450    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-model-cache\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998501 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998484    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tls-certs\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998661 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq7s4\" (UniqueName: \"kubernetes.io/projected/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-kube-api-access-tq7s4\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998766 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tmp-dir\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998835 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998814    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-home\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:57.998881 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:57.998841    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-model-cache\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:58.000573 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:58.000545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-dshm\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:58.000892 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:58.000874    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tls-certs\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:58.007977 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:58.007946    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq7s4\" (UniqueName: \"kubernetes.io/projected/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-kube-api-access-tq7s4\") pod \"rate-test-model-7207cb-kserve-86685fdf95-ztjzd\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") " pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:58.103352 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:58.103266    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:42:58.229938 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:58.229912    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"]
Jul 10 19:42:58.232193 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:42:58.232165    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podede2f72e_ca02_4e5c_8d28_dfec75a5553f.slice/crio-2c1f1d12bdd5c19ee82f468c813d07ad6cb67cc369a09afc80238fa63a6b90ee WatchSource:0}: Error finding container 2c1f1d12bdd5c19ee82f468c813d07ad6cb67cc369a09afc80238fa63a6b90ee: Status 404 returned error can't find the container with id 2c1f1d12bdd5c19ee82f468c813d07ad6cb67cc369a09afc80238fa63a6b90ee
Jul 10 19:42:59.201942 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.201904    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd" event={"ID":"ede2f72e-ca02-4e5c-8d28-dfec75a5553f","Type":"ContainerStarted","Data":"f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5"}
Jul 10 19:42:59.202367 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.201947    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd" event={"ID":"ede2f72e-ca02-4e5c-8d28-dfec75a5553f","Type":"ContainerStarted","Data":"2c1f1d12bdd5c19ee82f468c813d07ad6cb67cc369a09afc80238fa63a6b90ee"}
Jul 10 19:42:59.220237 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.220185    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd" podStartSLOduration=2.22016995 podStartE2EDuration="2.22016995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:42:59.21916191 +0000 UTC m=+2668.407687079" watchObservedRunningTime="2026-07-10 19:42:59.22016995 +0000 UTC m=+2668.408695116"
Jul 10 19:42:59.597897 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.597860    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52" podUID="b9b8f5d1-494b-4f62-8f14-4f4efab1c752" containerName="main" containerID="cri-o://e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d" gracePeriod=45
Jul 10 19:42:59.846419 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.846395    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:42:59.914011 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.913931    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-home\") pod \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") "
Jul 10 19:42:59.914011 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.913976    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tmp-dir\") pod \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") "
Jul 10 19:42:59.914011 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.913995    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-dshm\") pod \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") "
Jul 10 19:42:59.914286 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.914035    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-model-cache\") pod \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") "
Jul 10 19:42:59.914286 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.914060    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbzqb\" (UniqueName: \"kubernetes.io/projected/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-kube-api-access-nbzqb\") pod \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") "
Jul 10 19:42:59.914286 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.914089    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tls-certs\") pod \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\" (UID: \"b9b8f5d1-494b-4f62-8f14-4f4efab1c752\") "
Jul 10 19:42:59.914286 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.914263    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9b8f5d1-494b-4f62-8f14-4f4efab1c752" (UID: "b9b8f5d1-494b-4f62-8f14-4f4efab1c752"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:42:59.914514 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.914281    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-home" (OuterVolumeSpecName: "home") pod "b9b8f5d1-494b-4f62-8f14-4f4efab1c752" (UID: "b9b8f5d1-494b-4f62-8f14-4f4efab1c752"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:42:59.914514 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.914299    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9b8f5d1-494b-4f62-8f14-4f4efab1c752" (UID: "b9b8f5d1-494b-4f62-8f14-4f4efab1c752"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:42:59.916321 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.916295    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-dshm" (OuterVolumeSpecName: "dshm") pod "b9b8f5d1-494b-4f62-8f14-4f4efab1c752" (UID: "b9b8f5d1-494b-4f62-8f14-4f4efab1c752"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:42:59.916321 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.916300    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9b8f5d1-494b-4f62-8f14-4f4efab1c752" (UID: "b9b8f5d1-494b-4f62-8f14-4f4efab1c752"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:42:59.916321 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:42:59.916303    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-kube-api-access-nbzqb" (OuterVolumeSpecName: "kube-api-access-nbzqb") pod "b9b8f5d1-494b-4f62-8f14-4f4efab1c752" (UID: "b9b8f5d1-494b-4f62-8f14-4f4efab1c752"). InnerVolumeSpecName "kube-api-access-nbzqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:43:00.015012 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.014982    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.015012 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.015005    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.015012 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.015014    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.015264 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.015023    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbzqb\" (UniqueName: \"kubernetes.io/projected/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-kube-api-access-nbzqb\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.015264 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.015031    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.015264 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.015040    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9b8f5d1-494b-4f62-8f14-4f4efab1c752-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.207704 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.207615    2556 generic.go:356] "Generic (PLEG): container finished" podID="b9b8f5d1-494b-4f62-8f14-4f4efab1c752" containerID="e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d" exitCode=0
Jul 10 19:43:00.207704 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.207663    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"
Jul 10 19:43:00.208206 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.207707    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52" event={"ID":"b9b8f5d1-494b-4f62-8f14-4f4efab1c752","Type":"ContainerDied","Data":"e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d"}
Jul 10 19:43:00.208206 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.207753    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52" event={"ID":"b9b8f5d1-494b-4f62-8f14-4f4efab1c752","Type":"ContainerDied","Data":"c838cfe3dd5d507307a00653579323059eb83b21ac6d1b253442b3309b17e459"}
Jul 10 19:43:00.208206 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.207774    2556 scope.go:117] "RemoveContainer" containerID="e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d"
Jul 10 19:43:00.216385 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.216367    2556 scope.go:117] "RemoveContainer" containerID="e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d"
Jul 10 19:43:00.216642 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:43:00.216626    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d\": container with ID starting with e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d not found: ID does not exist" containerID="e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d"
Jul 10 19:43:00.216685 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.216651    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d"} err="failed to get container status \"e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d\": rpc error: code = NotFound desc = could not find container \"e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d\": container with ID starting with e4b6d27b4ec456b05cb9c5fa1e6b5e5109c13d62a0c85c5624c853d1bd695d4d not found: ID does not exist"
Jul 10 19:43:00.229580 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.229556    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"]
Jul 10 19:43:00.232865 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.232846    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/sub-test-model-7207cb-kserve-fccb897d9-wrd52"]
Jul 10 19:43:00.498255 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.498222    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz" podUID="b6a07624-0669-4c6e-83ec-604e3dfa8364" containerName="main" containerID="cri-o://389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd" gracePeriod=45
Jul 10 19:43:00.742943 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.742918    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:43:00.821463 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821385    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg8jr\" (UniqueName: \"kubernetes.io/projected/b6a07624-0669-4c6e-83ec-604e3dfa8364-kube-api-access-tg8jr\") pod \"b6a07624-0669-4c6e-83ec-604e3dfa8364\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") "
Jul 10 19:43:00.821463 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821419    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-dshm\") pod \"b6a07624-0669-4c6e-83ec-604e3dfa8364\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") "
Jul 10 19:43:00.821463 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821451    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-model-cache\") pod \"b6a07624-0669-4c6e-83ec-604e3dfa8364\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") "
Jul 10 19:43:00.821749 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821485    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-home\") pod \"b6a07624-0669-4c6e-83ec-604e3dfa8364\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") "
Jul 10 19:43:00.821749 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821516    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-tmp-dir\") pod \"b6a07624-0669-4c6e-83ec-604e3dfa8364\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") "
Jul 10 19:43:00.821749 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821549    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a07624-0669-4c6e-83ec-604e3dfa8364-tls-certs\") pod \"b6a07624-0669-4c6e-83ec-604e3dfa8364\" (UID: \"b6a07624-0669-4c6e-83ec-604e3dfa8364\") "
Jul 10 19:43:00.821886 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821780    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-model-cache" (OuterVolumeSpecName: "model-cache") pod "b6a07624-0669-4c6e-83ec-604e3dfa8364" (UID: "b6a07624-0669-4c6e-83ec-604e3dfa8364"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:43:00.821886 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821799    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b6a07624-0669-4c6e-83ec-604e3dfa8364" (UID: "b6a07624-0669-4c6e-83ec-604e3dfa8364"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:43:00.821886 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.821768    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-home" (OuterVolumeSpecName: "home") pod "b6a07624-0669-4c6e-83ec-604e3dfa8364" (UID: "b6a07624-0669-4c6e-83ec-604e3dfa8364"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:43:00.823535 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.823507    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a07624-0669-4c6e-83ec-604e3dfa8364-kube-api-access-tg8jr" (OuterVolumeSpecName: "kube-api-access-tg8jr") pod "b6a07624-0669-4c6e-83ec-604e3dfa8364" (UID: "b6a07624-0669-4c6e-83ec-604e3dfa8364"). InnerVolumeSpecName "kube-api-access-tg8jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:43:00.823629 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.823555    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-dshm" (OuterVolumeSpecName: "dshm") pod "b6a07624-0669-4c6e-83ec-604e3dfa8364" (UID: "b6a07624-0669-4c6e-83ec-604e3dfa8364"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:43:00.823629 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.823557    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6a07624-0669-4c6e-83ec-604e3dfa8364-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b6a07624-0669-4c6e-83ec-604e3dfa8364" (UID: "b6a07624-0669-4c6e-83ec-604e3dfa8364"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:43:00.922595 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.922566    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg8jr\" (UniqueName: \"kubernetes.io/projected/b6a07624-0669-4c6e-83ec-604e3dfa8364-kube-api-access-tg8jr\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.922595 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.922591    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.922746 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.922600    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.922746 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.922609    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.922746 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.922617    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a07624-0669-4c6e-83ec-604e3dfa8364-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:00.922746 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:00.922626    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a07624-0669-4c6e-83ec-604e3dfa8364-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:43:01.214085 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.214000    2556 generic.go:356] "Generic (PLEG): container finished" podID="b6a07624-0669-4c6e-83ec-604e3dfa8364" containerID="389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd" exitCode=0
Jul 10 19:43:01.214085 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.214044    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"
Jul 10 19:43:01.214085 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.214078    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz" event={"ID":"b6a07624-0669-4c6e-83ec-604e3dfa8364","Type":"ContainerDied","Data":"389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd"}
Jul 10 19:43:01.214609 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.214114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz" event={"ID":"b6a07624-0669-4c6e-83ec-604e3dfa8364","Type":"ContainerDied","Data":"bd396d448b866f1af681b3eeddca3ef8bfd2549ecbf83827fbcdca43ef03c56f"}
Jul 10 19:43:01.214609 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.214132    2556 scope.go:117] "RemoveContainer" containerID="389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd"
Jul 10 19:43:01.222710 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.222692    2556 scope.go:117] "RemoveContainer" containerID="389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd"
Jul 10 19:43:01.222934 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:43:01.222917    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd\": container with ID starting with 389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd not found: ID does not exist" containerID="389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd"
Jul 10 19:43:01.222988 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.222943    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd"} err="failed to get container status \"389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd\": rpc error: code = NotFound desc = could not find container \"389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd\": container with ID starting with 389c09d9f96888e124237619235e578114ac5af3f8f7f967affa429382472afd not found: ID does not exist"
Jul 10 19:43:01.236534 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.236510    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"]
Jul 10 19:43:01.242265 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.242245    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/sub-test-model-3ec3c4-kserve-654df88569-xqksz"]
Jul 10 19:43:01.352043 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.352012    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a07624-0669-4c6e-83ec-604e3dfa8364" path="/var/lib/kubelet/pods/b6a07624-0669-4c6e-83ec-604e3dfa8364/volumes"
Jul 10 19:43:01.352424 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:01.352410    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b8f5d1-494b-4f62-8f14-4f4efab1c752" path="/var/lib/kubelet/pods/b9b8f5d1-494b-4f62-8f14-4f4efab1c752/volumes"
Jul 10 19:43:05.493570 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:05.493532    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:43:08.103652 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:08.103612    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:43:08.104023 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:08.103665    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:43:08.116199 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:08.116143    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:43:08.255428 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:08.255400    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:43:23.198077 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.197989    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"]
Jul 10 19:43:23.198702 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.198303    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b8f5d1-494b-4f62-8f14-4f4efab1c752" containerName="main"
Jul 10 19:43:23.198702 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.198315    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b8f5d1-494b-4f62-8f14-4f4efab1c752" containerName="main"
Jul 10 19:43:23.198702 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.198326    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a07624-0669-4c6e-83ec-604e3dfa8364" containerName="main"
Jul 10 19:43:23.198702 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.198331    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a07624-0669-4c6e-83ec-604e3dfa8364" containerName="main"
Jul 10 19:43:23.198702 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.198393    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b8f5d1-494b-4f62-8f14-4f4efab1c752" containerName="main"
Jul 10 19:43:23.198702 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.198401    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a07624-0669-4c6e-83ec-604e3dfa8364" containerName="main"
Jul 10 19:43:23.200897 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.200877    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.203569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.203543    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"openshift-service-ca.crt\""
Jul 10 19:43:23.204415 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.204393    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"kube-root-ca.crt\""
Jul 10 19:43:23.204717 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.204697    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"rate-test-model-3ec3c4-kserve-self-signed-certs\""
Jul 10 19:43:23.204825 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.204753    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3ec3c4\"/\"default-dockercfg-blkf6\""
Jul 10 19:43:23.210869 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.210849    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"]
Jul 10 19:43:23.301694 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.301657    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tmp-dir\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.301863 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.301710    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-home\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.301863 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.301761    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhsgg\" (UniqueName: \"kubernetes.io/projected/6ee973d6-6d6a-4b01-875a-d280d1f9f907-kube-api-access-nhsgg\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.301863 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.301798    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-dshm\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.301863 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.301851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-model-cache\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.302083 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.301870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tls-certs\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.402420 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402388    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-home\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.402420 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402423    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhsgg\" (UniqueName: \"kubernetes.io/projected/6ee973d6-6d6a-4b01-875a-d280d1f9f907-kube-api-access-nhsgg\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.402649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-dshm\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.402649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-model-cache\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.402649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402585    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tls-certs\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.402649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402618    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tmp-dir\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.402960 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402941    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-home\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.403030 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.402983    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-model-cache\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.403030 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.403005    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tmp-dir\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.404889 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.404870    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-dshm\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.405108 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.405092    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tls-certs\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.410679 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.410657    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhsgg\" (UniqueName: \"kubernetes.io/projected/6ee973d6-6d6a-4b01-875a-d280d1f9f907-kube-api-access-nhsgg\") pod \"rate-test-model-3ec3c4-kserve-598d996995-pblc4\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") " pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.511442 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.511408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:23.639746 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:23.639723    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"]
Jul 10 19:43:23.642095 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:43:23.642065    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ee973d6_6d6a_4b01_875a_d280d1f9f907.slice/crio-5f2cd89ca483ff9898e334e32d77617832bec37cecce4089f87389fba0abf453 WatchSource:0}: Error finding container 5f2cd89ca483ff9898e334e32d77617832bec37cecce4089f87389fba0abf453: Status 404 returned error can't find the container with id 5f2cd89ca483ff9898e334e32d77617832bec37cecce4089f87389fba0abf453
Jul 10 19:43:24.310051 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:24.310017    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4" event={"ID":"6ee973d6-6d6a-4b01-875a-d280d1f9f907","Type":"ContainerStarted","Data":"ecfed47b4dcec82c2ef9462df4c1eb8dacea83f3b35f55f58fe08cae2a82ea6c"}
Jul 10 19:43:24.310051 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:24.310059    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4" event={"ID":"6ee973d6-6d6a-4b01-875a-d280d1f9f907","Type":"ContainerStarted","Data":"5f2cd89ca483ff9898e334e32d77617832bec37cecce4089f87389fba0abf453"}
Jul 10 19:43:24.329900 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:24.329853    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4" podStartSLOduration=1.3298398470000001 podStartE2EDuration="1.329839847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:43:24.328485988 +0000 UTC m=+2693.517011176" watchObservedRunningTime="2026-07-10 19:43:24.329839847 +0000 UTC m=+2693.518365018"
Jul 10 19:43:27.894022 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:27.893985    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:43:31.412557 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:31.412531    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:43:31.415804 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:31.415784    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:43:31.417200 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:31.417180    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:43:31.420444 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:31.420418    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82rhc_acc95c06-47ea-4b66-abc4-a0dbf6882b8a/ovn-acl-logging/0.log"
Jul 10 19:43:33.511534 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:33.511495    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:33.511940 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:33.511549    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:33.524396 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:33.524372    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:34.364806 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:34.364776    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:43:43.189087 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:43.189040    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:43:59.884684 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:43:59.884649    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:44:06.479760 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:06.479729    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"]
Jul 10 19:44:07.422728 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:07.422694    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"]
Jul 10 19:44:08.315516 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.315476    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7346-139701945936560"]
Jul 10 19:44:08.319001 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.318980    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:08.321379 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.321360    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-drjpt\""
Jul 10 19:44:08.325076 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.325053    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7346-139701945936560"]
Jul 10 19:44:08.376924 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.376897    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl4bz\" (UniqueName: \"kubernetes.io/projected/4b86f46a-1b0c-467d-a7d1-5015522d11b7-kube-api-access-sl4bz\") pod \"test-curl-7346-139701945936560\" (UID: \"4b86f46a-1b0c-467d-a7d1-5015522d11b7\") " pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:08.477714 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.477686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl4bz\" (UniqueName: \"kubernetes.io/projected/4b86f46a-1b0c-467d-a7d1-5015522d11b7-kube-api-access-sl4bz\") pod \"test-curl-7346-139701945936560\" (UID: \"4b86f46a-1b0c-467d-a7d1-5015522d11b7\") " pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:08.488295 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.488273    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl4bz\" (UniqueName: \"kubernetes.io/projected/4b86f46a-1b0c-467d-a7d1-5015522d11b7-kube-api-access-sl4bz\") pod \"test-curl-7346-139701945936560\" (UID: \"4b86f46a-1b0c-467d-a7d1-5015522d11b7\") " pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:08.628680 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.628598    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:08.758940 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.758688    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7346-139701945936560"]
Jul 10 19:44:08.761470 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:44:08.761440    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b86f46a_1b0c_467d_a7d1_5015522d11b7.slice/crio-2f7a856e4d1684f2c7c47efda1720bbd6b662c52473c540a5e3f7f74109d9181 WatchSource:0}: Error finding container 2f7a856e4d1684f2c7c47efda1720bbd6b662c52473c540a5e3f7f74109d9181: Status 404 returned error can't find the container with id 2f7a856e4d1684f2c7c47efda1720bbd6b662c52473c540a5e3f7f74109d9181
Jul 10 19:44:08.762869 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:08.762851    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 19:44:09.499708 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:09.499683    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7346-139701945936560" event={"ID":"4b86f46a-1b0c-467d-a7d1-5015522d11b7","Type":"ContainerStarted","Data":"2f7a856e4d1684f2c7c47efda1720bbd6b662c52473c540a5e3f7f74109d9181"}
Jul 10 19:44:10.505222 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:10.505191    2556 generic.go:356] "Generic (PLEG): container finished" podID="4b86f46a-1b0c-467d-a7d1-5015522d11b7" containerID="c3403ceda69289e4c5dd1ff75d5ef07ab380f453dc40b6a084bd90ca6c8dfa28" exitCode=0
Jul 10 19:44:10.505588 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:10.505227    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7346-139701945936560" event={"ID":"4b86f46a-1b0c-467d-a7d1-5015522d11b7","Type":"ContainerDied","Data":"c3403ceda69289e4c5dd1ff75d5ef07ab380f453dc40b6a084bd90ca6c8dfa28"}
Jul 10 19:44:11.645608 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.645584    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:11.684109 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.684079    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7346-139701945936560_4b86f46a-1b0c-467d-a7d1-5015522d11b7/test-curl-7346-139701945936560/0.log"
Jul 10 19:44:11.705948 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.705783    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl4bz\" (UniqueName: \"kubernetes.io/projected/4b86f46a-1b0c-467d-a7d1-5015522d11b7-kube-api-access-sl4bz\") pod \"4b86f46a-1b0c-467d-a7d1-5015522d11b7\" (UID: \"4b86f46a-1b0c-467d-a7d1-5015522d11b7\") "
Jul 10 19:44:11.706266 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.706233    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7346-139701945936560"]
Jul 10 19:44:11.707796 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.707775    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7346-139701945936560"]
Jul 10 19:44:11.708308 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.708286    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b86f46a-1b0c-467d-a7d1-5015522d11b7-kube-api-access-sl4bz" (OuterVolumeSpecName: "kube-api-access-sl4bz") pod "4b86f46a-1b0c-467d-a7d1-5015522d11b7" (UID: "4b86f46a-1b0c-467d-a7d1-5015522d11b7"). InnerVolumeSpecName "kube-api-access-sl4bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:44:11.807254 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.807175    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl4bz\" (UniqueName: \"kubernetes.io/projected/4b86f46a-1b0c-467d-a7d1-5015522d11b7-kube-api-access-sl4bz\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:11.826931 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.826899    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7346-139701945976240"]
Jul 10 19:44:11.827246 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.827233    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b86f46a-1b0c-467d-a7d1-5015522d11b7" containerName="test-curl-7346-139701945936560"
Jul 10 19:44:11.827305 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.827247    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b86f46a-1b0c-467d-a7d1-5015522d11b7" containerName="test-curl-7346-139701945936560"
Jul 10 19:44:11.827305 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.827298    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b86f46a-1b0c-467d-a7d1-5015522d11b7" containerName="test-curl-7346-139701945936560"
Jul 10 19:44:11.830076 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.830061    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945976240"
Jul 10 19:44:11.834423 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.834399    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7346-139701945976240"]
Jul 10 19:44:11.907856 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:11.907829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkpfb\" (UniqueName: \"kubernetes.io/projected/77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9-kube-api-access-tkpfb\") pod \"test-curl-7346-139701945976240\" (UID: \"77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9\") " pod="openshift-ingress/test-curl-7346-139701945976240"
Jul 10 19:44:12.008638 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:12.008602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkpfb\" (UniqueName: \"kubernetes.io/projected/77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9-kube-api-access-tkpfb\") pod \"test-curl-7346-139701945976240\" (UID: \"77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9\") " pod="openshift-ingress/test-curl-7346-139701945976240"
Jul 10 19:44:12.018267 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:12.018242    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkpfb\" (UniqueName: \"kubernetes.io/projected/77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9-kube-api-access-tkpfb\") pod \"test-curl-7346-139701945976240\" (UID: \"77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9\") " pod="openshift-ingress/test-curl-7346-139701945976240"
Jul 10 19:44:12.139381 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:12.139280    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945976240"
Jul 10 19:44:12.261355 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:12.261326    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7346-139701945976240"]
Jul 10 19:44:12.264356 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:44:12.264324    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77715a64_3c5f_4b06_ac6b_ff3f5fc55cc9.slice/crio-2b52d2f2a4d002f0cf8bbe28b875fa422d05057b1ec29ad2cec114a97cf51ef2 WatchSource:0}: Error finding container 2b52d2f2a4d002f0cf8bbe28b875fa422d05057b1ec29ad2cec114a97cf51ef2: Status 404 returned error can't find the container with id 2b52d2f2a4d002f0cf8bbe28b875fa422d05057b1ec29ad2cec114a97cf51ef2
Jul 10 19:44:12.514975 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:12.514944    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:12.514975 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:12.514973    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f7a856e4d1684f2c7c47efda1720bbd6b662c52473c540a5e3f7f74109d9181"
Jul 10 19:44:12.516060 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:12.516029    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7346-139701945976240" event={"ID":"77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9","Type":"ContainerStarted","Data":"2b52d2f2a4d002f0cf8bbe28b875fa422d05057b1ec29ad2cec114a97cf51ef2"}
Jul 10 19:44:12.525249 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:44:12.525223    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7346-139701945936560\" is forbidden: User \"system:node:ip-10-0-139-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-108.ec2.internal' and this object" podUID="4b86f46a-1b0c-467d-a7d1-5015522d11b7" pod="openshift-ingress/test-curl-7346-139701945936560"
Jul 10 19:44:13.352118 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:13.352084    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b86f46a-1b0c-467d-a7d1-5015522d11b7" path="/var/lib/kubelet/pods/4b86f46a-1b0c-467d-a7d1-5015522d11b7/volumes"
Jul 10 19:44:13.521668 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:13.521623    2556 generic.go:356] "Generic (PLEG): container finished" podID="77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9" containerID="181cce47e057743f92cc32cbc4eb4cf5b893c42b05ec5152b8c0008c878391dd" exitCode=0
Jul 10 19:44:13.521839 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:13.521711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7346-139701945976240" event={"ID":"77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9","Type":"ContainerDied","Data":"181cce47e057743f92cc32cbc4eb4cf5b893c42b05ec5152b8c0008c878391dd"}
Jul 10 19:44:13.994324 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:13.994289    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:44:14.664825 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:14.664798    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945976240"
Jul 10 19:44:14.685099 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:14.685065    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7346-139701945976240_77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9/test-curl-7346-139701945976240/0.log"
Jul 10 19:44:14.706175 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:14.706120    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7346-139701945976240"]
Jul 10 19:44:14.709053 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:14.709028    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7346-139701945976240"]
Jul 10 19:44:14.729772 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:14.729749    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkpfb\" (UniqueName: \"kubernetes.io/projected/77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9-kube-api-access-tkpfb\") pod \"77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9\" (UID: \"77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9\") "
Jul 10 19:44:14.731786 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:14.731766    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9-kube-api-access-tkpfb" (OuterVolumeSpecName: "kube-api-access-tkpfb") pod "77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9" (UID: "77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9"). InnerVolumeSpecName "kube-api-access-tkpfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:44:14.831103 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:14.831018    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkpfb\" (UniqueName: \"kubernetes.io/projected/77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9-kube-api-access-tkpfb\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:15.352267 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:15.352235    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9" path="/var/lib/kubelet/pods/77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9/volumes"
Jul 10 19:44:15.531547 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:15.531518    2556 scope.go:117] "RemoveContainer" containerID="181cce47e057743f92cc32cbc4eb4cf5b893c42b05ec5152b8c0008c878391dd"
Jul 10 19:44:15.531547 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:15.531530    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701945976240"
Jul 10 19:44:21.499513 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.499475    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd" podUID="ede2f72e-ca02-4e5c-8d28-dfec75a5553f" containerName="main" containerID="cri-o://f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5" gracePeriod=45
Jul 10 19:44:21.746887 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.746864    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:44:21.894691 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894609    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-home\") pod \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") "
Jul 10 19:44:21.894691 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894658    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tls-certs\") pod \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") "
Jul 10 19:44:21.894691 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894675    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-model-cache\") pod \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") "
Jul 10 19:44:21.894964 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894736    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq7s4\" (UniqueName: \"kubernetes.io/projected/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-kube-api-access-tq7s4\") pod \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") "
Jul 10 19:44:21.894964 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894765    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-dshm\") pod \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") "
Jul 10 19:44:21.894964 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894796    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tmp-dir\") pod \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\" (UID: \"ede2f72e-ca02-4e5c-8d28-dfec75a5553f\") "
Jul 10 19:44:21.894964 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894892    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-home" (OuterVolumeSpecName: "home") pod "ede2f72e-ca02-4e5c-8d28-dfec75a5553f" (UID: "ede2f72e-ca02-4e5c-8d28-dfec75a5553f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:21.894964 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.894954    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ede2f72e-ca02-4e5c-8d28-dfec75a5553f" (UID: "ede2f72e-ca02-4e5c-8d28-dfec75a5553f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:21.895227 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.895078    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:21.895227 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.895099    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:21.895227 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.895100    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ede2f72e-ca02-4e5c-8d28-dfec75a5553f" (UID: "ede2f72e-ca02-4e5c-8d28-dfec75a5553f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:21.896755 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.896730    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ede2f72e-ca02-4e5c-8d28-dfec75a5553f" (UID: "ede2f72e-ca02-4e5c-8d28-dfec75a5553f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:44:21.896857 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.896833    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-kube-api-access-tq7s4" (OuterVolumeSpecName: "kube-api-access-tq7s4") pod "ede2f72e-ca02-4e5c-8d28-dfec75a5553f" (UID: "ede2f72e-ca02-4e5c-8d28-dfec75a5553f"). InnerVolumeSpecName "kube-api-access-tq7s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:44:21.896915 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.896855    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-dshm" (OuterVolumeSpecName: "dshm") pod "ede2f72e-ca02-4e5c-8d28-dfec75a5553f" (UID: "ede2f72e-ca02-4e5c-8d28-dfec75a5553f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:21.996106 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.996079    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq7s4\" (UniqueName: \"kubernetes.io/projected/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-kube-api-access-tq7s4\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:21.996106 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.996101    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:21.996106 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.996111    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:21.996306 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:21.996119    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ede2f72e-ca02-4e5c-8d28-dfec75a5553f-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:22.442320 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.442278    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4" podUID="6ee973d6-6d6a-4b01-875a-d280d1f9f907" containerName="main" containerID="cri-o://ecfed47b4dcec82c2ef9462df4c1eb8dacea83f3b35f55f58fe08cae2a82ea6c" gracePeriod=45
Jul 10 19:44:22.562130 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.562103    2556 generic.go:356] "Generic (PLEG): container finished" podID="ede2f72e-ca02-4e5c-8d28-dfec75a5553f" containerID="f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5" exitCode=0
Jul 10 19:44:22.562483 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.562182    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"
Jul 10 19:44:22.562483 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.562184    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd" event={"ID":"ede2f72e-ca02-4e5c-8d28-dfec75a5553f","Type":"ContainerDied","Data":"f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5"}
Jul 10 19:44:22.562483 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.562225    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd" event={"ID":"ede2f72e-ca02-4e5c-8d28-dfec75a5553f","Type":"ContainerDied","Data":"2c1f1d12bdd5c19ee82f468c813d07ad6cb67cc369a09afc80238fa63a6b90ee"}
Jul 10 19:44:22.562483 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.562244    2556 scope.go:117] "RemoveContainer" containerID="f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5"
Jul 10 19:44:22.563992 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.563974    2556 generic.go:356] "Generic (PLEG): container finished" podID="6ee973d6-6d6a-4b01-875a-d280d1f9f907" containerID="ecfed47b4dcec82c2ef9462df4c1eb8dacea83f3b35f55f58fe08cae2a82ea6c" exitCode=0
Jul 10 19:44:22.564083 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.564057    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4" event={"ID":"6ee973d6-6d6a-4b01-875a-d280d1f9f907","Type":"ContainerDied","Data":"ecfed47b4dcec82c2ef9462df4c1eb8dacea83f3b35f55f58fe08cae2a82ea6c"}
Jul 10 19:44:22.570176 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.570141    2556 scope.go:117] "RemoveContainer" containerID="f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5"
Jul 10 19:44:22.570504 ip-10-0-139-108 kubenswrapper[2556]: E0710 19:44:22.570476    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5\": container with ID starting with f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5 not found: ID does not exist" containerID="f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5"
Jul 10 19:44:22.570588 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.570519    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5"} err="failed to get container status \"f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5\": rpc error: code = NotFound desc = could not find container \"f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5\": container with ID starting with f07c318d7f167a2033272158f96b8a8182a2dd63f4d2977fd35d449d06c596a5 not found: ID does not exist"
Jul 10 19:44:22.582919 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.582897    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"]
Jul 10 19:44:22.588234 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.588213    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7207cb/rate-test-model-7207cb-kserve-86685fdf95-ztjzd"]
Jul 10 19:44:22.683655 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.683633    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:44:22.802162 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802114    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-model-cache\") pod \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") "
Jul 10 19:44:22.802162 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802163    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tls-certs\") pod \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") "
Jul 10 19:44:22.802391 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802220    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tmp-dir\") pod \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") "
Jul 10 19:44:22.802391 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802244    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-dshm\") pod \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") "
Jul 10 19:44:22.802391 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802267    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-home\") pod \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") "
Jul 10 19:44:22.802391 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802293    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhsgg\" (UniqueName: \"kubernetes.io/projected/6ee973d6-6d6a-4b01-875a-d280d1f9f907-kube-api-access-nhsgg\") pod \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\" (UID: \"6ee973d6-6d6a-4b01-875a-d280d1f9f907\") "
Jul 10 19:44:22.802649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802392    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ee973d6-6d6a-4b01-875a-d280d1f9f907" (UID: "6ee973d6-6d6a-4b01-875a-d280d1f9f907"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:22.802649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802528    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ee973d6-6d6a-4b01-875a-d280d1f9f907" (UID: "6ee973d6-6d6a-4b01-875a-d280d1f9f907"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:22.802649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802544    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-home" (OuterVolumeSpecName: "home") pod "6ee973d6-6d6a-4b01-875a-d280d1f9f907" (UID: "6ee973d6-6d6a-4b01-875a-d280d1f9f907"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:22.802649 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.802551    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-model-cache\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:22.804392 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.804372    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ee973d6-6d6a-4b01-875a-d280d1f9f907" (UID: "6ee973d6-6d6a-4b01-875a-d280d1f9f907"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:44:22.804458 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.804442    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee973d6-6d6a-4b01-875a-d280d1f9f907-kube-api-access-nhsgg" (OuterVolumeSpecName: "kube-api-access-nhsgg") pod "6ee973d6-6d6a-4b01-875a-d280d1f9f907" (UID: "6ee973d6-6d6a-4b01-875a-d280d1f9f907"). InnerVolumeSpecName "kube-api-access-nhsgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:44:22.804502 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.804446    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-dshm" (OuterVolumeSpecName: "dshm") pod "6ee973d6-6d6a-4b01-875a-d280d1f9f907" (UID: "6ee973d6-6d6a-4b01-875a-d280d1f9f907"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:44:22.903399 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.903371    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-home\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:22.903399 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.903393    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhsgg\" (UniqueName: \"kubernetes.io/projected/6ee973d6-6d6a-4b01-875a-d280d1f9f907-kube-api-access-nhsgg\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:22.903399 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.903404    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tls-certs\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:22.903594 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.903431    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-tmp-dir\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:22.903594 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:22.903438    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ee973d6-6d6a-4b01-875a-d280d1f9f907-dshm\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:23.352965 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:23.352933    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede2f72e-ca02-4e5c-8d28-dfec75a5553f" path="/var/lib/kubelet/pods/ede2f72e-ca02-4e5c-8d28-dfec75a5553f/volumes"
Jul 10 19:44:23.573012 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:23.572973    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4" event={"ID":"6ee973d6-6d6a-4b01-875a-d280d1f9f907","Type":"ContainerDied","Data":"5f2cd89ca483ff9898e334e32d77617832bec37cecce4089f87389fba0abf453"}
Jul 10 19:44:23.573012 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:23.573011    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"
Jul 10 19:44:23.573569 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:23.573027    2556 scope.go:117] "RemoveContainer" containerID="ecfed47b4dcec82c2ef9462df4c1eb8dacea83f3b35f55f58fe08cae2a82ea6c"
Jul 10 19:44:23.589774 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:23.589751    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"]
Jul 10 19:44:23.593434 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:23.593414    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3ec3c4/rate-test-model-3ec3c4-kserve-598d996995-pblc4"]
Jul 10 19:44:24.188849 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.188809    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7346-139701951233888"]
Jul 10 19:44:24.189172 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189138    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede2f72e-ca02-4e5c-8d28-dfec75a5553f" containerName="main"
Jul 10 19:44:24.189271 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189174    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede2f72e-ca02-4e5c-8d28-dfec75a5553f" containerName="main"
Jul 10 19:44:24.189271 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189187    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9" containerName="test-curl-7346-139701945976240"
Jul 10 19:44:24.189271 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189196    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9" containerName="test-curl-7346-139701945976240"
Jul 10 19:44:24.189271 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189216    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee973d6-6d6a-4b01-875a-d280d1f9f907" containerName="main"
Jul 10 19:44:24.189271 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189225    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee973d6-6d6a-4b01-875a-d280d1f9f907" containerName="main"
Jul 10 19:44:24.189517 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189319    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="77715a64-3c5f-4b06-ac6b-ff3f5fc55cc9" containerName="test-curl-7346-139701945976240"
Jul 10 19:44:24.189517 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189332    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee973d6-6d6a-4b01-875a-d280d1f9f907" containerName="main"
Jul 10 19:44:24.189517 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.189344    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede2f72e-ca02-4e5c-8d28-dfec75a5553f" containerName="main"
Jul 10 19:44:24.192269 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.192246    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701951233888"
Jul 10 19:44:24.195236 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.195213    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-drjpt\""
Jul 10 19:44:24.196431 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.196407    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7346-139701951233888"]
Jul 10 19:44:24.316047 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.316016    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzkd\" (UniqueName: \"kubernetes.io/projected/f6205a21-5f58-46df-af91-1c9298d494de-kube-api-access-chzkd\") pod \"test-curl-7346-139701951233888\" (UID: \"f6205a21-5f58-46df-af91-1c9298d494de\") " pod="openshift-ingress/test-curl-7346-139701951233888"
Jul 10 19:44:24.417139 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.417104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzkd\" (UniqueName: \"kubernetes.io/projected/f6205a21-5f58-46df-af91-1c9298d494de-kube-api-access-chzkd\") pod \"test-curl-7346-139701951233888\" (UID: \"f6205a21-5f58-46df-af91-1c9298d494de\") " pod="openshift-ingress/test-curl-7346-139701951233888"
Jul 10 19:44:24.427241 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.427207    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzkd\" (UniqueName: \"kubernetes.io/projected/f6205a21-5f58-46df-af91-1c9298d494de-kube-api-access-chzkd\") pod \"test-curl-7346-139701951233888\" (UID: \"f6205a21-5f58-46df-af91-1c9298d494de\") " pod="openshift-ingress/test-curl-7346-139701951233888"
Jul 10 19:44:24.502020 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.501991    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701951233888"
Jul 10 19:44:24.628679 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:24.628491    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7346-139701951233888"]
Jul 10 19:44:24.631271 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:44:24.631246    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6205a21_5f58_46df_af91_1c9298d494de.slice/crio-d196a8755a8136e0162446d488f43cd3898eaaad68534da96d74bffcc1c6f841 WatchSource:0}: Error finding container d196a8755a8136e0162446d488f43cd3898eaaad68534da96d74bffcc1c6f841: Status 404 returned error can't find the container with id d196a8755a8136e0162446d488f43cd3898eaaad68534da96d74bffcc1c6f841
Jul 10 19:44:25.352768 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:25.352738    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee973d6-6d6a-4b01-875a-d280d1f9f907" path="/var/lib/kubelet/pods/6ee973d6-6d6a-4b01-875a-d280d1f9f907/volumes"
Jul 10 19:44:25.583419 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:25.583388    2556 generic.go:356] "Generic (PLEG): container finished" podID="f6205a21-5f58-46df-af91-1c9298d494de" containerID="204be4fabd8f1bc3387a32853d03afc1d956469a5a8ca20e23278c3255aa48ee" exitCode=0
Jul 10 19:44:25.583587 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:25.583474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7346-139701951233888" event={"ID":"f6205a21-5f58-46df-af91-1c9298d494de","Type":"ContainerDied","Data":"204be4fabd8f1bc3387a32853d03afc1d956469a5a8ca20e23278c3255aa48ee"}
Jul 10 19:44:25.583587 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:25.583512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7346-139701951233888" event={"ID":"f6205a21-5f58-46df-af91-1c9298d494de","Type":"ContainerStarted","Data":"d196a8755a8136e0162446d488f43cd3898eaaad68534da96d74bffcc1c6f841"}
Jul 10 19:44:26.725994 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:26.725972    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701951233888"
Jul 10 19:44:26.745777 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:26.745749    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7346-139701951233888_f6205a21-5f58-46df-af91-1c9298d494de/test-curl-7346-139701951233888/0.log"
Jul 10 19:44:26.770293 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:26.770263    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7346-139701951233888"]
Jul 10 19:44:26.772305 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:26.772280    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7346-139701951233888"]
Jul 10 19:44:26.838224 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:26.838196    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chzkd\" (UniqueName: \"kubernetes.io/projected/f6205a21-5f58-46df-af91-1c9298d494de-kube-api-access-chzkd\") pod \"f6205a21-5f58-46df-af91-1c9298d494de\" (UID: \"f6205a21-5f58-46df-af91-1c9298d494de\") "
Jul 10 19:44:26.840303 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:26.840245    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6205a21-5f58-46df-af91-1c9298d494de-kube-api-access-chzkd" (OuterVolumeSpecName: "kube-api-access-chzkd") pod "f6205a21-5f58-46df-af91-1c9298d494de" (UID: "f6205a21-5f58-46df-af91-1c9298d494de"). InnerVolumeSpecName "kube-api-access-chzkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:44:26.939519 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:26.939490    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chzkd\" (UniqueName: \"kubernetes.io/projected/f6205a21-5f58-46df-af91-1c9298d494de-kube-api-access-chzkd\") on node \"ip-10-0-139-108.ec2.internal\" DevicePath \"\""
Jul 10 19:44:27.351898 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:27.351861    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6205a21-5f58-46df-af91-1c9298d494de" path="/var/lib/kubelet/pods/f6205a21-5f58-46df-af91-1c9298d494de/volumes"
Jul 10 19:44:27.593335 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:27.593307    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7346-139701951233888"
Jul 10 19:44:27.593524 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:27.593307    2556 scope.go:117] "RemoveContainer" containerID="204be4fabd8f1bc3387a32853d03afc1d956469a5a8ca20e23278c3255aa48ee"
Jul 10 19:44:40.890247 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:44:40.890212    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:45:06.589769 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:06.589729    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-27xwk"]
Jul 10 19:45:19.498381 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:19.498350    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c487c7465-nlnwj_5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5/authorino/0.log"
Jul 10 19:45:24.776045 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:24.776017    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfcf59dd-vsn6f_80d44188-5341-4f51-bddc-56106c2c3475/copy-manifests/0.log"
Jul 10 19:45:24.782814 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:24.782794    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfcf59dd-vsn6f_80d44188-5341-4f51-bddc-56106c2c3475/manager/0.log"
Jul 10 19:45:28.093507 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:28.093471    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c487c7465-nlnwj_5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5/authorino/0.log"
Jul 10 19:45:28.777184 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:28.777139    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-27xwk_c4cb302a-f6aa-4b4e-8242-0af29dcd16c8/limitador/0.log"
Jul 10 19:45:29.537878 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:29.537852    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-697457d895-l5x9x_041d4d30-f150-4bb8-aa28-2f62f57619bb/kube-auth-proxy/0.log"
Jul 10 19:45:30.874708 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:30.874680    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-krxwf_2b5aff3f-cec9-49c1-9102-b940d266828a/main/0.log"
Jul 10 19:45:34.325673 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.325624    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q9l4b/must-gather-vsfcn"]
Jul 10 19:45:34.326188 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.326102    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6205a21-5f58-46df-af91-1c9298d494de" containerName="test-curl-7346-139701951233888"
Jul 10 19:45:34.326188 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.326120    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6205a21-5f58-46df-af91-1c9298d494de" containerName="test-curl-7346-139701951233888"
Jul 10 19:45:34.326327 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.326247    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6205a21-5f58-46df-af91-1c9298d494de" containerName="test-curl-7346-139701951233888"
Jul 10 19:45:34.329305 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.329283    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.332047 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.332026    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9l4b\"/\"openshift-service-ca.crt\""
Jul 10 19:45:34.332182 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.332028    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q9l4b\"/\"default-dockercfg-7kvh2\""
Jul 10 19:45:34.332182 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.332060    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9l4b\"/\"kube-root-ca.crt\""
Jul 10 19:45:34.338944 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.338919    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9l4b/must-gather-vsfcn"]
Jul 10 19:45:34.479135 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.479093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bw6x\" (UniqueName: \"kubernetes.io/projected/e71ebf70-d939-46e3-a998-71b64a6586f6-kube-api-access-6bw6x\") pod \"must-gather-vsfcn\" (UID: \"e71ebf70-d939-46e3-a998-71b64a6586f6\") " pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.479363 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.479265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e71ebf70-d939-46e3-a998-71b64a6586f6-must-gather-output\") pod \"must-gather-vsfcn\" (UID: \"e71ebf70-d939-46e3-a998-71b64a6586f6\") " pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.580501 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.580410    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e71ebf70-d939-46e3-a998-71b64a6586f6-must-gather-output\") pod \"must-gather-vsfcn\" (UID: \"e71ebf70-d939-46e3-a998-71b64a6586f6\") " pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.580501 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.580456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bw6x\" (UniqueName: \"kubernetes.io/projected/e71ebf70-d939-46e3-a998-71b64a6586f6-kube-api-access-6bw6x\") pod \"must-gather-vsfcn\" (UID: \"e71ebf70-d939-46e3-a998-71b64a6586f6\") " pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.580771 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.580751    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e71ebf70-d939-46e3-a998-71b64a6586f6-must-gather-output\") pod \"must-gather-vsfcn\" (UID: \"e71ebf70-d939-46e3-a998-71b64a6586f6\") " pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.590368 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.590333    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bw6x\" (UniqueName: \"kubernetes.io/projected/e71ebf70-d939-46e3-a998-71b64a6586f6-kube-api-access-6bw6x\") pod \"must-gather-vsfcn\" (UID: \"e71ebf70-d939-46e3-a998-71b64a6586f6\") " pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.638884 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.638852    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9l4b/must-gather-vsfcn"
Jul 10 19:45:34.782068 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.782044    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9l4b/must-gather-vsfcn"]
Jul 10 19:45:34.784743 ip-10-0-139-108 kubenswrapper[2556]: W0710 19:45:34.784710    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode71ebf70_d939_46e3_a998_71b64a6586f6.slice/crio-022b3eae4318e1e04b0b4f45d4b0895e06cf75d154912f5ed5a774447876d619 WatchSource:0}: Error finding container 022b3eae4318e1e04b0b4f45d4b0895e06cf75d154912f5ed5a774447876d619: Status 404 returned error can't find the container with id 022b3eae4318e1e04b0b4f45d4b0895e06cf75d154912f5ed5a774447876d619
Jul 10 19:45:34.878274 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:34.878179    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9l4b/must-gather-vsfcn" event={"ID":"e71ebf70-d939-46e3-a998-71b64a6586f6","Type":"ContainerStarted","Data":"022b3eae4318e1e04b0b4f45d4b0895e06cf75d154912f5ed5a774447876d619"}
Jul 10 19:45:35.888854 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:35.888816    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9l4b/must-gather-vsfcn" event={"ID":"e71ebf70-d939-46e3-a998-71b64a6586f6","Type":"ContainerStarted","Data":"37f8dac500a9d7326bcdd0e8a102e5f5cbaa2bb8ebd938fa4f9f40e87eccdea8"}
Jul 10 19:45:35.889349 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:35.888870    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9l4b/must-gather-vsfcn" event={"ID":"e71ebf70-d939-46e3-a998-71b64a6586f6","Type":"ContainerStarted","Data":"e818ce3b0984ca2b03d79a58ae99566b2d49cf36f6550cb6d85aa021f7f4629e"}
Jul 10 19:45:35.909657 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:35.909537    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q9l4b/must-gather-vsfcn" podStartSLOduration=1.045169543 podStartE2EDuration="1.909514164s" totalImagesPullingTime="864.344621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:45:35.90849646 +0000 UTC m=+2825.097021625" watchObservedRunningTime="2026-07-10 19:45:35.909514164 +0000 UTC m=+2825.098039338"
Jul 10 19:45:37.320588 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:37.320554    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4c9q6_45c81fd8-1c96-44ab-aa35-a80dab1f8204/global-pull-secret-syncer/0.log"
Jul 10 19:45:37.503187 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:37.503142    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-svcd9_047d827d-c983-4c5d-b1bf-51457743fa01/konnectivity-agent/0.log"
Jul 10 19:45:37.617457 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:37.617379    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-108.ec2.internal_358e0de60fbd33a58841a6c3c2eebdab/haproxy/0.log"
Jul 10 19:45:42.954296 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:42.954258    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c487c7465-nlnwj_5a4a0f0a-8d18-42b5-b2db-8ae2d3dc35d5/authorino/0.log"
Jul 10 19:45:43.348556 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:43.348519    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-27xwk_c4cb302a-f6aa-4b4e-8242-0af29dcd16c8/limitador/0.log"
Jul 10 19:45:45.333173 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:45.333123    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-bj4sf_a45ea9ba-82ba-49f7-b8ec-4bfbc89fcf33/cluster-monitoring-operator/0.log"
Jul 10 19:45:45.581656 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:45.581542    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffczk_45d6428e-af44-436f-9b1d-a1285a36172e/node-exporter/0.log"
Jul 10 19:45:45.603831 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:45.603764    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffczk_45d6428e-af44-436f-9b1d-a1285a36172e/kube-rbac-proxy/0.log"
Jul 10 19:45:45.627660 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:45.627629    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffczk_45d6428e-af44-436f-9b1d-a1285a36172e/init-textfile/0.log"
Jul 10 19:45:47.016584 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.016547    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"]
Jul 10 19:45:47.021755 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.021726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.033600 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.033570    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"]
Jul 10 19:45:47.196944 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.196900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-sys\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.197285 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.197262    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpnjs\" (UniqueName: \"kubernetes.io/projected/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-kube-api-access-tpnjs\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.197478 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.197462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-proc\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.197631 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.197617    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-podres\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.197792 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.197771    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-lib-modules\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.298839 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.298749    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpnjs\" (UniqueName: \"kubernetes.io/projected/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-kube-api-access-tpnjs\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299113 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299092    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-proc\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299356 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-podres\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299491 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-lib-modules\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299491 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-proc\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299610 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299525    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-podres\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299610 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-sys\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299610 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299561    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-lib-modules\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.299610 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.299578    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-sys\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.308689 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.308664    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpnjs\" (UniqueName: \"kubernetes.io/projected/e75b5bd0-4296-4f02-8d40-1e7eabd8bed0-kube-api-access-tpnjs\") pod \"perf-node-gather-daemonset-hbq26\" (UID: \"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0\") " pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.335191 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.335140    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.526196 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.526118    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"]
Jul 10 19:45:47.978553 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.978464    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26" event={"ID":"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0","Type":"ContainerStarted","Data":"5df30d80536feef4d2fc6725606892ffae8ec894b67437968194293e0bc96218"}
Jul 10 19:45:47.978553 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.978521    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26" event={"ID":"e75b5bd0-4296-4f02-8d40-1e7eabd8bed0","Type":"ContainerStarted","Data":"3ebbed85ff570b93dd2f7fe603e38be241ba6d054ebc9a2e777fa684265378d2"}
Jul 10 19:45:47.978739 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.978613    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:47.997407 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:47.997335    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26" podStartSLOduration=1.997315327 podStartE2EDuration="1.997315327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:45:47.994952295 +0000 UTC m=+2837.183477468" watchObservedRunningTime="2026-07-10 19:45:47.997315327 +0000 UTC m=+2837.185840502"
Jul 10 19:45:48.068414 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:48.068386    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/2.log"
Jul 10 19:45:48.074952 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:48.074914    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xpb8v_e04c462f-1228-4a9c-8edc-c35416fe21ac/console-operator/3.log"
Jul 10 19:45:48.542096 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:48.542061    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54fbff55c-hf569_067e8c21-dd0a-4b49-a699-6eac8446b64c/console/0.log"
Jul 10 19:45:50.229668 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:50.229627    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-58nj5_1108ee5d-2e79-40e4-97fb-01d41bb43583/dns/0.log"
Jul 10 19:45:50.255036 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:50.254998    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-58nj5_1108ee5d-2e79-40e4-97fb-01d41bb43583/kube-rbac-proxy/0.log"
Jul 10 19:45:50.407473 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:50.407436    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p7ct2_f9c519d6-a78e-4d7b-9834-cd1b40370815/dns-node-resolver/0.log"
Jul 10 19:45:51.089737 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:51.089707    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nq82_fe60dcc8-96b5-4a96-b372-b05910831a32/node-ca/0.log"
Jul 10 19:45:52.413939 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:52.413911    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-697457d895-l5x9x_041d4d30-f150-4bb8-aa28-2f62f57619bb/kube-auth-proxy/0.log"
Jul 10 19:45:53.352816 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:53.352790    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rnmln_8d7dfd2e-b2d1-4b38-994c-87b058662e65/serve-healthcheck-canary/0.log"
Jul 10 19:45:53.935848 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:53.935822    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cwjl_0c0a257f-857a-4714-a05f-f93b900059d6/kube-rbac-proxy/0.log"
Jul 10 19:45:53.959070 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:53.959043    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cwjl_0c0a257f-857a-4714-a05f-f93b900059d6/exporter/0.log"
Jul 10 19:45:53.984504 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:53.984479    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cwjl_0c0a257f-857a-4714-a05f-f93b900059d6/extractor/0.log"
Jul 10 19:45:53.995992 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:53.995969    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q9l4b/perf-node-gather-daemonset-hbq26"
Jul 10 19:45:57.119898 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:57.119816    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfcf59dd-vsn6f_80d44188-5341-4f51-bddc-56106c2c3475/manager/0.log"
Jul 10 19:45:57.141287 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:57.141264    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cfcf59dd-vsn6f_80d44188-5341-4f51-bddc-56106c2c3475/copy-manifests/0.log"
Jul 10 19:45:57.874518 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:57.874479    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-697457d895-l5x9x_041d4d30-f150-4bb8-aa28-2f62f57619bb/kube-auth-proxy/0.log"
Jul 10 19:45:58.559544 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:58.559511    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b69967895-4dhns_83d43444-5674-4518-8bf7-90efbe12fd6b/manager/0.log"
Jul 10 19:45:58.627879 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:58.627801    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pql99_76491635-3221-4dd0-8e0a-d1a356e97103/openshift-lws-operator/0.log"
Jul 10 19:45:59.502773 ip-10-0-139-108 kubenswrapper[2556]: I0710 19:45:59.502743    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-697457d895-l5x9x_041d4d30-f150-4bb8-aa28-2f62f57619bb/kube-auth-proxy/0.log"